2024-01-22T10:00:31.393 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-22T10:00:31.393 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-common}} --archive /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821 --verbose --name vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi -- /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/orig.config.yaml 2024-01-22T10:00:31.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T10:00:31.524 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821 branch: wip-vshankar-testing-20240119.075157-1 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-common}} email: vshankar@redhat.com first_in_suite: false job_id: '7525821' kernel: client: branch: testing flavor: default kdb: true sha1: 06652275eb934672217aaf9d4180f4a90395eb16 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240119.075157-1 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 1db5459e688287ea17e1bda532d3c81a51b40e23 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1db5459e688287ea17e1bda532d3c81a51b40e23 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240119.075157-1 sha1: 1db5459e688287ea17e1bda532d3c81a51b40e23 owner: scheduled_vshankar@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 2348 sha1: 1db5459e688287ea17e1bda532d3c81a51b40e23 sleep_before_teardown: 0 subset: 48/1024 suite: fs suite_branch: wip-vshankar-testing-20240119.075157-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1db5459e688287ea17e1bda532d3c81a51b40e23/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1db5459e688287ea17e1bda532d3c81a51b40e23 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGm5qBD0MFmF8O4lnKGEV6qA0sCe4oCTIPKXrZ7F3jhJe9dA72pdz5ZT53WhJ1X0wob/kQHl6oFQiBqWYfH3pjo= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCY0m/WpUHgCVnUUbvaYPkk/w+THGvIi/cNKNAZvjymIqqgQLUoISRXPsIPcRbLekfvBUKvLgs+lfl6KCwQLxYs= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC2rvdlHQbUj1hPmC8FBgSykvYQbw/1D74T2kAubvxkL9ZH4gsqn9nigCpVq58EdCyzuMuTCTLyMYsbSWK3olCE= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-22_07:03:31 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-22T10:00:31.524 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1db5459e688287ea17e1bda532d3c81a51b40e23/qa; will attempt to use it 2024-01-22T10:00:31.525 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1db5459e688287ea17e1bda532d3c81a51b40e23/qa/tasks 2024-01-22T10:00:31.525 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-22T10:00:31.527 INFO:teuthology.task.internal:Checking packages... 2024-01-22T10:00:31.549 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1db5459e688287ea17e1bda532d3c81a51b40e23' 2024-01-22T10:00:31.549 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-22T10:00:31.549 INFO:teuthology.packaging:ref: None 2024-01-22T10:00:31.549 INFO:teuthology.packaging:tag: None 2024-01-22T10:00:31.549 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240119.075157-1 2024-01-22T10:00:31.549 INFO:teuthology.packaging:sha1: 1db5459e688287ea17e1bda532d3c81a51b40e23 2024-01-22T10:00:31.550 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240119.075157-1 2024-01-22T10:00:31.786 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-815.g1db5459e 2024-01-22T10:00:31.787 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-22T10:00:31.793 INFO:teuthology.task.internal:no buildpackages task found 2024-01-22T10:00:31.793 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-22T10:00:31.802 INFO:teuthology.task.internal:Saving configuration 2024-01-22T10:00:31.819 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-22T10:00:31.826 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-22T10:00:31.850 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 09:54:49.318258', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGm5qBD0MFmF8O4lnKGEV6qA0sCe4oCTIPKXrZ7F3jhJe9dA72pdz5ZT53WhJ1X0wob/kQHl6oFQiBqWYfH3pjo='} 2024-01-22T10:00:31.875 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 09:54:49.315322', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCY0m/WpUHgCVnUUbvaYPkk/w+THGvIi/cNKNAZvjymIqqgQLUoISRXPsIPcRbLekfvBUKvLgs+lfl6KCwQLxYs='} 2024-01-22T10:00:31.900 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 09:54:49.317158', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC2rvdlHQbUj1hPmC8FBgSykvYQbw/1D74T2kAubvxkL9ZH4gsqn9nigCpVq58EdCyzuMuTCTLyMYsbSWK3olCE='} 2024-01-22T10:00:31.900 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-22T10:00:31.908 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-01-22T10:00:31.909 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-01-22T10:00:31.909 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['client.0'] 2024-01-22T10:00:31.909 INFO:teuthology.run_tasks:Running task console_log... 2024-01-22T10:00:32.012 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8fa02f7160>, signals=[15]) 2024-01-22T10:00:32.012 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-22T10:00:32.020 INFO:teuthology.task.internal:Opening connections... 2024-01-22T10:00:32.020 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-01-22T10:00:32.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T10:00:32.116 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-01-22T10:00:32.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T10:00:32.209 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-01-22T10:00:32.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T10:00:32.300 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-22T10:00:32.308 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-01-22T10:00:32.326 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-01-22T10:00:32.326 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-01-22T10:00:32.384 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-01-22T10:00:32.384 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-01-22T10:00:32.384 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-01-22T10:00:32.384 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-01-22T10:00:32.384 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-01-22T10:00:32.384 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-01-22T10:00:32.384 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-22T10:00:32.384 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-01-22T10:00:32.384 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-01-22T10:00:32.384 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-22T10:00:32.384 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-01-22T10:00:32.385 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-22T10:00:32.385 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-22T10:00:32.385 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-22T10:00:32.385 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-01-22T10:00:32.412 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-01-22T10:00:32.430 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-01-22T10:00:32.430 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-01-22T10:00:32.487 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-01-22T10:00:32.487 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-01-22T10:00:32.488 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-01-22T10:00:32.488 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-01-22T10:00:32.488 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-01-22T10:00:32.488 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-01-22T10:00:32.488 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-22T10:00:32.488 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-01-22T10:00:32.489 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-01-22T10:00:32.489 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-22T10:00:32.489 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-01-22T10:00:32.489 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-22T10:00:32.489 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-22T10:00:32.489 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-22T10:00:32.489 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-01-22T10:00:32.512 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-01-22T10:00:32.529 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-01-22T10:00:32.529 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-01-22T10:00:32.586 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-01-22T10:00:32.586 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-01-22T10:00:32.586 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-01-22T10:00:32.586 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-01-22T10:00:32.587 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-01-22T10:00:32.587 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-01-22T10:00:32.587 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-22T10:00:32.587 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-01-22T10:00:32.587 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-01-22T10:00:32.587 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-22T10:00:32.587 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-01-22T10:00:32.587 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-22T10:00:32.587 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-22T10:00:32.587 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-22T10:00:32.587 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-01-22T10:00:32.612 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-22T10:00:32.623 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-22T10:00:32.630 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-22T10:00:32.630 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-01-22T10:00:32.633 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-01-22T10:00:32.635 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-01-22T10:00:32.651 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-22T10:00:32.661 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-22T10:00:32.661 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-01-22T10:00:32.689 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-01-22T10:00:32.691 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-01-22T10:00:32.772 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-22T10:00:32.851 INFO:teuthology.run_tasks:Running task kernel... 2024-01-22T10:00:32.867 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '06652275eb934672217aaf9d4180f4a90395eb16'} 2024-01-22T10:00:32.868 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-01-22T10:00:32.868 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-01-22T10:00:32.868 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-22T10:00:32.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:00:32.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-01-22T10:00:33.193 DEBUG:teuthology.task.kernel:sha1 for client.0 is 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T10:00:33.193 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "06652275eb934672217aaf9d4180f4a90395eb16"... 2024-01-22T10:00:33.193 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-01-22T10:00:33.211 INFO:teuthology.orchestra.run.smithi161.stdout:5.14.0-361.el9.x86_64 2024-01-22T10:00:33.211 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T10:00:33.211 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-22T10:00:33.212 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum upgrade -y linux-firmware 2024-01-22T10:00:35.317 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2024-01-22T10:00:36.618 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.0 MB 00:00 2024-01-22T10:00:40.541 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.0 MB 00:03 2024-01-22T10:00:43.945 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 19 MB 00:02 2024-01-22T10:00:49.168 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 5.9 MB 00:01 2024-01-22T10:00:50.627 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 15 kB 00:00 2024-01-22T10:01:01.653 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 1.9 MB/s | 20 MB 00:10 2024-01-22T10:01:06.652 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-01-22T10:01:09.020 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-01-22T10:01:09.032 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-01-22T10:01:09.032 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-01-22T10:01:09.032 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-01-22T10:01:09.032 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2024-01-22T10:01:09.032 INFO:teuthology.orchestra.run.smithi161.stdout: linux-firmware noarch 20240109-142.el9 CentOS-BaseOS 375 M 2024-01-22T10:01:09.032 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:01:09.033 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-01-22T10:01:09.033 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-01-22T10:01:09.033 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 1 Package 2024-01-22T10:01:09.033 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:01:09.033 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 375 M 2024-01-22T10:01:09.033 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-01-22T10:01:18.369 INFO:teuthology.orchestra.run.smithi161.stdout:linux-firmware-20240109-142.el9.noarch.rpm 40 MB/s | 375 MB 00:09 2024-01-22T10:01:18.372 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-01-22T10:01:18.372 INFO:teuthology.orchestra.run.smithi161.stdout:Total 40 MB/s | 375 MB 00:09 2024-01-22T10:01:18.372 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-01-22T10:01:18.451 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-01-22T10:01:18.451 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-01-22T10:01:20.936 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-01-22T10:01:20.937 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-01-22T10:01:27.454 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-01-22T10:01:27.821 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : linux-firmware-20240109-142.el9.noarch 1/2 2024-01-22T10:01:27.909 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-01-22T10:01:28.945 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-01-22T10:01:28.945 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : linux-firmware-20240109-142.el9.noarch 1/2 2024-01-22T10:01:29.385 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-01-22T10:01:29.385 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:01:29.386 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2024-01-22T10:01:29.386 INFO:teuthology.orchestra.run.smithi161.stdout: linux-firmware-20240109-142.el9.noarch 2024-01-22T10:01:29.386 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:01:29.386 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-01-22T10:01:29.652 INFO:teuthology.task.kernel:Downloading kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.0... 2024-01-22T10:01:29.652 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-22T10:01:29.911 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/ 2024-01-22T10:01:29.911 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.7.0_g06652275eb93-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/ --input-file=- 2024-01-22T10:01:29.914 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi161.front.sepia.ceph.com to complete... 2024-01-22T10:01:42.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-01-22 10:01:42 URL:https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/kernel-6.7.0_g06652275eb93-1.x86_64.rpm [330048165/330048165] -> "/tmp/kernel.x86_64.rpm" [1] 2024-01-22T10:01:42.503 INFO:teuthology.orchestra.run.smithi161.stderr:FINISHED --2024-01-22 10:01:42-- 2024-01-22T10:01:42.503 INFO:teuthology.orchestra.run.smithi161.stderr:Total wall clock time: 13s 2024-01-22T10:01:42.504 INFO:teuthology.orchestra.run.smithi161.stderr:Downloaded: 1 files, 315M in 12s (25.9 MB/s) 2024-01-22T10:01:42.506 INFO:teuthology.task.kernel:Installing kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.0... 2024-01-22T10:01:42.506 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-01-22T10:01:44.391 INFO:teuthology.orchestra.run.smithi161.stdout:Verifying... ######################################## 2024-01-22T10:01:44.450 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing... ######################################## 2024-01-22T10:01:44.529 INFO:teuthology.orchestra.run.smithi161.stdout:Updating / installing... 2024-01-22T10:01:51.873 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-6.7.0_g06652275eb93-1 ######################################## 2024-01-22T10:02:07.453 INFO:teuthology.orchestra.run.smithi161.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-22T10:02:29.563 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-01-22T10:02:29.564 DEBUG:teuthology.orchestra.run.smithi161:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-01-22T10:02:29.646 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/System.map-6.7.0-g06652275eb93 2024-01-22T10:02:29.646 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/config-6.7.0-g06652275eb93 2024-01-22T10:02:29.646 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/vmlinuz-6.7.0-g06652275eb93 2024-01-22T10:02:29.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93 2024-01-22T10:02:29.646 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32c-intel.ko 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-22T10:02:29.647 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu 2024-01-22T10:02:29.648 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm.ko 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ansi_cprng.ko 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/anubis.ko 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/arc4.ko 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_memcpy.ko 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_pq.ko 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-22T10:02:29.649 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_tx.ko 2024-01-22T10:02:29.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_xor.ko 2024-01-22T10:02:29.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/raid6test.ko 2024-01-22T10:02:29.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authenc.ko 2024-01-22T10:02:29.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authencesn.ko 2024-01-22T10:02:29.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blake2b_generic.ko 2024-01-22T10:02:29.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_common.ko 2024-01-22T10:02:29.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_generic.ko 2024-01-22T10:02:29.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/camellia_generic.ko 2024-01-22T10:02:29.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast5_generic.ko 2024-01-22T10:02:29.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast6_generic.ko 2024-01-22T10:02:29.650 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast_common.ko 2024-01-22T10:02:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ccm.ko 2024-01-22T10:02:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cmac.ko 2024-01-22T10:02:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crc32_generic.ko 2024-01-22T10:02:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_engine.ko 2024-01-22T10:02:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_user.ko 2024-01-22T10:02:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cts.ko 2024-01-22T10:02:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/des_generic.ko 2024-01-22T10:02:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/dh_generic.ko 2024-01-22T10:02:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/echainiv.ko 2024-01-22T10:02:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/essiv.ko 2024-01-22T10:02:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/fcrypt.ko 2024-01-22T10:02:29.651 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/khazad.ko 2024-01-22T10:02:29.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4.ko 2024-01-22T10:02:29.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4hc.ko 2024-01-22T10:02:29.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/md4.ko 2024-01-22T10:02:29.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/michael_mic.ko 2024-01-22T10:02:29.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcbc.ko 2024-01-22T10:02:29.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcrypt.ko 2024-01-22T10:02:29.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/rmd160.ko 2024-01-22T10:02:29.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/seed.ko 2024-01-22T10:02:29.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/serpent_generic.ko 2024-01-22T10:02:29.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tcrypt.ko 2024-01-22T10:02:29.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tea.ko 2024-01-22T10:02:29.652 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_common.ko 2024-01-22T10:02:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_generic.ko 2024-01-22T10:02:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/vmac.ko 2024-01-22T10:02:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/wp512.ko 2024-01-22T10:02:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xcbc.ko 2024-01-22T10:02:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xor.ko 2024-01-22T10:02:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xxhash_generic.ko 2024-01-22T10:02:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers 2024-01-22T10:02:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi 2024-01-22T10:02:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-22T10:02:29.653 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_pad.ko 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/custom_method.ko 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ec_sys.ko 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/platform_profile.ko 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbs.ko 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbshc.ko 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/video.ko 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/acard-ahci.ko 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci_platform.ko 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ata_generic.ko 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci_platform.ko 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_acpi.ko 2024-01-22T10:02:29.654 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ali.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_amd.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_artop.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atiixp.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atp867x.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd640.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd64x.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cypress.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_efar.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt366.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt37x.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it8213.ko 2024-01-22T10:02:29.655 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it821x.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_jmicron.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_marvell.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_mpiix.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_netcell.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ninja32.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87410.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87415.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_oldpiix.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_opti.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_optidma.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pcmcia.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-22T10:02:29.656 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_piccolo.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rdc.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sch.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_serverworks.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sil680.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sis.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sl82c105.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_triflex.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_via.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pdc_adma.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_inic162x.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_mv.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_nv.ko 2024-01-22T10:02:29.657 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_promise.ko 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_qstor.ko 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil.ko 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil24.ko 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sis.ko 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_svw.ko 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sx4.ko 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_uli.ko 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_via.ko 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_vsc.ko 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ks0108.ko 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap 2024-01-22T10:02:29.658 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-i2c.ko 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-mmio.ko 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/bcma.ko 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/aoe.ko 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/brd.ko 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/drbd.ko 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/floppy.ko 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/loop.ko 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/nbd.ko 2024-01-22T10:02:29.659 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk 2024-01-22T10:02:29.660 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/null_blk.ko 2024-01-22T10:02:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/pktcdvd.ko 2024-01-22T10:02:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/rbd.ko 2024-01-22T10:02:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/virtio_blk.ko 2024-01-22T10:02:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback 2024-01-22T10:02:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-22T10:02:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkfront.ko 2024-01-22T10:02:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram 2024-01-22T10:02:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/zram.ko 2024-01-22T10:02:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char 2024-01-22T10:02:29.661 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hangcheck-timer.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/via-rng.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/lp.ko 2024-01-22T10:02:29.662 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/mwave.ko 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ppdev.ko 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tlclk.ko 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm.ko 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis.ko 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/uv_mmtimer.ko 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/virtio_console.ko 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq 2024-01-22T10:02:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/powernow-k8.ko 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp.ko 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-22T10:02:29.664 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-aes.ko 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-sha.ko 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/dca.ko 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat 2024-01-22T10:02:29.665 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/amd64_edac.ko 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/e752x_edac.ko 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/edac_mce_amd.ko 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3000_edac.ko 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3200_edac.ko 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5100_edac.ko 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5400_edac.ko 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7300_edac.ko 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7core_edac.ko 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i82975x_edac.ko 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ie31200_edac.ko 2024-01-22T10:02:29.666 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/sb_edac.ko 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/x38_edac.ko 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/edd.ko 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ich.ko 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-appleir.ko 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-aureal.ko 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-axff.ko 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-dr.ko 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elecom.ko 2024-01-22T10:02:29.667 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elo.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-emsff.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gaff.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gt683r.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gyration.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtekff.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-hyperv.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-icade.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-keytouch.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kye.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lcpower.ko 2024-01-22T10:02:29.668 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-led.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lenovo.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-multitouch.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ortek.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-penmount.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-petalynx.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-picolcd.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-pl.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-plantronics.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-primax.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-rmi.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-common.ko 2024-01-22T10:02:29.669 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-saitek.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-samsung.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sjoy.ko 2024-01-22T10:02:29.670 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sony.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-speedlink.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-steelseries.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sunplus.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tivo.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tmff.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-topseed.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-twinhan.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-uclogic.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-waltop.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-wiimote.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-xinmo.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zpff.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zydacron.ko 2024-01-22T10:02:29.671 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/uhid.ko 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/wacom.ko 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_balloon.ko 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_utils.ko 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_vmbus.ko 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru.ko 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru3.ko 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7414.ko 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7418.ko 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adc128d818.ko 2024-01-22T10:02:29.672 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1025.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1026.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1029.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1031.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm9240.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ads7828.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7410.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7411.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7462.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7470.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7475.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7x10.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/amc6821.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/applesmc.ko 2024-01-22T10:02:29.673 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asb100.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asc7621.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/atxp1.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/coretemp.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dme1737.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds1621.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds620.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc1403.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc6w201.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71805f.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71882fg.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f75375s.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fam15h_power.ko 2024-01-22T10:02:29.674 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fschmd.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g760a.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g762.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl518sm.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl520sm.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5500_temp.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5k_amb.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmaem.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmpex.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina209.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina2xx.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/it87.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k10temp.ko 2024-01-22T10:02:29.675 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k8temp.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lineage-pem.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm63.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm73.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm75.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm77.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm78.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm80.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm83.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm85.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm87.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm90.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm92.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm93.ko 2024-01-22T10:02:29.676 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95234.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95241.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95245.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc2945.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4151.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4215.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4222.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4245.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4260.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4261.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max16065.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1619.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1668.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max197.ko 2024-01-22T10:02:29.677 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6639.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6650.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6697.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mcp3021.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6683.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775-core.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct7802.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87360.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87427.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pcf8591.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-22T10:02:29.678 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/powr1220.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5627.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5636.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht15.ko 2024-01-22T10:02:29.679 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht21.ko 2024-01-22T10:02:29.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/shtc1.ko 2024-01-22T10:02:29.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sis5595.ko 2024-01-22T10:02:29.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47b397.ko 2024-01-22T10:02:29.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m1.ko 2024-01-22T10:02:29.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m192.ko 2024-01-22T10:02:29.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/thmc50.ko 2024-01-22T10:02:29.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp102.ko 2024-01-22T10:02:29.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp103.ko 2024-01-22T10:02:29.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp401.ko 2024-01-22T10:02:29.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp421.ko 2024-01-22T10:02:29.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via-cputemp.ko 2024-01-22T10:02:29.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via686a.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt1211.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt8231.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627ehf.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627hf.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83781d.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83791d.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83792d.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83793.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83795.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l785ts.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l786ng.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-22T10:02:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-22T10:02:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-dev.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-mux.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-01-22T10:02:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-smbus.ko 2024-01-22T10:02:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-stub.ko 2024-01-22T10:02:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband 2024-01-22T10:02:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core 2024-01-22T10:02:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-22T10:02:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_core.ko 2024-01-22T10:02:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-22T10:02:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-22T10:02:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-22T10:02:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-22T10:02:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-22T10:02:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw 2024-01-22T10:02:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-22T10:02:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/gameport.ko 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/joydev.ko 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse 2024-01-22T10:02:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/appletouch.ko 2024-01-22T10:02:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/bcm5974.ko 2024-01-22T10:02:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/cyapatp.ko 2024-01-22T10:02:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-22T10:02:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/sermouse.ko 2024-01-22T10:02:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-22T10:02:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-22T10:02:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-22T10:02:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4 2024-01-22T10:02:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-22T10:02:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio 2024-01-22T10:02:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/altera_ps2.ko 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/arc_ps2.ko 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serio_raw.ko 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/sparse-keymap.ko 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-blinkm.ko 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3530.ko 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp3944.ko 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-ss4200.ko 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-22T10:02:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/bcache.ko 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bio-prison.ko 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache-smq.ko 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache.ko 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-crypt.ko 2024-01-22T10:02:29.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-delay.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-flakey.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log-userspace.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-multipath.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-queue-length.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-raid.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-round-robin.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-service-time.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-switch.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-thin-pool.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-verity.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/faulty.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/linear.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/multipath.ko 2024-01-22T10:02:29.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid0.ko 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid1.ko 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid10.ko 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid456.ko 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptbase.ko 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptctl.ko 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptfc.ko 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptlan.ko 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptsas.ko 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptscsih.ko 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptspi.ko 2024-01-22T10:02:29.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_ich.ko 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_sch.ko 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mfd-core.ko 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/sm501.ko 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/viperboard.ko 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/vx855.ko 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wl1273-core.ko 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds9802als.ko 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds990x.ko 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/bh1770glc.ko 2024-01-22T10:02:29.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/cb710.ko 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/at24.ko 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/max6875.ko 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/enclosure.ko 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hpilo.ko 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29003.ko 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29020.ko 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei 2024-01-22T10:02:29.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-me.ko 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-txe.ko 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei.ko 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru/gru.ko 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xp.ko 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpc.ko 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_7xx1.ko 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_core.ko 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tsl2550.ko 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_balloon.ko 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci 2024-01-22T10:02:29.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/bonding.ko 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dummy.ko 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/eql.ko 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet 2024-01-22T10:02:29.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-22T10:02:29.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e 2024-01-22T10:02:29.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-22T10:02:29.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade 2024-01-22T10:02:29.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna 2024-01-22T10:02:29.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-22T10:02:29.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio 2024-01-22T10:02:29.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb 2024-01-22T10:02:29.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-22T10:02:29.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-01-22T10:02:29.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-22T10:02:29.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-01-22T10:02:29.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-22T10:02:29.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-22T10:02:29.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dnet.ko 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ethoc.ko 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fealnx.ko 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-22T10:02:29.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe 2024-01-22T10:02:29.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/jme.ko 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-01-22T10:02:29.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-22T10:02:29.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-22T10:02:29.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-22T10:02:29.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-22T10:02:29.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/geneve.ko 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ifb.ko 2024-01-22T10:02:29.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvlan.ko 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvtap.ko 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio.ko 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mii.ko 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/net_failover.ko 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/netconsole.ko 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/nlmon.ko 2024-01-22T10:02:29.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/amd.ko 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm87xx.ko 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/broadcom.ko 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/cicada.ko 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/davicom.ko 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/dp83640.ko 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/et1011c.ko 2024-01-22T10:02:29.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/icplus.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/lxt.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/marvell.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/micrel.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/national.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/phylink.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/qsemi.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/realtek.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/smsc.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ste10Xp.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/vitesse.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_async.ko 2024-01-22T10:02:29.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_generic.ko 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppoe.ko 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppox.ko 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pptp.ko 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slhc.ko 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slip.ko 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sungem_phy.ko 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tap.ko 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team 2024-01-22T10:02:29.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team.ko 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_random.ko 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tun.ko 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/veth.ko 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/virtio_net.ko 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/vxlan.ko 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback 2024-01-22T10:02:29.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netfront.ko 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ntb.ko 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme-core.ko 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme.ko 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport.ko 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_cs.ko 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_pc.ko 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_serial.ko 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci 2024-01-22T10:02:29.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie/aer_inject.ko 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/xen-pcifront.ko 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/i82092.ko 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pd6729.ko 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86 2024-01-22T10:02:29.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acerhdf.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/hdaps.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-22T10:02:29.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel_ips.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps 2024-01-22T10:02:29.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps_parport.ko 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/pps_core.ko 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp.ko 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp_kvm.ko 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-22T10:02:29.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-em3027.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max6900.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-22T10:02:29.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-x1205.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-9xxx.ko 2024-01-22T10:02:29.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-sas.ko 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-xxxx.ko 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/BusLogic.ko 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/a100u2w.ko 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/advansys.ko 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/am53c974.ko 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/atp870u.ko 2024-01-22T10:02:29.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/bfa.ko 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ch.ko 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-22T10:02:29.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dc395x.ko 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dmx3191d.ko 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esp_scsi.ko 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-22T10:02:29.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/fnic.ko 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hpsa.ko 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hptiop.ko 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hv_storvsc.ko 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/initio.ko 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ipr.ko 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ips.ko 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/isci.ko 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-22T10:02:29.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/libfc.ko 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi.ko 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/libsas.ko 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid.ko 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas 2024-01-22T10:02:29.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvumi.ko 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pmcraid.ko 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla1280.ko 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/raid_class.ko 2024-01-22T10:02:29.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_debug.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ses.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/st.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/stex.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/virtio_scsi.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/wd719x.ko 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb 2024-01-22T10:02:29.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ssb.ko 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_file.ko 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_iblock.ko 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_mod.ko 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_pscsi.ko 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_user.ko 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-22T10:02:29.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-22T10:02:29.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_gsm.ko 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_hdlc.ko 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/nozomi.ko 2024-01-22T10:02:29.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/arc_uart.ko 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio.ko 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_aec.ko 2024-01-22T10:02:29.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_cif.ko 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pci_generic.ko 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_sercos3.ko 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-acm.ko 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usblp.ko 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usbtmc.ko 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/mdc800.ko 2024-01-22T10:02:29.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/microtek.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/adutux.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/appledisplay.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi26.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi62.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ezusb.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/idmouse.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/iowarrior.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ldusb.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/legousbtower.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-22T10:02:29.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usb3503.ko 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usblcd.ko 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/uss720.ko 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/yurex.ko 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-generic.ko 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/aircable.ko 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ark3116.ko 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ch341.ko 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cp210x.ko 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cyberjack.ko 2024-01-22T10:02:29.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/empeg.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_ti.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipaq.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipw.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ir-usb.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-22T10:02:29.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mct_u232.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7720.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7840.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/navman.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/omninet.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/opticon.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/option.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/oti6858.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/pl2303.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcaux.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcserial.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/quatech2.ko 2024-01-22T10:02:29.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/safe_serial.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/sierra.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ssu100.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/symbolserial.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_debug.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/visor.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/whiteheat.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/uas.ko 2024-01-22T10:02:29.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-karma.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/usb-storage.ko 2024-01-22T10:02:29.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio.ko 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost.ko 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_net.ko 2024-01-22T10:02:29.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_scsi.ko 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/apple_bl.ko 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lcd.ko 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio.ko 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_balloon.ko 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_mmio.ko 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci.ko 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_ring.ko 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1 2024-01-22T10:02:29.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2482.ko 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2490.ko 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-22T10:02:29.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/wire.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/hpwdt.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/i6300esb.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ib700wdt.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ibmasr.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-22T10:02:29.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it87_wdt.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/machzwd.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/nv_tco.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/softdog.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/via_wdt.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-22T10:02:29.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wdt_pci.ko 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/xen_wdt.ko 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-acpi-processor.ko 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-evtchn.ko 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntalloc.ko 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntdev.ko 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-privcmd.ko 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/9p.ko 2024-01-22T10:02:29.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/affs.ko 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/befs.ko 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/binfmt_misc.ko 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/btrfs.ko 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/cachefiles.ko 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ceph.ko 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/coda.ko 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/cramfs.ko 2024-01-22T10:02:29.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/dlm.ko 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs/ecryptfs.ko 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/f2fs.ko 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/fat.ko 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/msdos.ko 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/vfat.ko 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/fscache.ko 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/cuse.ko 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/fuse.ko 2024-01-22T10:02:29.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/gfs2.ko 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/hfs.ko 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/hfsplus.ko 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/isofs.ko 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/jfs.ko 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/lockd.ko 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/minix.ko 2024-01-22T10:02:29.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/netfs.ko 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfs.ko 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv3.ko 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv4.ko 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/grace.ko 2024-01-22T10:02:29.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/nfs_acl.ko 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/nfsd.ko 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/nilfs2.ko 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-celtic.ko 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-centeuro.ko 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-croatian.ko 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-cyrillic.ko 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-gaelic.ko 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-greek.ko 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-iceland.ko 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-inuit.ko 2024-01-22T10:02:29.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-roman.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-romanian.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-turkish.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1250.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1251.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1255.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp737.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp775.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp850.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp852.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp855.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp857.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp860.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp861.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp862.ko 2024-01-22T10:02:29.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp863.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp864.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp865.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp866.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp869.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp874.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp932.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp936.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp949.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp950.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_euc-jp.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-1.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-13.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-14.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-15.ko 2024-01-22T10:02:29.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-2.ko 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-3.ko 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-4.ko 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-5.ko 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-6.ko 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-7.ko 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-9.ko 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-r.ko 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-ru.ko 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-u.ko 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_utf8.ko 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster 2024-01-22T10:02:29.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2.ko 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/overlay.ko 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ramoops.ko 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs 2024-01-22T10:02:29.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/reiserfs.ko 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/romfs.ko 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/cifs.ko 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_arc4.ko 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_md4.ko 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/squashfs.ko 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/sysv.ko 2024-01-22T10:02:29.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/udf.ko 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ufs.ko 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/xfs.ko 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu/rcutorture.ko 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/torture.ko 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/asn1_encoder.ko 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc-itu-t.ko 2024-01-22T10:02:29.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc8.ko 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libarc4.ko 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libdes.ko 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/libcrc32c.ko 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lru_cache.ko 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4_compress.ko 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4hc_compress.ko 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math/cordic.ko 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/raid6_pq.ko 2024-01-22T10:02:29.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_bm.ko 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_fsm.ko 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_kmp.ko 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd/zstd_compress.ko 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm/hwpoison-inject.ko 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/6lowpan.ko 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_dest.ko 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_fragment.ko 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_hop.ko 2024-01-22T10:02:29.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_mobility.ko 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_routing.ko 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_udp.ko 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/garp.ko 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/mrp.ko 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/p8022.ko 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/psnap.ko 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/stp.ko 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/8021q.ko 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet.ko 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_fd.ko 2024-01-22T10:02:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_rdma.ko 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_virtio.ko 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/batman-adv.ko 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/br_netfilter.ko 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/bridge.ko 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-22T10:02:29.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-22T10:02:29.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtables.ko 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/libceph.ko 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/failover.ko 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/pktgen.ko 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp.ko 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_diag.ko 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv4.ko 2024-01-22T10:02:29.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv6.ko 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver/dns_resolver.ko 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/dsa_core.ko 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_brcm.ko 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_dsa.ko 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_none.ko 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_trailer.ko 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154.ko 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-22T10:02:29.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ah4.ko 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/esp4.ko 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/fou.ko 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/gre.ko 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/inet_diag.ko 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_gre.ko 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_tunnel.ko 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_vti.ko 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipcomp.ko 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipip.ko 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-22T10:02:29.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-22T10:02:29.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_bic.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_dctcp.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_diag.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_highspeed.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_htcp.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_hybla.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_illinois.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_lp.ko 2024-01-22T10:02:29.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_scalable.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_vegas.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_veno.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_westwood.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_yeah.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tunnel4.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_diag.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_tunnel.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ah6.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/esp6.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/fou6.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_tunnel.ko 2024-01-22T10:02:29.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_vti.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ipcomp6.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-22T10:02:29.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-22T10:02:29.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/sit.ko 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/tunnel6.ko 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key/af_key.ko 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_core.ko 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_eth.ko 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip.ko 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip6.ko 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_netlink.ko 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ppp.ko 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc.ko 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154 2024-01-22T10:02:29.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/mac802154.ko 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/mpls_gso.ko 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set.ko 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-22T10:02:29.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-22T10:02:29.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conncount.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-22T10:02:29.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_log_syslog.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-22T10:02:29.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_irc.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_sip.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_tables.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_log.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_chain_nat.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_compat.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_ct.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fib.ko 2024-01-22T10:02:29.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_hash.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_limit.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_log.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_masq.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_nat.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_numgen.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_queue.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_quota.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_redir.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject_inet.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_socket.ko 2024-01-22T10:02:29.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_tunnel.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_AUDIT.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CT.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_DSCP.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HL.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HMARK.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LED.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LOG.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NETMAP.ko 2024-01-22T10:02:29.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFLOG.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_RATEEST.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_SECMARK.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TEE.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TPROXY.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TRACE.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_addrtype.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_bpf.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cgroup.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cluster.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_comment.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connbytes.ko 2024-01-22T10:02:29.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlabel.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlimit.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connmark.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_conntrack.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cpu.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dccp.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_devgroup.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dscp.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ecn.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_esp.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hashlimit.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_helper.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hl.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipcomp.ko 2024-01-22T10:02:29.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_iprange.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipvs.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_l2tp.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_length.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_limit.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mac.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mark.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_multiport.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nat.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nfacct.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_osf.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_owner.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_physdev.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_pkttype.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_policy.ko 2024-01-22T10:02:29.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_quota.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_rateest.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_realm.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_recent.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_sctp.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_set.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_socket.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_state.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_statistic.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_string.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpmss.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_time.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_u32.ko 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink 2024-01-22T10:02:29.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/netlink_diag.ko 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/nsh.ko 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/openvswitch.ko 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-geneve.ko 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-gre.ko 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-vxlan.ko 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet/af_packet_diag.ko 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds.ko 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_rdma.ko 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_tcp.ko 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched 2024-01-22T10:02:29.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_csum.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_gact.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_ipt.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_mirred.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_nat.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_pedit.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_police.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_simple.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_skbedit.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_vlan.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_basic.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_bpf.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_flow.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_fw.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_route.ko 2024-01-22T10:02:29.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_u32.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_cmp.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_ipset.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_meta.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_nbyte.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_text.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_u32.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_choke.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_codel.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_drr.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_gred.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hfsc.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hhf.ko 2024-01-22T10:02:29.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_htb.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_ingress.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio_lib.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_multiq.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_netem.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_pie.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_plug.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_prio.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_qfq.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_red.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfb.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfq.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_tbf.ko 2024-01-22T10:02:29.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_teql.ko 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp.ko 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp_diag.ko 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/sunrpc.ko 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/diag.ko 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/tipc.ko 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix 2024-01-22T10:02:29.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix/unix_diag.ko 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock.ko 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys 2024-01-22T10:02:29.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys/trusted.ko 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/irqbypass.ko 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias.bin 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.alias.bin 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.bin 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.modinfo 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep.bin 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.devname 2024-01-22T10:02:29.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.order 2024-01-22T10:02:29.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.softdep 2024-01-22T10:02:29.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols 2024-01-22T10:02:29.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols.bin 2024-01-22T10:02:29.788 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g06652275eb93 2024-01-22T10:02:29.789 DEBUG:teuthology.orchestra.run.smithi161:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-01-22T10:02:29.810 INFO:teuthology.orchestra.run.smithi161.stdout:postinstall scriptlet (using /bin/sh): 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.7.0-g06652275eb93 -a -r /boot/System.map-6.7.0-g06652275eb93 ]; then 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:cp /boot/vmlinuz-6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:cp /boot/System.map-6.7.0-g06652275eb93 /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:rm -f /boot/vmlinuz-6.7.0-g06652275eb93 /boot/System.map-6.7.0-g06652275eb93 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:/sbin/installkernel 6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:rm -f /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:preuninstall scriptlet (using /bin/sh): 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:new-kernel-pkg --remove 6.7.0-g06652275eb93 --rminitrd --initrdfile=/boot/initramfs-6.7.0-g06652275eb93.img 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-install remove 6.7.0-g06652275eb93 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2024-01-22T10:02:29.811 INFO:teuthology.orchestra.run.smithi161.stdout:postuninstall scriptlet (using /bin/sh): 2024-01-22T10:02:29.812 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /sbin/update-bootloader ]; then 2024-01-22T10:02:29.812 INFO:teuthology.orchestra.run.smithi161.stdout:/sbin/update-bootloader --remove 6.7.0-g06652275eb93 2024-01-22T10:02:29.812 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2024-01-22T10:02:29.813 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -qi grub2-tools 2024-01-22T10:02:29.887 INFO:teuthology.orchestra.run.smithi161.stdout:Name : grub2-tools 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:Epoch : 1 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:Version : 2.06 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:Release : 68.el9 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: x86_64 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:Group : Unspecified 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:Size : 8264254 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:License : GPLv3+ 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-22T10:02:29.888 INFO:teuthology.orchestra.run.smithi161.stdout:Packager : builder@centos.org 2024-01-22T10:02:29.889 INFO:teuthology.orchestra.run.smithi161.stdout:Vendor : CentOS 2024-01-22T10:02:29.889 INFO:teuthology.orchestra.run.smithi161.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-22T10:02:29.889 INFO:teuthology.orchestra.run.smithi161.stdout:Summary : Support tools for GRUB. 2024-01-22T10:02:29.889 INFO:teuthology.orchestra.run.smithi161.stdout:Description : 2024-01-22T10:02:29.889 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:02:29.889 INFO:teuthology.orchestra.run.smithi161.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-22T10:02:29.889 INFO:teuthology.orchestra.run.smithi161.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-22T10:02:29.889 INFO:teuthology.orchestra.run.smithi161.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-22T10:02:29.889 INFO:teuthology.orchestra.run.smithi161.stdout:hardware devices. 2024-01-22T10:02:29.889 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:02:29.889 INFO:teuthology.orchestra.run.smithi161.stdout:This subpackage provides tools for support of all platforms. 2024-01-22T10:02:29.890 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-22T10:02:29.890 INFO:teuthology.task.kernel:Updating grub on smithi161 to boot 6.7.0-g06652275eb93 2024-01-22T10:02:29.891 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-22T10:02:30.593 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-01-22T10:02:31.889 INFO:teuthology.orchestra.run.smithi161.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-22T10:02:31.925 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-01-22T10:02:31.927 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-01-22T10:02:31.950 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.Z92dDMWGST 2024-01-22T10:02:31.950 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Z92dDMWGST 2024-01-22T10:02:32.018 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.Z92dDMWGST 2024-01-22T10:02:32.152 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.Z92dDMWGST is 6KB 2024-01-22T10:02:32.200 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.Z92dDMWGST 2024-01-22T10:02:32.214 DEBUG:teuthology.orchestra.run.smithi161:> sudo /bin/ls /boot/loader/entries || true 2024-01-22T10:02:32.281 INFO:teuthology.orchestra.run.smithi161.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-22T10:02:32.281 INFO:teuthology.orchestra.run.smithi161.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-22T10:02:32.281 INFO:teuthology.orchestra.run.smithi161.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-22T10:02:32.281 INFO:teuthology.orchestra.run.smithi161.stdout:15949e3c88704300882482eddfd7baae-6.7.0-g06652275eb93.conf 2024-01-22T10:02:32.282 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.7.0-g06652275eb93 2024-01-22T10:02:32.426 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2024-01-22T10:03:02.430 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-22T10:03:02.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-22T10:03:02.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T10:03:21.020 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-22T10:03:30.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-22T10:03:30.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T10:03:33.084 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-22T10:03:45.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-22T10:03:45.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T10:04:03.516 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-01-22T10:04:18.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-22T10:04:18.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T10:04:22.127 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-01-22T10:04:22.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-22T10:04:22.718 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.7.0-g06652275eb93"... 2024-01-22T10:04:22.718 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-01-22T10:04:22.767 INFO:teuthology.orchestra.run.smithi161.stdout:6.7.0-g06652275eb93 2024-01-22T10:04:22.767 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g06652275eb93 vs 6.7.0-g06652275eb93 2024-01-22T10:04:22.767 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-22T10:04:22.767 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-22T10:04:23.768 DEBUG:teuthology.parallel:result is None 2024-01-22T10:04:23.768 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-22T10:04:23.776 INFO:teuthology.task.internal:Creating test directory... 2024-01-22T10:04:23.777 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-22T10:04:23.779 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-22T10:04:23.782 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-22T10:04:23.837 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-22T10:04:23.843 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-22T10:04:23.853 INFO:teuthology.task.internal:Creating archive directory... 2024-01-22T10:04:23.854 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-22T10:04:23.856 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-22T10:04:23.859 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-22T10:04:23.976 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-22T10:04:23.983 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-22T10:04:23.983 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-22T10:04:24.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:04:24.000 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-22T10:04:24.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:04:24.017 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-22T10:04:24.043 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-22T10:04:24.060 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-22T10:04:24.106 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T10:04:24.114 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T10:04:24.127 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T10:04:24.136 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T10:04:24.188 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T10:04:24.238 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-22T10:04:24.241 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-22T10:04:24.248 INFO:teuthology.task.internal:Configuring sudo... 2024-01-22T10:04:24.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-22T10:04:24.251 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-22T10:04:24.253 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-22T10:04:24.320 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-22T10:04:24.330 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-22T10:04:24.330 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-22T10:04:24.332 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-22T10:04:24.334 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-22T10:04:24.374 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-22T10:04:24.431 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-22T10:04:24.482 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-22T10:04:24.563 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-22T10:04:24.608 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:04:24.608 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-22T10:04:24.677 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-22T10:04:24.721 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-22T10:04:24.822 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-22T10:04:24.865 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-22T10:04:24.913 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:04:24.913 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-22T10:04:24.982 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-22T10:04:25.060 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-22T10:04:25.146 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-22T10:04:25.216 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-22T10:04:25.293 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:04:25.293 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-22T10:04:25.364 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-01-22T10:04:25.366 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-01-22T10:04:25.369 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-01-22T10:04:25.415 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-22T10:04:25.419 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-22T10:04:25.508 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-22T10:04:25.832 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-22T10:04:25.840 INFO:teuthology.task.internal:Starting timer... 2024-01-22T10:04:25.840 INFO:teuthology.run_tasks:Running task pcp... 2024-01-22T10:04:25.850 INFO:teuthology.run_tasks:Running task selinux... 2024-01-22T10:04:25.861 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2024-01-22T10:04:25.929 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2024-01-22T10:04:25.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2024-01-22T10:04:25.986 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2024-01-22T10:04:25.987 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2024-01-22T10:04:26.111 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2024-01-22T10:04:26.115 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-22T10:04:26.116 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2024-01-22T10:04:26.143 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2024-01-22T10:04:26.143 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2024-01-22T10:04:26.174 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2024-01-22T10:04:26.175 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2024-01-22T10:04:26.229 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2024-01-22T10:04:26.229 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi161.front.sepia.ceph.com': 'permissive'} 2024-01-22T10:04:26.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-22T10:04:26.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:04:26.258 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-22T10:04:26.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:04:26.287 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-22T10:04:26.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:04:26.364 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-22T10:04:26.364 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2024-01-22T10:04:26.403 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2024-01-22T10:04:26.434 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2024-01-22T10:04:26.515 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-22T10:04:26.526 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-01-22T10:04:26.531 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-01-22T10:04:26.653 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-22T10:04:26.667 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-22T10:04:26.669 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi119.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-22T10:10:04.856 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2024-01-22T10:10:04.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-01-22T10:10:04.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T10:10:04.950 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-01-22T10:10:05.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-01-22T10:10:05.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-01-22T10:10:05.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T10:10:05.108 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-01-22T10:10:05.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-01-22T10:10:05.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-22T10:10:05.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-22T10:10:05.282 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-01-22T10:10:05.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-01-22T10:10:05.427 INFO:teuthology.run_tasks:Running task clock... 2024-01-22T10:10:05.440 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-22T10:10:05.440 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-22T10:10:05.440 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T10:10:05.442 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-22T10:10:05.442 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T10:10:05.445 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-22T10:10:05.445 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T10:10:05.471 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-22T10:10:05.478 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-22T10:10:05.487 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-22T10:10:05.496 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-22T10:10:05.516 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2024-01-22T10:10:05.527 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2024-01-22T10:10:05.529 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2024-01-22T10:10:05.541 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2024-01-22T10:10:05.544 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-22T10:10:05.546 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-22T10:10:05.558 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-22T10:10:05.562 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-22T10:10:05.574 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-22T10:10:05.596 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-22T10:10:05.606 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-01-22T10:10:05.609 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-22T10:10:05.609 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-01-22T10:10:05.609 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:10:05.610 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:10:05.610 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:10:05.610 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:10:05.618 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-01-22T10:10:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-22T10:10:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-01-22T10:10:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:10:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:10:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:10:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:10:05.690 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2024-01-22T10:10:05.735 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2024-01-22T10:10:05.788 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-22T10:10:05.842 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-22T10:10:05.962 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2024-01-22T10:10:05.969 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-22T10:10:05.969 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-01-22T10:10:05.970 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:10:05.970 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:10:05.970 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:10:05.970 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:10:05.971 INFO:teuthology.run_tasks:Running task install... 2024-01-22T10:10:05.982 DEBUG:teuthology.task.install:project ceph 2024-01-22T10:10:05.982 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1db5459e688287ea17e1bda532d3c81a51b40e23'}} 2024-01-22T10:10:05.982 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1db5459e688287ea17e1bda532d3c81a51b40e23'} 2024-01-22T10:10:05.983 INFO:teuthology.task.install:Using flavor: default 2024-01-22T10:10:05.991 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-22T10:10:05.991 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-01-22T10:10:05.992 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1db5459e688287ea17e1bda532d3c81a51b40e23', 'tag': None, 'wait_for_package': False} 2024-01-22T10:10:05.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1db5459e688287ea17e1bda532d3c81a51b40e23 2024-01-22T10:10:05.995 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1db5459e688287ea17e1bda532d3c81a51b40e23', 'tag': None, 'wait_for_package': False} 2024-01-22T10:10:05.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1db5459e688287ea17e1bda532d3c81a51b40e23 2024-01-22T10:10:05.996 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1db5459e688287ea17e1bda532d3c81a51b40e23', 'tag': None, 'wait_for_package': False} 2024-01-22T10:10:05.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1db5459e688287ea17e1bda532d3c81a51b40e23 2024-01-22T10:10:06.141 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240119.075157-1/1db5459e688287ea17e1bda532d3c81a51b40e23/centos/9/flavors/default/ 2024-01-22T10:10:06.142 INFO:teuthology.task.install.rpm:Package version is 19.0.0-815.g1db5459e 2024-01-22T10:10:06.145 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240119.075157-1/1db5459e688287ea17e1bda532d3c81a51b40e23/centos/9/flavors/default/ 2024-01-22T10:10:06.145 INFO:teuthology.task.install.rpm:Package version is 19.0.0-815.g1db5459e 2024-01-22T10:10:06.212 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240119.075157-1/1db5459e688287ea17e1bda532d3c81a51b40e23/centos/9/flavors/default/ 2024-01-22T10:10:06.212 INFO:teuthology.task.install.rpm:Package version is 19.0.0-815.g1db5459e 2024-01-22T10:10:06.324 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240119.075157-1/1db5459e688287ea17e1bda532d3c81a51b40e23/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240119.075157-1/1db5459e688287ea17e1bda532d3c81a51b40e23/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240119.075157-1/1db5459e688287ea17e1bda532d3c81a51b40e23/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-22T10:10:06.324 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:10:06.324 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-22T10:10:06.326 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240119.075157-1/1db5459e688287ea17e1bda532d3c81a51b40e23/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240119.075157-1/1db5459e688287ea17e1bda532d3c81a51b40e23/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240119.075157-1/1db5459e688287ea17e1bda532d3c81a51b40e23/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-22T10:10:06.327 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:10:06.327 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-22T10:10:06.356 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-22T10:10:06.356 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1db5459e688287ea17e1bda532d3c81a51b40e23/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-22T10:10:06.358 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-22T10:10:06.358 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1db5459e688287ea17e1bda532d3c81a51b40e23/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-22T10:10:06.384 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240119.075157-1/1db5459e688287ea17e1bda532d3c81a51b40e23/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240119.075157-1/1db5459e688287ea17e1bda532d3c81a51b40e23/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240119.075157-1/1db5459e688287ea17e1bda532d3c81a51b40e23/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-22T10:10:06.384 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:10:06.384 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-22T10:10:06.425 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-22T10:10:06.428 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-22T10:10:06.480 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-22T10:10:06.480 DEBUG:teuthology.orchestra.run.smithi161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1db5459e688287ea17e1bda532d3c81a51b40e23/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-22T10:10:06.506 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-22T10:10:06.510 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-22T10:10:06.572 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2024-01-22T10:10:06.574 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2024-01-22T10:10:06.577 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2024-01-22T10:10:06.578 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2024-01-22T10:10:06.615 DEBUG:teuthology.orchestra.run.smithi161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-22T10:10:06.745 DEBUG:teuthology.orchestra.run.smithi161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-22T10:10:06.807 INFO:teuthology.orchestra.run.smithi119.stdout:73 files removed 2024-01-22T10:10:06.812 INFO:teuthology.orchestra.run.smithi088.stdout:73 files removed 2024-01-22T10:10:06.833 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-22T10:10:06.834 INFO:teuthology.orchestra.run.smithi161.stdout:check_obsoletes = 1 2024-01-22T10:10:06.838 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum clean all 2024-01-22T10:10:06.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-22T10:10:07.183 INFO:teuthology.orchestra.run.smithi161.stdout:73 files removed 2024-01-22T10:10:07.222 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-22T10:10:07.507 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 207 kB/s | 80 kB 00:00 2024-01-22T10:10:07.618 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 160 kB/s | 80 kB 00:00 2024-01-22T10:10:07.883 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 28 kB/s | 9.5 kB 00:00 2024-01-22T10:10:08.027 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2024-01-22T10:10:08.124 INFO:teuthology.orchestra.run.smithi161.stdout:ceph packages for x86_64 198 kB/s | 80 kB 00:00 2024-01-22T10:10:08.217 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 6.1 kB/s | 1.9 kB 00:00 2024-01-22T10:10:08.444 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2024-01-22T10:10:08.661 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2024-01-22T10:10:08.683 INFO:teuthology.orchestra.run.smithi161.stdout:ceph noarch packages 20 kB/s | 9.5 kB 00:00 2024-01-22T10:10:08.805 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS-9 - AppStream 19 MB/s | 6.4 MB 00:00 2024-01-22T10:10:09.251 INFO:teuthology.orchestra.run.smithi161.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2024-01-22T10:10:09.879 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2024-01-22T10:10:10.078 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2024-01-22T10:10:10.139 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-01-22T10:10:11.463 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2024-01-22T10:10:11.688 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.0 MB 00:01 2024-01-22T10:10:13.134 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.0 MB 00:01 2024-01-22T10:10:13.851 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.0 MB 00:03 2024-01-22T10:10:13.980 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-01-22T10:10:15.736 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-01-22T10:10:16.518 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 19 MB 00:02 2024-01-22T10:10:18.081 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 5.9 MB 00:00 2024-01-22T10:10:19.532 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 15 kB 00:00 2024-01-22T10:10:20.558 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2024-01-22T10:10:21.027 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 5.9 MB 00:00 2024-01-22T10:10:21.203 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 5.9 MB 00:02 2024-01-22T10:10:22.816 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 15 kB 00:00 2024-01-22T10:10:23.204 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 15 kB 00:00 2024-01-22T10:10:24.363 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 20 MB/s | 20 MB 00:01 2024-01-22T10:10:25.277 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 20 MB 00:02 2024-01-22T10:10:25.417 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-01-22T10:10:27.837 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-22T10:10:27.838 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-22T10:10:27.851 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-22T10:10:27.851 INFO:teuthology.orchestra.run.smithi119.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-22T10:10:27.853 INFO:teuthology.orchestra.run.smithi119.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-22T10:10:27.854 INFO:teuthology.orchestra.run.smithi119.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-22T10:10:27.855 INFO:teuthology.orchestra.run.smithi119.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-22T10:10:27.858 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-22T10:10:27.859 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-22T10:10:27.933 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-01-22T10:10:27.951 INFO:teuthology.orchestra.run.smithi119.stdout:=========================================================================================== 2024-01-22T10:10:27.951 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-01-22T10:10:27.951 INFO:teuthology.orchestra.run.smithi119.stdout:=========================================================================================== 2024-01-22T10:10:27.952 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-01-22T10:10:27.952 INFO:teuthology.orchestra.run.smithi119.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-22T10:10:27.952 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:19.0.0-815.g1db5459e.el9 ceph 6.5 k 2024-01-22T10:10:27.952 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:19.0.0-815.g1db5459e.el9 ceph 5.1 M 2024-01-22T10:10:27.952 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:19.0.0-815.g1db5459e.el9 ceph 885 k 2024-01-22T10:10:27.952 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-815.g1db5459e.el9 ceph 145 k 2024-01-22T10:10:27.952 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:19.0.0-815.g1db5459e.el9 ceph 1.5 M 2024-01-22T10:10:27.952 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 133 k 2024-01-22T10:10:27.952 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 1.7 M 2024-01-22T10:10:27.952 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 7.4 M 2024-01-22T10:10:27.952 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 51 k 2024-01-22T10:10:27.952 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:19.0.0-815.g1db5459e.el9 ceph 8.6 M 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:19.0.0-815.g1db5459e.el9 ceph 46 M 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 262 k 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 743 k 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror x86_64 2:19.0.0-815.g1db5459e.el9 ceph 221 k 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 18 k 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:19.0.0-815.g1db5459e.el9 ceph 31 k 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 743 k 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:19.0.0-815.g1db5459e.el9 ceph 127 k 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-22T10:10:27.953 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:19.0.0-815.g1db5459e.el9 ceph 162 k 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:19.0.0-815.g1db5459e.el9 ceph 321 k 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:19.0.0-815.g1db5459e.el9 ceph 298 k 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:19.0.0-815.g1db5459e.el9 ceph 99 k 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:19.0.0-815.g1db5459e.el9 ceph 85 k 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:19.0.0-815.g1db5459e.el9 ceph 3.1 M 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:19.0.0-815.g1db5459e.el9 ceph 170 k 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-22T10:10:27.954 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 3.4 M 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 3.1 M 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-22T10:10:27.955 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:19.0.0-815.g1db5459e.el9 ceph 19 M 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 28 k 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:19.0.0-815.g1db5459e.el9 ceph 2.1 M 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 245 k 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:19.0.0-815.g1db5459e.el9 ceph 4.7 M 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:19.0.0-815.g1db5459e.el9 ceph 17 M 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 15 k 2024-01-22T10:10:27.956 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:19.0.0-815.g1db5459e.el9 ceph 25 k 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:19.0.0-815.g1db5459e.el9 ceph 163 k 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-22T10:10:27.957 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 499 k 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 4.8 M 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-22T10:10:27.958 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:19.0.0-815.g1db5459e.el9 ceph 45 k 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:19.0.0-815.g1db5459e.el9 ceph 130 k 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-22T10:10:27.959 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-22T10:10:27.960 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-22T10:10:27.961 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-22T10:10:27.962 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-22T10:10:27.963 INFO:teuthology.orchestra.run.smithi119.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-22T10:10:27.963 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-22T10:10:27.963 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-22T10:10:27.963 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:10:27.963 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-01-22T10:10:27.963 INFO:teuthology.orchestra.run.smithi119.stdout:=========================================================================================== 2024-01-22T10:10:27.963 INFO:teuthology.orchestra.run.smithi119.stdout:Install 133 Packages 2024-01-22T10:10:27.963 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 16 Packages 2024-01-22T10:10:27.963 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:10:27.964 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 209 M 2024-01-22T10:10:27.964 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-01-22T10:10:28.260 INFO:teuthology.orchestra.run.smithi119.stdout:(1/149): ceph-19.0.0-815.g1db5459e.el9.x86_64.r 42 kB/s | 6.5 kB 00:00 2024-01-22T10:10:28.427 INFO:teuthology.orchestra.run.smithi119.stdout:(2/149): ceph-fuse-19.0.0-815.g1db5459e.el9.x86 5.2 MB/s | 885 kB 00:00 2024-01-22T10:10:28.494 INFO:teuthology.orchestra.run.smithi119.stdout:(3/149): ceph-immutable-object-cache-19.0.0-815 2.1 MB/s | 145 kB 00:00 2024-01-22T10:10:28.760 INFO:teuthology.orchestra.run.smithi119.stdout:(4/149): ceph-mds-19.0.0-815.g1db5459e.el9.x86_ 8.0 MB/s | 2.1 MB 00:00 2024-01-22T10:10:28.961 INFO:teuthology.orchestra.run.smithi119.stdout:(5/149): ceph-mgr-19.0.0-815.g1db5459e.el9.x86_ 7.4 MB/s | 1.5 MB 00:00 2024-01-22T10:10:29.163 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-01-22T10:10:29.586 INFO:teuthology.orchestra.run.smithi119.stdout:(6/149): ceph-common-19.0.0-815.g1db5459e.el9.x 13 MB/s | 19 MB 00:01 2024-01-22T10:10:29.645 INFO:teuthology.orchestra.run.smithi119.stdout:(7/149): ceph-mon-19.0.0-815.g1db5459e.el9.x86_ 6.8 MB/s | 4.7 MB 00:00 2024-01-22T10:10:30.570 INFO:teuthology.orchestra.run.smithi119.stdout:(8/149): ceph-radosgw-19.0.0-815.g1db5459e.el9. 9.3 MB/s | 8.6 MB 00:00 2024-01-22T10:10:30.728 INFO:teuthology.orchestra.run.smithi119.stdout:(9/149): ceph-osd-19.0.0-815.g1db5459e.el9.x86_ 15 MB/s | 17 MB 00:01 2024-01-22T10:10:30.754 INFO:teuthology.orchestra.run.smithi119.stdout:(10/149): ceph-selinux-19.0.0-815.g1db5459e.el9 137 kB/s | 25 kB 00:00 2024-01-22T10:10:30.829 INFO:teuthology.orchestra.run.smithi119.stdout:(11/149): cephfs-mirror-19.0.0-815.g1db5459e.el 2.9 MB/s | 221 kB 00:00 2024-01-22T10:10:30.897 INFO:teuthology.orchestra.run.smithi119.stdout:(12/149): libcephfs-devel-19.0.0-815.g1db5459e. 469 kB/s | 31 kB 00:00 2024-01-22T10:10:30.921 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-01-22T10:10:31.005 INFO:teuthology.orchestra.run.smithi119.stdout:(13/149): libcephfs2-19.0.0-815.g1db5459e.el9.x 6.7 MB/s | 743 kB 00:00 2024-01-22T10:10:31.080 INFO:teuthology.orchestra.run.smithi119.stdout:(14/149): libcephsqlite-19.0.0-815.g1db5459e.el 2.1 MB/s | 163 kB 00:00 2024-01-22T10:10:31.155 INFO:teuthology.orchestra.run.smithi119.stdout:(15/149): librados-devel-19.0.0-815.g1db5459e.e 1.7 MB/s | 127 kB 00:00 2024-01-22T10:10:31.264 INFO:teuthology.orchestra.run.smithi119.stdout:(16/149): ceph-base-19.0.0-815.g1db5459e.el9.x8 1.6 MB/s | 5.1 MB 00:03 2024-01-22T10:10:31.289 INFO:teuthology.orchestra.run.smithi119.stdout:(17/149): libradosstriper1-19.0.0-815.g1db5459e 3.7 MB/s | 499 kB 00:00 2024-01-22T10:10:31.356 INFO:teuthology.orchestra.run.smithi119.stdout:(18/149): python3-ceph-argparse-19.0.0-815.g1db 676 kB/s | 45 kB 00:00 2024-01-22T10:10:31.439 INFO:teuthology.orchestra.run.smithi119.stdout:(19/149): python3-ceph-common-19.0.0-815.g1db54 1.5 MB/s | 130 kB 00:00 2024-01-22T10:10:31.515 INFO:teuthology.orchestra.run.smithi119.stdout:(20/149): python3-cephfs-19.0.0-815.g1db5459e.e 2.1 MB/s | 162 kB 00:00 2024-01-22T10:10:31.598 INFO:teuthology.orchestra.run.smithi119.stdout:(21/149): python3-rados-19.0.0-815.g1db5459e.el 3.8 MB/s | 321 kB 00:00 2024-01-22T10:10:31.607 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-22T10:10:31.608 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-22T10:10:31.622 INFO:teuthology.orchestra.run.smithi088.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-22T10:10:31.623 INFO:teuthology.orchestra.run.smithi088.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-22T10:10:31.624 INFO:teuthology.orchestra.run.smithi088.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-22T10:10:31.625 INFO:teuthology.orchestra.run.smithi088.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-22T10:10:31.627 INFO:teuthology.orchestra.run.smithi088.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-22T10:10:31.630 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-22T10:10:31.631 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-22T10:10:31.690 INFO:teuthology.orchestra.run.smithi119.stdout:(22/149): python3-rbd-19.0.0-815.g1db5459e.el9. 3.2 MB/s | 298 kB 00:00 2024-01-22T10:10:31.706 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-01-22T10:10:31.723 INFO:teuthology.orchestra.run.smithi088.stdout:=========================================================================================== 2024-01-22T10:10:31.723 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-01-22T10:10:31.723 INFO:teuthology.orchestra.run.smithi088.stdout:=========================================================================================== 2024-01-22T10:10:31.723 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-01-22T10:10:31.724 INFO:teuthology.orchestra.run.smithi088.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-22T10:10:31.724 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:19.0.0-815.g1db5459e.el9 ceph 6.5 k 2024-01-22T10:10:31.724 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:19.0.0-815.g1db5459e.el9 ceph 5.1 M 2024-01-22T10:10:31.724 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:19.0.0-815.g1db5459e.el9 ceph 885 k 2024-01-22T10:10:31.724 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-815.g1db5459e.el9 ceph 145 k 2024-01-22T10:10:31.724 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:19.0.0-815.g1db5459e.el9 ceph 1.5 M 2024-01-22T10:10:31.725 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 133 k 2024-01-22T10:10:31.725 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 1.7 M 2024-01-22T10:10:31.725 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 7.4 M 2024-01-22T10:10:31.725 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 51 k 2024-01-22T10:10:31.725 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:19.0.0-815.g1db5459e.el9 ceph 8.6 M 2024-01-22T10:10:31.725 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:19.0.0-815.g1db5459e.el9 ceph 46 M 2024-01-22T10:10:31.725 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 262 k 2024-01-22T10:10:31.726 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 743 k 2024-01-22T10:10:31.726 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror x86_64 2:19.0.0-815.g1db5459e.el9 ceph 221 k 2024-01-22T10:10:31.726 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 18 k 2024-01-22T10:10:31.726 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-22T10:10:31.726 INFO:teuthology.orchestra.run.smithi088.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-22T10:10:31.726 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-22T10:10:31.727 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:19.0.0-815.g1db5459e.el9 ceph 31 k 2024-01-22T10:10:31.727 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 743 k 2024-01-22T10:10:31.727 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:19.0.0-815.g1db5459e.el9 ceph 127 k 2024-01-22T10:10:31.727 INFO:teuthology.orchestra.run.smithi088.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-22T10:10:31.727 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-22T10:10:31.727 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-22T10:10:31.728 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-22T10:10:31.728 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-22T10:10:31.728 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-22T10:10:31.728 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:19.0.0-815.g1db5459e.el9 ceph 162 k 2024-01-22T10:10:31.728 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:19.0.0-815.g1db5459e.el9 ceph 321 k 2024-01-22T10:10:31.729 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:19.0.0-815.g1db5459e.el9 ceph 298 k 2024-01-22T10:10:31.729 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:19.0.0-815.g1db5459e.el9 ceph 99 k 2024-01-22T10:10:31.729 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:19.0.0-815.g1db5459e.el9 ceph 85 k 2024-01-22T10:10:31.729 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:19.0.0-815.g1db5459e.el9 ceph 3.1 M 2024-01-22T10:10:31.729 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:19.0.0-815.g1db5459e.el9 ceph 170 k 2024-01-22T10:10:31.729 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-22T10:10:31.730 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2024-01-22T10:10:31.730 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-22T10:10:31.730 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-22T10:10:31.730 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-22T10:10:31.730 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-22T10:10:31.730 INFO:teuthology.orchestra.run.smithi088.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-22T10:10:31.730 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-22T10:10:31.731 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-22T10:10:31.731 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-22T10:10:31.731 INFO:teuthology.orchestra.run.smithi088.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-22T10:10:31.731 INFO:teuthology.orchestra.run.smithi088.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-22T10:10:31.731 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 3.4 M 2024-01-22T10:10:31.731 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 3.1 M 2024-01-22T10:10:31.732 INFO:teuthology.orchestra.run.smithi088.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-22T10:10:31.732 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-22T10:10:31.732 INFO:teuthology.orchestra.run.smithi088.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-22T10:10:31.732 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-22T10:10:31.732 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-01-22T10:10:31.732 INFO:teuthology.orchestra.run.smithi088.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-22T10:10:31.733 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-22T10:10:31.733 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:19.0.0-815.g1db5459e.el9 ceph 19 M 2024-01-22T10:10:31.733 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 28 k 2024-01-22T10:10:31.733 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:19.0.0-815.g1db5459e.el9 ceph 2.1 M 2024-01-22T10:10:31.733 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 245 k 2024-01-22T10:10:31.733 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:19.0.0-815.g1db5459e.el9 ceph 4.7 M 2024-01-22T10:10:31.734 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:19.0.0-815.g1db5459e.el9 ceph 17 M 2024-01-22T10:10:31.734 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 15 k 2024-01-22T10:10:31.734 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:19.0.0-815.g1db5459e.el9 ceph 25 k 2024-01-22T10:10:31.734 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-22T10:10:31.734 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-22T10:10:31.734 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-22T10:10:31.734 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-22T10:10:31.735 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-22T10:10:31.735 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-22T10:10:31.735 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-22T10:10:31.735 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-22T10:10:31.735 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:19.0.0-815.g1db5459e.el9 ceph 163 k 2024-01-22T10:10:31.735 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-22T10:10:31.736 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-22T10:10:31.736 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-22T10:10:31.736 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-22T10:10:31.736 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-22T10:10:31.736 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 499 k 2024-01-22T10:10:31.736 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-22T10:10:31.737 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 4.8 M 2024-01-22T10:10:31.737 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-22T10:10:31.737 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-22T10:10:31.737 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-22T10:10:31.737 INFO:teuthology.orchestra.run.smithi088.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-22T10:10:31.737 INFO:teuthology.orchestra.run.smithi088.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-22T10:10:31.738 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-22T10:10:31.738 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-22T10:10:31.738 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-22T10:10:31.738 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-22T10:10:31.738 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-22T10:10:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-22T10:10:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-22T10:10:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-22T10:10:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-22T10:10:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-22T10:10:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:19.0.0-815.g1db5459e.el9 ceph 45 k 2024-01-22T10:10:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:19.0.0-815.g1db5459e.el9 ceph 130 k 2024-01-22T10:10:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-22T10:10:31.739 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-22T10:10:31.740 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-22T10:10:31.740 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-22T10:10:31.740 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-22T10:10:31.740 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-22T10:10:31.741 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-22T10:10:31.741 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-22T10:10:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-22T10:10:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-22T10:10:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-22T10:10:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-22T10:10:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-22T10:10:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-22T10:10:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-22T10:10:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-22T10:10:31.742 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-22T10:10:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-22T10:10:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-22T10:10:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-22T10:10:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-22T10:10:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-22T10:10:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-22T10:10:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-22T10:10:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-22T10:10:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-22T10:10:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-22T10:10:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-22T10:10:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-22T10:10:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-22T10:10:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-22T10:10:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-22T10:10:31.744 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-22T10:10:31.745 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout:=========================================================================================== 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout:Install 133 Packages 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 16 Packages 2024-01-22T10:10:31.746 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:10:31.747 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 209 M 2024-01-22T10:10:31.747 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-01-22T10:10:31.774 INFO:teuthology.orchestra.run.smithi119.stdout:(23/149): python3-rgw-19.0.0-815.g1db5459e.el9. 1.2 MB/s | 99 kB 00:00 2024-01-22T10:10:31.857 INFO:teuthology.orchestra.run.smithi119.stdout:(24/149): rbd-fuse-19.0.0-815.g1db5459e.el9.x86 1.0 MB/s | 85 kB 00:00 2024-01-22T10:10:32.208 INFO:teuthology.orchestra.run.smithi119.stdout:(25/149): rbd-mirror-19.0.0-815.g1db5459e.el9.x 8.8 MB/s | 3.1 MB 00:00 2024-01-22T10:10:32.283 INFO:teuthology.orchestra.run.smithi119.stdout:(26/149): rbd-nbd-19.0.0-815.g1db5459e.el9.x86_ 2.2 MB/s | 170 kB 00:00 2024-01-22T10:10:32.342 INFO:teuthology.orchestra.run.smithi119.stdout:(27/149): ceph-grafana-dashboards-19.0.0-815.g1 487 kB/s | 28 kB 00:00 2024-01-22T10:10:32.409 INFO:teuthology.orchestra.run.smithi119.stdout:(28/149): ceph-mgr-cephadm-19.0.0-815.g1db5459e 1.9 MB/s | 133 kB 00:00 2024-01-22T10:10:32.614 INFO:teuthology.orchestra.run.smithi088.stdout:(1/149): ceph-19.0.0-815.g1db5459e.el9.x86_64.r 19 kB/s | 6.5 kB 00:00 2024-01-22T10:10:32.617 INFO:teuthology.orchestra.run.smithi119.stdout:(29/149): ceph-mgr-dashboard-19.0.0-815.g1db545 8.4 MB/s | 1.7 MB 00:00 2024-01-22T10:10:33.264 INFO:teuthology.orchestra.run.smithi088.stdout:(2/149): ceph-fuse-19.0.0-815.g1db5459e.el9.x86 1.3 MB/s | 885 kB 00:00 2024-01-22T10:10:33.276 INFO:teuthology.orchestra.run.smithi119.stdout:(30/149): ceph-test-19.0.0-815.g1db5459e.el9.x8 18 MB/s | 46 MB 00:02 2024-01-22T10:10:33.335 INFO:teuthology.orchestra.run.smithi119.stdout:(31/149): ceph-mgr-modules-core-19.0.0-815.g1db 4.1 MB/s | 245 kB 00:00 2024-01-22T10:10:33.389 INFO:teuthology.orchestra.run.smithi088.stdout:(3/149): ceph-immutable-object-cache-19.0.0-815 1.1 MB/s | 145 kB 00:00 2024-01-22T10:10:33.427 INFO:teuthology.orchestra.run.smithi119.stdout:(32/149): ceph-mgr-diskprediction-local-19.0.0- 9.1 MB/s | 7.4 MB 00:00 2024-01-22T10:10:33.452 INFO:teuthology.orchestra.run.smithi119.stdout:(33/149): ceph-mgr-rook-19.0.0-815.g1db5459e.el 435 kB/s | 51 kB 00:00 2024-01-22T10:10:33.477 INFO:teuthology.orchestra.run.smithi119.stdout:(34/149): ceph-prometheus-alerts-19.0.0-815.g1d 301 kB/s | 15 kB 00:00 2024-01-22T10:10:33.511 INFO:teuthology.orchestra.run.smithi119.stdout:(35/149): ceph-volume-19.0.0-815.g1db5459e.el9. 4.4 MB/s | 262 kB 00:00 2024-01-22T10:10:33.563 INFO:teuthology.orchestra.run.smithi161.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-22T10:10:33.564 INFO:teuthology.orchestra.run.smithi161.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-22T10:10:33.581 INFO:teuthology.orchestra.run.smithi161.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-22T10:10:33.582 INFO:teuthology.orchestra.run.smithi161.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-22T10:10:33.583 INFO:teuthology.orchestra.run.smithi161.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-22T10:10:33.585 INFO:teuthology.orchestra.run.smithi161.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-22T10:10:33.586 INFO:teuthology.orchestra.run.smithi119.stdout:(36/149): cephadm-19.0.0-815.g1db5459e.el9.noar 6.7 MB/s | 743 kB 00:00 2024-01-22T10:10:33.587 INFO:teuthology.orchestra.run.smithi161.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-22T10:10:33.590 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-22T10:10:33.591 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-22T10:10:33.611 INFO:teuthology.orchestra.run.smithi119.stdout:(37/149): cephfs-top-19.0.0-815.g1db5459e.el9.n 182 kB/s | 18 kB 00:00 2024-01-22T10:10:33.669 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-01-22T10:10:33.670 INFO:teuthology.orchestra.run.smithi119.stdout:(38/149): librgw2-19.0.0-815.g1db5459e.el9.x86_ 2.0 MB/s | 4.8 MB 00:02 2024-01-22T10:10:33.694 INFO:teuthology.orchestra.run.smithi161.stdout:=========================================================================================== 2024-01-22T10:10:33.694 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-01-22T10:10:33.694 INFO:teuthology.orchestra.run.smithi161.stdout:=========================================================================================== 2024-01-22T10:10:33.694 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-01-22T10:10:33.694 INFO:teuthology.orchestra.run.smithi161.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-22T10:10:33.694 INFO:teuthology.orchestra.run.smithi161.stdout: ceph x86_64 2:19.0.0-815.g1db5459e.el9 ceph 6.5 k 2024-01-22T10:10:33.694 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base x86_64 2:19.0.0-815.g1db5459e.el9 ceph 5.1 M 2024-01-22T10:10:33.694 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse x86_64 2:19.0.0-815.g1db5459e.el9 ceph 885 k 2024-01-22T10:10:33.695 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-815.g1db5459e.el9 ceph 145 k 2024-01-22T10:10:33.695 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr x86_64 2:19.0.0-815.g1db5459e.el9 ceph 1.5 M 2024-01-22T10:10:33.695 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 133 k 2024-01-22T10:10:33.695 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 1.7 M 2024-01-22T10:10:33.695 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 7.4 M 2024-01-22T10:10:33.695 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 51 k 2024-01-22T10:10:33.695 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw x86_64 2:19.0.0-815.g1db5459e.el9 ceph 8.6 M 2024-01-22T10:10:33.695 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test x86_64 2:19.0.0-815.g1db5459e.el9 ceph 46 M 2024-01-22T10:10:33.695 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 262 k 2024-01-22T10:10:33.695 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 743 k 2024-01-22T10:10:33.695 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror x86_64 2:19.0.0-815.g1db5459e.el9 ceph 221 k 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 18 k 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel x86_64 2:19.0.0-815.g1db5459e.el9 ceph 31 k 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 743 k 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel x86_64 2:19.0.0-815.g1db5459e.el9 ceph 127 k 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-22T10:10:33.696 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs x86_64 2:19.0.0-815.g1db5459e.el9 ceph 162 k 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados x86_64 2:19.0.0-815.g1db5459e.el9 ceph 321 k 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd x86_64 2:19.0.0-815.g1db5459e.el9 ceph 298 k 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw x86_64 2:19.0.0-815.g1db5459e.el9 ceph 99 k 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse x86_64 2:19.0.0-815.g1db5459e.el9 ceph 85 k 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror x86_64 2:19.0.0-815.g1db5459e.el9 ceph 3.1 M 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd x86_64 2:19.0.0-815.g1db5459e.el9 ceph 170 k 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-22T10:10:33.697 INFO:teuthology.orchestra.run.smithi161.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 3.4 M 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 3.1 M 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-01-22T10:10:33.698 INFO:teuthology.orchestra.run.smithi161.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common x86_64 2:19.0.0-815.g1db5459e.el9 ceph 19 M 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 28 k 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds x86_64 2:19.0.0-815.g1db5459e.el9 ceph 2.1 M 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 245 k 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon x86_64 2:19.0.0-815.g1db5459e.el9 ceph 4.7 M 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd x86_64 2:19.0.0-815.g1db5459e.el9 ceph 17 M 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts noarch 2:19.0.0-815.g1db5459e.el9 ceph-noarch 15 k 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux x86_64 2:19.0.0-815.g1db5459e.el9 ceph 25 k 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-22T10:10:33.699 INFO:teuthology.orchestra.run.smithi161.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite x86_64 2:19.0.0-815.g1db5459e.el9 ceph 163 k 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 499 k 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-22T10:10:33.700 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2 x86_64 2:19.0.0-815.g1db5459e.el9 ceph 4.8 M 2024-01-22T10:10:33.701 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-22T10:10:33.701 INFO:teuthology.orchestra.run.smithi161.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-22T10:10:33.701 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-22T10:10:33.701 INFO:teuthology.orchestra.run.smithi161.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-22T10:10:33.701 INFO:teuthology.orchestra.run.smithi161.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-22T10:10:33.701 INFO:teuthology.orchestra.run.smithi161.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-22T10:10:33.701 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-22T10:10:33.701 INFO:teuthology.orchestra.run.smithi161.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-22T10:10:33.701 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-22T10:10:33.701 INFO:teuthology.orchestra.run.smithi161.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-22T10:10:33.701 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-22T10:10:33.701 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-22T10:10:33.702 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-22T10:10:33.702 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-22T10:10:33.702 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-22T10:10:33.702 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse x86_64 2:19.0.0-815.g1db5459e.el9 ceph 45 k 2024-01-22T10:10:33.702 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common x86_64 2:19.0.0-815.g1db5459e.el9 ceph 130 k 2024-01-22T10:10:33.702 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-22T10:10:33.702 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-22T10:10:33.702 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-22T10:10:33.702 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-22T10:10:33.702 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-22T10:10:33.703 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-22T10:10:33.704 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-22T10:10:33.704 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-22T10:10:33.704 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-22T10:10:33.704 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-22T10:10:33.704 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-22T10:10:33.704 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-22T10:10:33.704 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-22T10:10:33.704 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-22T10:10:33.704 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-22T10:10:33.704 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-22T10:10:33.704 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-22T10:10:33.704 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-22T10:10:33.705 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-22T10:10:33.705 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-22T10:10:33.705 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-22T10:10:33.705 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-22T10:10:33.705 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-22T10:10:33.705 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-22T10:10:33.705 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-22T10:10:33.705 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-22T10:10:33.705 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-22T10:10:33.705 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-22T10:10:33.705 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:10:33.706 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-01-22T10:10:33.707 INFO:teuthology.orchestra.run.smithi161.stdout:=========================================================================================== 2024-01-22T10:10:33.707 INFO:teuthology.orchestra.run.smithi161.stdout:Install 133 Packages 2024-01-22T10:10:33.707 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 16 Packages 2024-01-22T10:10:33.707 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:10:33.707 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 209 M 2024-01-22T10:10:33.707 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-01-22T10:10:33.748 INFO:teuthology.orchestra.run.smithi088.stdout:(4/149): ceph-base-19.0.0-815.g1db5459e.el9.x86 3.4 MB/s | 5.1 MB 00:01 2024-01-22T10:10:33.820 INFO:teuthology.orchestra.run.smithi119.stdout:(39/149): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 106 kB 00:00 2024-01-22T10:10:33.854 INFO:teuthology.orchestra.run.smithi119.stdout:(40/149): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 662 kB 00:00 2024-01-22T10:10:33.879 INFO:teuthology.orchestra.run.smithi119.stdout:(41/149): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 920 kB 00:00 2024-01-22T10:10:33.904 INFO:teuthology.orchestra.run.smithi119.stdout:(42/149): elfutils-libelf-devel-0.190-2.el9.x86 247 kB/s | 20 kB 00:00 2024-01-22T10:10:33.930 INFO:teuthology.orchestra.run.smithi119.stdout:(43/149): flex-2.6.4-9.el9.x86_64.rpm 4.0 MB/s | 307 kB 00:00 2024-01-22T10:10:33.931 INFO:teuthology.orchestra.run.smithi088.stdout:(5/149): ceph-mgr-19.0.0-815.g1db5459e.el9.x86_ 8.1 MB/s | 1.5 MB 00:00 2024-01-22T10:10:33.955 INFO:teuthology.orchestra.run.smithi119.stdout:(44/149): flexiblas-3.0.4-8.el9.x86_64.rpm 636 kB/s | 32 kB 00:00 2024-01-22T10:10:34.015 INFO:teuthology.orchestra.run.smithi088.stdout:(6/149): ceph-mds-19.0.0-815.g1db5459e.el9.x86_ 3.4 MB/s | 2.1 MB 00:00 2024-01-22T10:10:34.030 INFO:teuthology.orchestra.run.smithi119.stdout:(45/149): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-01-22T10:10:34.047 INFO:teuthology.orchestra.run.smithi119.stdout:(46/149): flexiblas-openblas-openmp-3.0.4-8.el9 146 kB/s | 17 kB 00:00 2024-01-22T10:10:34.072 INFO:teuthology.orchestra.run.smithi119.stdout:(47/149): libaio-devel-0.3.111-13.el9.x86_64.rp 87 kB/s | 10 kB 00:00 2024-01-22T10:10:34.097 INFO:teuthology.orchestra.run.smithi119.stdout:(48/149): librabbitmq-0.11.0-7.el9.x86_64.rpm 885 kB/s | 44 kB 00:00 2024-01-22T10:10:34.123 INFO:teuthology.orchestra.run.smithi119.stdout:(49/149): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-01-22T10:10:34.156 INFO:teuthology.orchestra.run.smithi119.stdout:(50/149): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 661 kB 00:00 2024-01-22T10:10:34.181 INFO:teuthology.orchestra.run.smithi119.stdout:(51/149): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 578 kB 00:00 2024-01-22T10:10:34.198 INFO:teuthology.orchestra.run.smithi119.stdout:(52/149): libuuid-devel-2.37.4-15.el9.x86_64.rp 601 kB/s | 24 kB 00:00 2024-01-22T10:10:34.215 INFO:teuthology.orchestra.run.smithi119.stdout:(53/149): libzstd-devel-1.5.1-2.el9.x86_64.rpm 807 kB/s | 46 kB 00:00 2024-01-22T10:10:34.241 INFO:teuthology.orchestra.run.smithi119.stdout:(54/149): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-01-22T10:10:34.257 INFO:teuthology.orchestra.run.smithi119.stdout:(55/149): openblas-0.3.21-2.el9.x86_64.rpm 826 kB/s | 34 kB 00:00 2024-01-22T10:10:34.283 INFO:teuthology.orchestra.run.smithi119.stdout:(56/149): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2024-01-22T10:10:34.367 INFO:teuthology.orchestra.run.smithi119.stdout:(57/149): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-01-22T10:10:34.425 INFO:teuthology.orchestra.run.smithi119.stdout:(58/149): openssl-devel-3.0.7-25.el9.x86_64.rpm 18 MB/s | 3.0 MB 00:00 2024-01-22T10:10:34.459 INFO:teuthology.orchestra.run.smithi119.stdout:(59/149): postgresql-13.11-1.el9.x86_64.rpm 8.8 MB/s | 1.5 MB 00:00 2024-01-22T10:10:34.473 INFO:teuthology.orchestra.run.smithi088.stdout:(7/149): ceph-mon-19.0.0-815.g1db5459e.el9.x86_ 8.6 MB/s | 4.7 MB 00:00 2024-01-22T10:10:34.484 INFO:teuthology.orchestra.run.smithi119.stdout:(60/149): postgresql-contrib-13.11-1.el9.x86_64 6.9 MB/s | 811 kB 00:00 2024-01-22T10:10:34.509 INFO:teuthology.orchestra.run.smithi119.stdout:(61/149): postgresql-private-libs-13.11-1.el9.x 1.6 MB/s | 134 kB 00:00 2024-01-22T10:10:34.693 INFO:teuthology.orchestra.run.smithi119.stdout:(62/149): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 5.8 MB 00:00 2024-01-22T10:10:34.768 INFO:teuthology.orchestra.run.smithi119.stdout:(63/149): postgresql-server-13.11-1.el9.x86_64. 20 MB/s | 5.7 MB 00:00 2024-01-22T10:10:34.785 INFO:teuthology.orchestra.run.smithi119.stdout:(64/149): python3-jinja2-2.11.3-4.el9.noarch.rp 832 kB/s | 228 kB 00:00 2024-01-22T10:10:34.806 INFO:teuthology.orchestra.run.smithi161.stdout:(1/149): ceph-19.0.0-815.g1db5459e.el9.x86_64.r 21 kB/s | 6.5 kB 00:00 2024-01-22T10:10:34.810 INFO:teuthology.orchestra.run.smithi119.stdout:(65/149): python3-jsonpatch-1.21-16.el9.noarch. 212 kB/s | 24 kB 00:00 2024-01-22T10:10:34.835 INFO:teuthology.orchestra.run.smithi119.stdout:(66/149): python3-jsonpointer-2.0-4.el9.noarch. 360 kB/s | 18 kB 00:00 2024-01-22T10:10:34.857 INFO:teuthology.orchestra.run.smithi088.stdout:(8/149): ceph-common-19.0.0-815.g1db5459e.el9.x 7.5 MB/s | 19 MB 00:02 2024-01-22T10:10:34.860 INFO:teuthology.orchestra.run.smithi119.stdout:(67/149): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-01-22T10:10:34.886 INFO:teuthology.orchestra.run.smithi119.stdout:(68/149): python3-markupsafe-1.1.1-12.el9.x86_6 419 kB/s | 32 kB 00:00 2024-01-22T10:10:34.911 INFO:teuthology.orchestra.run.smithi119.stdout:(69/149): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 217 kB 00:00 2024-01-22T10:10:34.915 INFO:teuthology.orchestra.run.smithi088.stdout:(9/149): ceph-selinux-19.0.0-815.g1db5459e.el9. 432 kB/s | 25 kB 00:00 2024-01-22T10:10:35.003 INFO:teuthology.orchestra.run.smithi119.stdout:(70/149): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2024-01-22T10:10:35.028 INFO:teuthology.orchestra.run.smithi119.stdout:(71/149): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2024-01-22T10:10:35.053 INFO:teuthology.orchestra.run.smithi119.stdout:(72/149): python3-prettytable-0.7.2-27.el9.noar 294 kB/s | 41 kB 00:00 2024-01-22T10:10:35.079 INFO:teuthology.orchestra.run.smithi119.stdout:(73/149): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-01-22T10:10:35.104 INFO:teuthology.orchestra.run.smithi119.stdout:(74/149): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-01-22T10:10:35.129 INFO:teuthology.orchestra.run.smithi119.stdout:(75/149): python3-pytz-2021.1-5.el9.noarch.rpm 630 kB/s | 47 kB 00:00 2024-01-22T10:10:35.154 INFO:teuthology.orchestra.run.smithi119.stdout:(76/149): python3-requests-oauthlib-1.3.0-12.el 569 kB/s | 43 kB 00:00 2024-01-22T10:10:35.180 INFO:teuthology.orchestra.run.smithi119.stdout:(77/149): python3-toml-0.10.2-6.el9.noarch.rpm 773 kB/s | 39 kB 00:00 2024-01-22T10:10:35.347 INFO:teuthology.orchestra.run.smithi119.stdout:(78/149): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 300 kB 00:00 2024-01-22T10:10:35.414 INFO:teuthology.orchestra.run.smithi161.stdout:(2/149): ceph-fuse-19.0.0-815.g1db5459e.el9.x86 1.4 MB/s | 885 kB 00:00 2024-01-22T10:10:35.491 INFO:teuthology.orchestra.run.smithi088.stdout:(10/149): ceph-radosgw-19.0.0-815.g1db5459e.el9 8.5 MB/s | 8.6 MB 00:01 2024-01-22T10:10:35.506 INFO:teuthology.orchestra.run.smithi161.stdout:(3/149): ceph-immutable-object-cache-19.0.0-815 1.6 MB/s | 145 kB 00:00 2024-01-22T10:10:35.514 INFO:teuthology.orchestra.run.smithi119.stdout:(79/149): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-01-22T10:10:35.539 INFO:teuthology.orchestra.run.smithi119.stdout:(80/149): uuid-1.6.2-55.el9.x86_64.rpm 158 kB/s | 56 kB 00:00 2024-01-22T10:10:35.564 INFO:teuthology.orchestra.run.smithi119.stdout:(81/149): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 405 kB/s | 87 kB 00:00 2024-01-22T10:10:35.574 INFO:teuthology.orchestra.run.smithi088.stdout:(11/149): cephfs-mirror-19.0.0-815.g1db5459e.el 2.6 MB/s | 221 kB 00:00 2024-01-22T10:10:35.589 INFO:teuthology.orchestra.run.smithi119.stdout:(82/149): xmlstarlet-1.6.1-20.el9.x86_64.rpm 835 kB/s | 63 kB 00:00 2024-01-22T10:10:35.615 INFO:teuthology.orchestra.run.smithi119.stdout:(83/149): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-01-22T10:10:35.640 INFO:teuthology.orchestra.run.smithi119.stdout:(84/149): zlib-devel-1.2.11-40.el9.x86_64.rpm 583 kB/s | 44 kB 00:00 2024-01-22T10:10:35.649 INFO:teuthology.orchestra.run.smithi088.stdout:(12/149): libcephfs-devel-19.0.0-815.g1db5459e. 416 kB/s | 31 kB 00:00 2024-01-22T10:10:35.665 INFO:teuthology.orchestra.run.smithi119.stdout:(85/149): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2024-01-22T10:10:35.699 INFO:teuthology.orchestra.run.smithi119.stdout:(86/149): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 802 kB 00:00 2024-01-22T10:10:35.724 INFO:teuthology.orchestra.run.smithi119.stdout:(87/149): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.7 MB/s | 217 kB 00:00 2024-01-22T10:10:35.749 INFO:teuthology.orchestra.run.smithi119.stdout:(88/149): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 194 kB 00:00 2024-01-22T10:10:35.791 INFO:teuthology.orchestra.run.smithi119.stdout:(89/149): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2024-01-22T10:10:35.816 INFO:teuthology.orchestra.run.smithi088.stdout:(13/149): libcephfs2-19.0.0-815.g1db5459e.el9.x 4.4 MB/s | 743 kB 00:00 2024-01-22T10:10:35.833 INFO:teuthology.orchestra.run.smithi119.stdout:(90/149): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-01-22T10:10:35.859 INFO:teuthology.orchestra.run.smithi119.stdout:(91/149): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-01-22T10:10:35.884 INFO:teuthology.orchestra.run.smithi119.stdout:(92/149): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2024-01-22T10:10:35.900 INFO:teuthology.orchestra.run.smithi088.stdout:(14/149): libcephsqlite-19.0.0-815.g1db5459e.el 1.9 MB/s | 163 kB 00:00 2024-01-22T10:10:35.909 INFO:teuthology.orchestra.run.smithi119.stdout:(93/149): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2024-01-22T10:10:35.951 INFO:teuthology.orchestra.run.smithi119.stdout:(94/149): python3-urllib3-1.26.5-5.el9.noarch.r 2.7 MB/s | 187 kB 00:00 2024-01-22T10:10:35.984 INFO:teuthology.orchestra.run.smithi088.stdout:(15/149): librados-devel-19.0.0-815.g1db5459e.e 1.5 MB/s | 127 kB 00:00 2024-01-22T10:10:36.084 INFO:teuthology.orchestra.run.smithi088.stdout:(16/149): libradosstriper1-19.0.0-815.g1db5459e 4.9 MB/s | 499 kB 00:00 2024-01-22T10:10:36.084 INFO:teuthology.orchestra.run.smithi119.stdout:(95/149): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-01-22T10:10:36.193 INFO:teuthology.orchestra.run.smithi119.stdout:(96/149): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.2 MB/s | 309 kB 00:00 2024-01-22T10:10:36.260 INFO:teuthology.orchestra.run.smithi119.stdout:(97/149): libarrow-doc-9.0.0-10.el9.noarch.rpm 616 kB/s | 26 kB 00:00 2024-01-22T10:10:36.302 INFO:teuthology.orchestra.run.smithi119.stdout:(98/149): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-01-22T10:10:36.331 INFO:teuthology.orchestra.run.smithi161.stdout:(4/149): ceph-mds-19.0.0-815.g1db5459e.el9.x86_ 2.6 MB/s | 2.1 MB 00:00 2024-01-22T10:10:36.344 INFO:teuthology.orchestra.run.smithi119.stdout:(99/149): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-01-22T10:10:36.411 INFO:teuthology.orchestra.run.smithi119.stdout:(100/149): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-01-22T10:10:36.628 INFO:teuthology.orchestra.run.smithi119.stdout:(101/149): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-01-22T10:10:36.753 INFO:teuthology.orchestra.run.smithi119.stdout:(102/149): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.4 MB/s | 838 kB 00:00 2024-01-22T10:10:36.795 INFO:teuthology.orchestra.run.smithi119.stdout:(103/149): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-01-22T10:10:36.809 INFO:teuthology.orchestra.run.smithi088.stdout:(17/149): librgw2-19.0.0-815.g1db5459e.el9.x86_ 6.6 MB/s | 4.8 MB 00:00 2024-01-22T10:10:36.823 INFO:teuthology.orchestra.run.smithi161.stdout:(5/149): ceph-mgr-19.0.0-815.g1db5459e.el9.x86_ 3.0 MB/s | 1.5 MB 00:00 2024-01-22T10:10:36.837 INFO:teuthology.orchestra.run.smithi119.stdout:(104/149): python3-cachetools-4.2.4-1.el9.noarc 772 kB/s | 32 kB 00:00 2024-01-22T10:10:36.876 INFO:teuthology.orchestra.run.smithi088.stdout:(18/149): python3-ceph-argparse-19.0.0-815.g1db 679 kB/s | 45 kB 00:00 2024-01-22T10:10:36.879 INFO:teuthology.orchestra.run.smithi119.stdout:(105/149): python3-certifi-2021.10.8-2.el9.noar 360 kB/s | 15 kB 00:00 2024-01-22T10:10:36.937 INFO:teuthology.orchestra.run.smithi119.stdout:(106/149): python3-asyncssh-2.13.2-3.el9.noarch 1.7 MB/s | 548 kB 00:00 2024-01-22T10:10:36.968 INFO:teuthology.orchestra.run.smithi088.stdout:(19/149): python3-ceph-common-19.0.0-815.g1db54 1.4 MB/s | 130 kB 00:00 2024-01-22T10:10:36.980 INFO:teuthology.orchestra.run.smithi119.stdout:(107/149): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-01-22T10:10:37.055 INFO:teuthology.orchestra.run.smithi119.stdout:(108/149): python3-google-auth-2.26.2-1.el9.noa 2.6 MB/s | 202 kB 00:00 2024-01-22T10:10:37.060 INFO:teuthology.orchestra.run.smithi088.stdout:(20/149): python3-cephfs-19.0.0-815.g1db5459e.e 1.7 MB/s | 162 kB 00:00 2024-01-22T10:10:37.080 INFO:teuthology.orchestra.run.smithi119.stdout:(109/149): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-01-22T10:10:37.106 INFO:teuthology.orchestra.run.smithi119.stdout:(110/149): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-01-22T10:10:37.131 INFO:teuthology.orchestra.run.smithi119.stdout:(111/149): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-01-22T10:10:37.156 INFO:teuthology.orchestra.run.smithi119.stdout:(112/149): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-01-22T10:10:37.160 INFO:teuthology.orchestra.run.smithi088.stdout:(21/149): python3-rados-19.0.0-815.g1db5459e.el 3.1 MB/s | 321 kB 00:00 2024-01-22T10:10:37.181 INFO:teuthology.orchestra.run.smithi119.stdout:(113/149): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-01-22T10:10:37.206 INFO:teuthology.orchestra.run.smithi119.stdout:(114/149): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-01-22T10:10:37.257 INFO:teuthology.orchestra.run.smithi119.stdout:(115/149): python3-logutils-0.3.5-21.el9.noarch 926 kB/s | 46 kB 00:00 2024-01-22T10:10:37.260 INFO:teuthology.orchestra.run.smithi088.stdout:(22/149): python3-rbd-19.0.0-815.g1db5459e.el9. 2.9 MB/s | 298 kB 00:00 2024-01-22T10:10:37.299 INFO:teuthology.orchestra.run.smithi119.stdout:(116/149): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-01-22T10:10:37.341 INFO:teuthology.orchestra.run.smithi119.stdout:(117/149): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-01-22T10:10:37.344 INFO:teuthology.orchestra.run.smithi088.stdout:(23/149): python3-rgw-19.0.0-815.g1db5459e.el9. 1.2 MB/s | 99 kB 00:00 2024-01-22T10:10:37.436 INFO:teuthology.orchestra.run.smithi088.stdout:(24/149): rbd-fuse-19.0.0-815.g1db5459e.el9.x86 928 kB/s | 85 kB 00:00 2024-01-22T10:10:37.459 INFO:teuthology.orchestra.run.smithi119.stdout:(118/149): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-01-22T10:10:37.492 INFO:teuthology.orchestra.run.smithi119.stdout:(119/149): python3-kubernetes-26.1.0-2.el9.noar 3.3 MB/s | 1.0 MB 00:00 2024-01-22T10:10:37.517 INFO:teuthology.orchestra.run.smithi119.stdout:(120/149): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-01-22T10:10:37.534 INFO:teuthology.orchestra.run.smithi119.stdout:(121/149): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-01-22T10:10:37.559 INFO:teuthology.orchestra.run.smithi119.stdout:(122/149): python3-repoze-lru-0.7-16.el9.noarch 732 kB/s | 31 kB 00:00 2024-01-22T10:10:37.601 INFO:teuthology.orchestra.run.smithi119.stdout:(123/149): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-01-22T10:10:37.627 INFO:teuthology.orchestra.run.smithi119.stdout:(124/149): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-01-22T10:10:37.652 INFO:teuthology.orchestra.run.smithi119.stdout:(125/149): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-01-22T10:10:37.677 INFO:teuthology.orchestra.run.smithi119.stdout:(126/149): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-01-22T10:10:37.724 INFO:teuthology.orchestra.run.smithi161.stdout:(6/149): ceph-mon-19.0.0-815.g1db5459e.el9.x86_ 5.2 MB/s | 4.7 MB 00:00 2024-01-22T10:10:37.752 INFO:teuthology.orchestra.run.smithi119.stdout:(127/149): libarrow-9.0.0-10.el9.x86_64.rpm 2.6 MB/s | 4.4 MB 00:01 2024-01-22T10:10:37.778 INFO:teuthology.orchestra.run.smithi119.stdout:(128/149): python3-websocket-client-1.2.3-2.el9 894 kB/s | 90 kB 00:00 2024-01-22T10:10:37.803 INFO:teuthology.orchestra.run.smithi119.stdout:(129/149): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-01-22T10:10:37.828 INFO:teuthology.orchestra.run.smithi119.stdout:(130/149): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-01-22T10:10:37.853 INFO:teuthology.orchestra.run.smithi088.stdout:(25/149): ceph-osd-19.0.0-815.g1db5459e.el9.x86 4.4 MB/s | 17 MB 00:03 2024-01-22T10:10:37.887 INFO:teuthology.orchestra.run.smithi119.stdout:(131/149): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-01-22T10:10:37.912 INFO:teuthology.orchestra.run.smithi119.stdout:(132/149): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-01-22T10:10:37.961 INFO:teuthology.orchestra.run.smithi088.stdout:(26/149): rbd-nbd-19.0.0-815.g1db5459e.el9.x86_ 1.5 MB/s | 170 kB 00:00 2024-01-22T10:10:38.012 INFO:teuthology.orchestra.run.smithi088.stdout:(27/149): rbd-mirror-19.0.0-815.g1db5459e.el9.x 5.4 MB/s | 3.1 MB 00:00 2024-01-22T10:10:38.045 INFO:teuthology.orchestra.run.smithi088.stdout:(28/149): ceph-grafana-dashboards-19.0.0-815.g1 340 kB/s | 28 kB 00:00 2024-01-22T10:10:38.088 INFO:teuthology.orchestra.run.smithi088.stdout:(29/149): ceph-mgr-cephadm-19.0.0-815.g1db5459e 1.7 MB/s | 133 kB 00:00 2024-01-22T10:10:38.229 INFO:teuthology.orchestra.run.smithi119.stdout:(133/149): thrift-0.15.0-2.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2024-01-22T10:10:38.279 INFO:teuthology.orchestra.run.smithi119.stdout:(134/149): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2024-01-22T10:10:38.464 INFO:teuthology.orchestra.run.smithi119.stdout:(135/149): NetworkManager-1.45.10-1.el9.x86_64. 12 MB/s | 2.2 MB 00:00 2024-01-22T10:10:38.571 INFO:teuthology.orchestra.run.smithi119.stdout:(136/149): NetworkManager-libnm-1.45.10-1.el9.x 17 MB/s | 1.8 MB 00:00 2024-01-22T10:10:38.605 INFO:teuthology.orchestra.run.smithi119.stdout:(137/149): NetworkManager-team-1.45.10-1.el9.x8 1.2 MB/s | 42 kB 00:00 2024-01-22T10:10:38.647 INFO:teuthology.orchestra.run.smithi119.stdout:(138/149): NetworkManager-tui-1.45.10-1.el9.x86 5.8 MB/s | 246 kB 00:00 2024-01-22T10:10:38.671 INFO:teuthology.orchestra.run.smithi088.stdout:(30/149): ceph-mgr-dashboard-19.0.0-815.g1db545 2.8 MB/s | 1.7 MB 00:00 2024-01-22T10:10:38.680 INFO:teuthology.orchestra.run.smithi119.stdout:(139/149): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2024-01-22T10:10:38.722 INFO:teuthology.orchestra.run.smithi119.stdout:(140/149): elfutils-debuginfod-client-0.190-2.e 848 kB/s | 35 kB 00:00 2024-01-22T10:10:38.764 INFO:teuthology.orchestra.run.smithi119.stdout:(141/149): elfutils-libelf-0.190-2.el9.x86_64.r 4.5 MB/s | 191 kB 00:00 2024-01-22T10:10:38.815 INFO:teuthology.orchestra.run.smithi119.stdout:(142/149): librados2-19.0.0-815.g1db5459e.el9.x 3.6 MB/s | 3.4 MB 00:00 2024-01-22T10:10:38.838 INFO:teuthology.orchestra.run.smithi088.stdout:(31/149): ceph-mgr-modules-core-19.0.0-815.g1db 1.4 MB/s | 245 kB 00:00 2024-01-22T10:10:38.840 INFO:teuthology.orchestra.run.smithi119.stdout:(143/149): elfutils-libs-0.190-2.el9.x86_64.rpm 3.3 MB/s | 254 kB 00:00 2024-01-22T10:10:38.865 INFO:teuthology.orchestra.run.smithi119.stdout:(144/149): libacl-2.3.1-4.el9.x86_64.rpm 442 kB/s | 22 kB 00:00 2024-01-22T10:10:38.907 INFO:teuthology.orchestra.run.smithi119.stdout:(145/149): openssl-3.0.7-25.el9.x86_64.rpm 17 MB/s | 1.2 MB 00:00 2024-01-22T10:10:38.921 INFO:teuthology.orchestra.run.smithi088.stdout:(32/149): ceph-mgr-rook-19.0.0-815.g1db5459e.el 612 kB/s | 51 kB 00:00 2024-01-22T10:10:38.966 INFO:teuthology.orchestra.run.smithi119.stdout:(146/149): openssl-libs-3.0.7-25.el9.x86_64.rpm 22 MB/s | 2.1 MB 00:00 2024-01-22T10:10:38.988 INFO:teuthology.orchestra.run.smithi088.stdout:(33/149): ceph-prometheus-alerts-19.0.0-815.g1d 227 kB/s | 15 kB 00:00 2024-01-22T10:10:38.991 INFO:teuthology.orchestra.run.smithi119.stdout:(147/149): xfsdump-3.1.12-4.el9.x86_64.rpm 3.9 MB/s | 321 kB 00:00 2024-01-22T10:10:39.033 INFO:teuthology.orchestra.run.smithi119.stdout:(148/149): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-01-22T10:10:39.114 INFO:teuthology.orchestra.run.smithi088.stdout:(34/149): ceph-volume-19.0.0-815.g1db5459e.el9. 2.0 MB/s | 262 kB 00:00 2024-01-22T10:10:39.124 INFO:teuthology.orchestra.run.smithi161.stdout:(7/149): ceph-common-19.0.0-815.g1db5459e.el9.x 4.2 MB/s | 19 MB 00:04 2024-01-22T10:10:39.232 INFO:teuthology.orchestra.run.smithi161.stdout:(8/149): ceph-base-19.0.0-815.g1db5459e.el9.x86 1.1 MB/s | 5.1 MB 00:04 2024-01-22T10:10:39.307 INFO:teuthology.orchestra.run.smithi161.stdout:(9/149): ceph-selinux-19.0.0-815.g1db5459e.el9. 340 kB/s | 25 kB 00:00 2024-01-22T10:10:39.314 INFO:teuthology.orchestra.run.smithi088.stdout:(35/149): ceph-mgr-diskprediction-local-19.0.0- 6.0 MB/s | 7.4 MB 00:01 2024-01-22T10:10:39.373 INFO:teuthology.orchestra.run.smithi088.stdout:(36/149): cephadm-19.0.0-815.g1db5459e.el9.noar 2.8 MB/s | 743 kB 00:00 2024-01-22T10:10:39.427 INFO:teuthology.orchestra.run.smithi088.stdout:(37/149): cephfs-top-19.0.0-815.g1db5459e.el9.n 162 kB/s | 18 kB 00:00 2024-01-22T10:10:39.573 INFO:teuthology.orchestra.run.smithi088.stdout:(38/149): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 662 kB 00:00 2024-01-22T10:10:39.606 INFO:teuthology.orchestra.run.smithi088.stdout:(39/149): boost-program-options-1.75.0-8.el9.x8 3.2 MB/s | 106 kB 00:00 2024-01-22T10:10:39.640 INFO:teuthology.orchestra.run.smithi088.stdout:(40/149): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 920 kB 00:00 2024-01-22T10:10:39.666 INFO:teuthology.orchestra.run.smithi088.stdout:(41/149): elfutils-libelf-devel-0.190-2.el9.x86 348 kB/s | 20 kB 00:00 2024-01-22T10:10:39.691 INFO:teuthology.orchestra.run.smithi088.stdout:(42/149): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-01-22T10:10:39.716 INFO:teuthology.orchestra.run.smithi088.stdout:(43/149): flexiblas-3.0.4-8.el9.x86_64.rpm 635 kB/s | 32 kB 00:00 2024-01-22T10:10:39.766 INFO:teuthology.orchestra.run.smithi088.stdout:(44/149): flexiblas-openblas-openmp-3.0.4-8.el9 355 kB/s | 17 kB 00:00 2024-01-22T10:10:39.817 INFO:teuthology.orchestra.run.smithi088.stdout:(45/149): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-01-22T10:10:39.842 INFO:teuthology.orchestra.run.smithi088.stdout:(46/149): libaio-devel-0.3.111-13.el9.x86_64.rp 135 kB/s | 10 kB 00:00 2024-01-22T10:10:39.858 INFO:teuthology.orchestra.run.smithi119.stdout:(149/149): librbd1-19.0.0-815.g1db5459e.el9.x86 1.6 MB/s | 3.1 MB 00:01 2024-01-22T10:10:39.867 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-01-22T10:10:39.867 INFO:teuthology.orchestra.run.smithi119.stdout:Total 18 MB/s | 209 MB 00:11 2024-01-22T10:10:39.867 INFO:teuthology.orchestra.run.smithi088.stdout:(47/149): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-01-22T10:10:39.893 INFO:teuthology.orchestra.run.smithi088.stdout:(48/149): librabbitmq-0.11.0-7.el9.x86_64.rpm 880 kB/s | 44 kB 00:00 2024-01-22T10:10:39.895 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-01-22T10:10:39.918 INFO:teuthology.orchestra.run.smithi088.stdout:(49/149): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-01-22T10:10:39.951 INFO:teuthology.orchestra.run.smithi088.stdout:(50/149): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2024-01-22T10:10:39.977 INFO:teuthology.orchestra.run.smithi088.stdout:(51/149): libuuid-devel-2.37.4-15.el9.x86_64.rp 424 kB/s | 24 kB 00:00 2024-01-22T10:10:40.002 INFO:teuthology.orchestra.run.smithi088.stdout:(52/149): libzstd-devel-1.5.1-2.el9.x86_64.rpm 923 kB/s | 46 kB 00:00 2024-01-22T10:10:40.027 INFO:teuthology.orchestra.run.smithi088.stdout:(53/149): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-01-22T10:10:40.053 INFO:teuthology.orchestra.run.smithi088.stdout:(54/149): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-01-22T10:10:40.078 INFO:teuthology.orchestra.run.smithi088.stdout:(55/149): openblas-0.3.21-2.el9.x86_64.rpm 681 kB/s | 34 kB 00:00 2024-01-22T10:10:40.145 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-01-22T10:10:40.146 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-01-22T10:10:40.258 INFO:teuthology.orchestra.run.smithi161.stdout:(10/149): ceph-osd-19.0.0-815.g1db5459e.el9.x86 6.6 MB/s | 17 MB 00:02 2024-01-22T10:10:40.400 INFO:teuthology.orchestra.run.smithi161.stdout:(11/149): cephfs-mirror-19.0.0-815.g1db5459e.el 1.5 MB/s | 221 kB 00:00 2024-01-22T10:10:40.483 INFO:teuthology.orchestra.run.smithi161.stdout:(12/149): libcephfs-devel-19.0.0-815.g1db5459e. 378 kB/s | 31 kB 00:00 2024-01-22T10:10:40.487 INFO:teuthology.orchestra.run.smithi088.stdout:(56/149): ceph-test-19.0.0-815.g1db5459e.el9.x8 8.2 MB/s | 46 MB 00:05 2024-01-22T10:10:40.554 INFO:teuthology.orchestra.run.smithi088.stdout:(57/149): openblas-openmp-0.3.21-2.el9.x86_64.r 9.5 MB/s | 4.7 MB 00:00 2024-01-22T10:10:40.629 INFO:teuthology.orchestra.run.smithi088.stdout:(58/149): openssl-devel-3.0.7-25.el9.x86_64.rpm 5.4 MB/s | 3.0 MB 00:00 2024-01-22T10:10:40.671 INFO:teuthology.orchestra.run.smithi088.stdout:(59/149): postgresql-13.11-1.el9.x86_64.rpm 8.4 MB/s | 1.5 MB 00:00 2024-01-22T10:10:40.675 INFO:teuthology.orchestra.run.smithi161.stdout:(13/149): libcephfs2-19.0.0-815.g1db5459e.el9.x 3.8 MB/s | 743 kB 00:00 2024-01-22T10:10:40.696 INFO:teuthology.orchestra.run.smithi088.stdout:(60/149): postgresql-contrib-13.11-1.el9.x86_64 5.8 MB/s | 811 kB 00:00 2024-01-22T10:10:40.713 INFO:teuthology.orchestra.run.smithi088.stdout:(61/149): postgresql-private-libs-13.11-1.el9.x 1.6 MB/s | 134 kB 00:00 2024-01-22T10:10:40.734 INFO:teuthology.orchestra.run.smithi161.stdout:(14/149): libcephsqlite-19.0.0-815.g1db5459e.el 2.8 MB/s | 163 kB 00:00 2024-01-22T10:10:40.792 INFO:teuthology.orchestra.run.smithi161.stdout:(15/149): librados-devel-19.0.0-815.g1db5459e.e 2.2 MB/s | 127 kB 00:00 2024-01-22T10:10:40.934 INFO:teuthology.orchestra.run.smithi161.stdout:(16/149): ceph-radosgw-19.0.0-815.g1db5459e.el9 4.8 MB/s | 8.6 MB 00:01 2024-01-22T10:10:40.955 INFO:teuthology.orchestra.run.smithi088.stdout:(62/149): postgresql-server-13.11-1.el9.x86_64. 22 MB/s | 5.7 MB 00:00 2024-01-22T10:10:40.993 INFO:teuthology.orchestra.run.smithi161.stdout:(17/149): libradosstriper1-19.0.0-815.g1db5459e 2.4 MB/s | 499 kB 00:00 2024-01-22T10:10:41.030 INFO:teuthology.orchestra.run.smithi088.stdout:(63/149): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2024-01-22T10:10:41.051 INFO:teuthology.orchestra.run.smithi161.stdout:(18/149): python3-ceph-argparse-19.0.0-815.g1db 788 kB/s | 45 kB 00:00 2024-01-22T10:10:41.055 INFO:teuthology.orchestra.run.smithi088.stdout:(64/149): python3-jinja2-2.11.3-4.el9.noarch.rp 668 kB/s | 228 kB 00:00 2024-01-22T10:10:41.081 INFO:teuthology.orchestra.run.smithi088.stdout:(65/149): python3-jsonpatch-1.21-16.el9.noarch. 197 kB/s | 24 kB 00:00 2024-01-22T10:10:41.097 INFO:teuthology.orchestra.run.smithi088.stdout:(66/149): python3-jsonpointer-2.0-4.el9.noarch. 435 kB/s | 18 kB 00:00 2024-01-22T10:10:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:(19/149): python3-ceph-common-19.0.0-815.g1db54 2.6 MB/s | 130 kB 00:00 2024-01-22T10:10:41.123 INFO:teuthology.orchestra.run.smithi088.stdout:(67/149): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-01-22T10:10:41.140 INFO:teuthology.orchestra.run.smithi088.stdout:(68/149): python3-markupsafe-1.1.1-12.el9.x86_6 540 kB/s | 32 kB 00:00 2024-01-22T10:10:41.160 INFO:teuthology.orchestra.run.smithi161.stdout:(20/149): python3-cephfs-19.0.0-815.g1db5459e.e 2.8 MB/s | 162 kB 00:00 2024-01-22T10:10:41.165 INFO:teuthology.orchestra.run.smithi088.stdout:(69/149): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.1 MB/s | 217 kB 00:00 2024-01-22T10:10:41.227 INFO:teuthology.orchestra.run.smithi161.stdout:(21/149): python3-rados-19.0.0-815.g1db5459e.el 4.8 MB/s | 321 kB 00:00 2024-01-22T10:10:41.282 INFO:teuthology.orchestra.run.smithi088.stdout:(70/149): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2024-01-22T10:10:41.286 INFO:teuthology.orchestra.run.smithi161.stdout:(22/149): python3-rbd-19.0.0-815.g1db5459e.el9. 5.0 MB/s | 298 kB 00:00 2024-01-22T10:10:41.307 INFO:teuthology.orchestra.run.smithi088.stdout:(71/149): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 174 kB 00:00 2024-01-22T10:10:41.333 INFO:teuthology.orchestra.run.smithi088.stdout:(72/149): python3-prettytable-0.7.2-27.el9.noar 250 kB/s | 41 kB 00:00 2024-01-22T10:10:41.336 INFO:teuthology.orchestra.run.smithi161.stdout:(23/149): python3-rgw-19.0.0-815.g1db5459e.el9. 2.0 MB/s | 99 kB 00:00 2024-01-22T10:10:41.358 INFO:teuthology.orchestra.run.smithi088.stdout:(73/149): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-01-22T10:10:41.383 INFO:teuthology.orchestra.run.smithi088.stdout:(74/149): python3-pytz-2021.1-5.el9.noarch.rpm 950 kB/s | 47 kB 00:00 2024-01-22T10:10:41.395 INFO:teuthology.orchestra.run.smithi161.stdout:(24/149): rbd-fuse-19.0.0-815.g1db5459e.el9.x86 1.4 MB/s | 85 kB 00:00 2024-01-22T10:10:41.408 INFO:teuthology.orchestra.run.smithi088.stdout:(75/149): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-01-22T10:10:41.433 INFO:teuthology.orchestra.run.smithi088.stdout:(76/149): python3-requests-oauthlib-1.3.0-12.el 568 kB/s | 43 kB 00:00 2024-01-22T10:10:41.620 INFO:teuthology.orchestra.run.smithi161.stdout:(25/149): librgw2-19.0.0-815.g1db5459e.el9.x86_ 7.0 MB/s | 4.8 MB 00:00 2024-01-22T10:10:41.674 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-01-22T10:10:41.674 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-01-22T10:10:41.678 INFO:teuthology.orchestra.run.smithi161.stdout:(26/149): rbd-nbd-19.0.0-815.g1db5459e.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-01-22T10:10:41.734 INFO:teuthology.orchestra.run.smithi088.stdout:(77/149): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-01-22T10:10:41.759 INFO:teuthology.orchestra.run.smithi088.stdout:(78/149): python3-toml-0.10.2-6.el9.noarch.rpm 120 kB/s | 39 kB 00:00 2024-01-22T10:10:41.784 INFO:teuthology.orchestra.run.smithi088.stdout:(79/149): socat-1.7.4.1-5.el9.x86_64.rpm 863 kB/s | 300 kB 00:00 2024-01-22T10:10:41.795 INFO:teuthology.orchestra.run.smithi161.stdout:(27/149): rbd-mirror-19.0.0-815.g1db5459e.el9.x 7.7 MB/s | 3.1 MB 00:00 2024-01-22T10:10:41.809 INFO:teuthology.orchestra.run.smithi088.stdout:(80/149): uuid-1.6.2-55.el9.x86_64.rpm 749 kB/s | 56 kB 00:00 2024-01-22T10:10:41.821 INFO:teuthology.orchestra.run.smithi161.stdout:(28/149): ceph-grafana-dashboards-19.0.0-815.g1 201 kB/s | 28 kB 00:00 2024-01-22T10:10:41.835 INFO:teuthology.orchestra.run.smithi088.stdout:(81/149): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-01-22T10:10:41.860 INFO:teuthology.orchestra.run.smithi088.stdout:(82/149): xmlstarlet-1.6.1-20.el9.x86_64.rpm 833 kB/s | 63 kB 00:00 2024-01-22T10:10:41.871 INFO:teuthology.orchestra.run.smithi161.stdout:(29/149): ceph-mgr-cephadm-19.0.0-815.g1db5459e 2.7 MB/s | 133 kB 00:00 2024-01-22T10:10:41.885 INFO:teuthology.orchestra.run.smithi088.stdout:(83/149): zlib-devel-1.2.11-40.el9.x86_64.rpm 585 kB/s | 44 kB 00:00 2024-01-22T10:10:41.910 INFO:teuthology.orchestra.run.smithi088.stdout:(84/149): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-01-22T10:10:41.936 INFO:teuthology.orchestra.run.smithi088.stdout:(85/149): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2024-01-22T10:10:41.961 INFO:teuthology.orchestra.run.smithi088.stdout:(86/149): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 802 kB 00:00 2024-01-22T10:10:41.995 INFO:teuthology.orchestra.run.smithi088.stdout:(87/149): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 194 kB 00:00 2024-01-22T10:10:42.020 INFO:teuthology.orchestra.run.smithi088.stdout:(88/149): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 217 kB 00:00 2024-01-22T10:10:42.045 INFO:teuthology.orchestra.run.smithi088.stdout:(89/149): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2024-01-22T10:10:42.046 INFO:teuthology.orchestra.run.smithi161.stdout:(30/149): ceph-mgr-dashboard-19.0.0-815.g1db545 7.8 MB/s | 1.7 MB 00:00 2024-01-22T10:10:42.070 INFO:teuthology.orchestra.run.smithi088.stdout:(90/149): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2024-01-22T10:10:42.104 INFO:teuthology.orchestra.run.smithi088.stdout:(91/149): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-01-22T10:10:42.129 INFO:teuthology.orchestra.run.smithi088.stdout:(92/149): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2024-01-22T10:10:42.154 INFO:teuthology.orchestra.run.smithi088.stdout:(93/149): python3-requests-2.25.1-7.el9.noarch. 1.3 MB/s | 113 kB 00:00 2024-01-22T10:10:42.155 INFO:teuthology.orchestra.run.smithi161.stdout:(31/149): ceph-mgr-modules-core-19.0.0-815.g1db 2.2 MB/s | 245 kB 00:00 2024-01-22T10:10:42.180 INFO:teuthology.orchestra.run.smithi088.stdout:(94/149): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-01-22T10:10:42.197 INFO:teuthology.orchestra.run.smithi161.stdout:(32/149): ceph-mgr-rook-19.0.0-815.g1db5459e.el 1.2 MB/s | 51 kB 00:00 2024-01-22T10:10:42.305 INFO:teuthology.orchestra.run.smithi088.stdout:(95/149): python3-devel-3.9.17-2.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-01-22T10:10:42.330 INFO:teuthology.orchestra.run.smithi088.stdout:(96/149): lua-devel-5.4.4-4.el9.x86_64.rpm 127 kB/s | 22 kB 00:00 2024-01-22T10:10:42.339 INFO:teuthology.orchestra.run.smithi161.stdout:(33/149): ceph-prometheus-alerts-19.0.0-815.g1d 107 kB/s | 15 kB 00:00 2024-01-22T10:10:42.414 INFO:teuthology.orchestra.run.smithi161.stdout:(34/149): ceph-volume-19.0.0-815.g1db5459e.el9. 3.5 MB/s | 262 kB 00:00 2024-01-22T10:10:42.481 INFO:teuthology.orchestra.run.smithi088.stdout:(97/149): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.0 MB/s | 309 kB 00:00 2024-01-22T10:10:42.539 INFO:teuthology.orchestra.run.smithi088.stdout:(98/149): libarrow-doc-9.0.0-10.el9.noarch.rpm 124 kB/s | 26 kB 00:00 2024-01-22T10:10:42.540 INFO:teuthology.orchestra.run.smithi161.stdout:(35/149): cephadm-19.0.0-815.g1db5459e.el9.noar 5.8 MB/s | 743 kB 00:00 2024-01-22T10:10:42.565 INFO:teuthology.orchestra.run.smithi088.stdout:(99/149): liboath-2.6.7-2.el9.x86_64.rpm 581 kB/s | 49 kB 00:00 2024-01-22T10:10:42.581 INFO:teuthology.orchestra.run.smithi161.stdout:(36/149): cephfs-top-19.0.0-815.g1db5459e.el9.n 447 kB/s | 18 kB 00:00 2024-01-22T10:10:42.623 INFO:teuthology.orchestra.run.smithi088.stdout:(100/149): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-01-22T10:10:42.650 INFO:teuthology.orchestra.run.smithi088.stdout:(101/149): libunwind-1.6.2-1.el9.x86_64.rpm 618 kB/s | 67 kB 00:00 2024-01-22T10:10:42.709 INFO:teuthology.orchestra.run.smithi161.stdout:(37/149): ceph-mgr-diskprediction-local-19.0.0- 8.8 MB/s | 7.4 MB 00:00 2024-01-22T10:10:42.732 INFO:teuthology.orchestra.run.smithi088.stdout:(102/149): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.5 MB/s | 838 kB 00:00 2024-01-22T10:10:42.791 INFO:teuthology.orchestra.run.smithi088.stdout:(103/149): python3-bcrypt-3.2.2-1.el9.x86_64.rp 746 kB/s | 43 kB 00:00 2024-01-22T10:10:42.816 INFO:teuthology.orchestra.run.smithi088.stdout:(104/149): python3-asyncssh-2.13.2-3.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-01-22T10:10:42.850 INFO:teuthology.orchestra.run.smithi088.stdout:(105/149): python3-cachetools-4.2.4-1.el9.noarc 549 kB/s | 32 kB 00:00 2024-01-22T10:10:42.877 INFO:teuthology.orchestra.run.smithi088.stdout:(106/149): python3-certifi-2021.10.8-2.el9.noar 255 kB/s | 15 kB 00:00 2024-01-22T10:10:42.933 INFO:teuthology.orchestra.run.smithi161.stdout:(38/149): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 662 kB 00:00 2024-01-22T10:10:42.943 INFO:teuthology.orchestra.run.smithi088.stdout:(107/149): libarrow-9.0.0-10.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-01-22T10:10:42.967 INFO:teuthology.orchestra.run.smithi088.stdout:(108/149): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-01-22T10:10:42.991 INFO:teuthology.orchestra.run.smithi161.stdout:(39/149): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 920 kB 00:00 2024-01-22T10:10:42.992 INFO:teuthology.orchestra.run.smithi088.stdout:(109/149): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-01-22T10:10:43.016 INFO:teuthology.orchestra.run.smithi161.stdout:(40/149): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 106 kB 00:00 2024-01-22T10:10:43.018 INFO:teuthology.orchestra.run.smithi088.stdout:(110/149): python3-google-auth-2.26.2-1.el9.noa 2.6 MB/s | 202 kB 00:00 2024-01-22T10:10:43.035 INFO:teuthology.orchestra.run.smithi088.stdout:(111/149): python3-jaraco-8.2.1-3.el9.noarch.rp 159 kB/s | 11 kB 00:00 2024-01-22T10:10:43.041 INFO:teuthology.orchestra.run.smithi161.stdout:(41/149): elfutils-libelf-devel-0.190-2.el9.x86 418 kB/s | 20 kB 00:00 2024-01-22T10:10:43.075 INFO:teuthology.orchestra.run.smithi161.stdout:(42/149): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2024-01-22T10:10:43.076 INFO:teuthology.orchestra.run.smithi088.stdout:(112/149): python3-jaraco-classes-3.2.1-5.el9.n 210 kB/s | 18 kB 00:00 2024-01-22T10:10:43.094 INFO:teuthology.orchestra.run.smithi088.stdout:(113/149): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-01-22T10:10:43.100 INFO:teuthology.orchestra.run.smithi161.stdout:(43/149): flexiblas-3.0.4-8.el9.x86_64.rpm 572 kB/s | 32 kB 00:00 2024-01-22T10:10:43.119 INFO:teuthology.orchestra.run.smithi088.stdout:(114/149): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2024-01-22T10:10:43.145 INFO:teuthology.orchestra.run.smithi088.stdout:(115/149): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-01-22T10:10:43.178 INFO:teuthology.orchestra.run.smithi088.stdout:(116/149): python3-logutils-0.3.5-21.el9.noarch 789 kB/s | 46 kB 00:00 2024-01-22T10:10:43.201 INFO:teuthology.orchestra.run.smithi161.stdout:(44/149): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-01-22T10:10:43.203 INFO:teuthology.orchestra.run.smithi088.stdout:(117/149): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-01-22T10:10:43.226 INFO:teuthology.orchestra.run.smithi161.stdout:(45/149): flexiblas-openblas-openmp-3.0.4-8.el9 153 kB/s | 17 kB 00:00 2024-01-22T10:10:43.237 INFO:teuthology.orchestra.run.smithi088.stdout:(118/149): python3-natsort-7.1.1-5.el9.noarch.r 987 kB/s | 58 kB 00:00 2024-01-22T10:10:43.270 INFO:teuthology.orchestra.run.smithi088.stdout:(119/149): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-01-22T10:10:43.276 INFO:teuthology.orchestra.run.smithi161.stdout:(46/149): libaio-devel-0.3.111-13.el9.x86_64.rp 135 kB/s | 10 kB 00:00 2024-01-22T10:10:43.296 INFO:teuthology.orchestra.run.smithi088.stdout:(120/149): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-01-22T10:10:43.301 INFO:teuthology.orchestra.run.smithi161.stdout:(47/149): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-01-22T10:10:43.321 INFO:teuthology.orchestra.run.smithi088.stdout:(121/149): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-01-22T10:10:43.327 INFO:teuthology.orchestra.run.smithi161.stdout:(48/149): librabbitmq-0.11.0-7.el9.x86_64.rpm 920 kB/s | 44 kB 00:00 2024-01-22T10:10:43.338 INFO:teuthology.orchestra.run.smithi088.stdout:(122/149): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-01-22T10:10:43.363 INFO:teuthology.orchestra.run.smithi088.stdout:(123/149): python3-repoze-lru-0.7-16.el9.noarch 458 kB/s | 31 kB 00:00 2024-01-22T10:10:43.369 INFO:teuthology.orchestra.run.smithi161.stdout:(49/149): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2024-01-22T10:10:43.388 INFO:teuthology.orchestra.run.smithi088.stdout:(124/149): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-01-22T10:10:43.411 INFO:teuthology.orchestra.run.smithi161.stdout:(50/149): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2024-01-22T10:10:43.414 INFO:teuthology.orchestra.run.smithi088.stdout:(125/149): python3-rsa-4.9-2.el9.noarch.rpm 781 kB/s | 59 kB 00:00 2024-01-22T10:10:43.436 INFO:teuthology.orchestra.run.smithi161.stdout:(51/149): libuuid-devel-2.37.4-15.el9.x86_64.rp 398 kB/s | 24 kB 00:00 2024-01-22T10:10:43.456 INFO:teuthology.orchestra.run.smithi088.stdout:(126/149): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-01-22T10:10:43.461 INFO:teuthology.orchestra.run.smithi161.stdout:(52/149): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 46 kB 00:00 2024-01-22T10:10:43.481 INFO:teuthology.orchestra.run.smithi088.stdout:(127/149): python3-typing-extensions-4.4.0-2.el 552 kB/s | 51 kB 00:00 2024-01-22T10:10:43.495 INFO:teuthology.orchestra.run.smithi161.stdout:(53/149): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-01-22T10:10:43.506 INFO:teuthology.orchestra.run.smithi088.stdout:(128/149): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-01-22T10:10:43.529 INFO:teuthology.orchestra.run.smithi161.stdout:(54/149): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2024-01-22T10:10:43.531 INFO:teuthology.orchestra.run.smithi088.stdout:(129/149): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-01-22T10:10:43.554 INFO:teuthology.orchestra.run.smithi161.stdout:(55/149): openblas-0.3.21-2.el9.x86_64.rpm 607 kB/s | 34 kB 00:00 2024-01-22T10:10:43.565 INFO:teuthology.orchestra.run.smithi088.stdout:(130/149): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-01-22T10:10:43.590 INFO:teuthology.orchestra.run.smithi088.stdout:(131/149): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-01-22T10:10:43.616 INFO:teuthology.orchestra.run.smithi088.stdout:(132/149): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-01-22T10:10:43.696 INFO:teuthology.orchestra.run.smithi161.stdout:(56/149): openblas-openmp-0.3.21-2.el9.x86_64.r 29 MB/s | 4.7 MB 00:00 2024-01-22T10:10:43.724 INFO:teuthology.orchestra.run.smithi088.stdout:(133/149): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-01-22T10:10:43.766 INFO:teuthology.orchestra.run.smithi088.stdout:(134/149): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2024-01-22T10:10:43.780 INFO:teuthology.orchestra.run.smithi161.stdout:(57/149): openssl-devel-3.0.7-25.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-01-22T10:10:43.841 INFO:teuthology.orchestra.run.smithi088.stdout:(135/149): NetworkManager-1.45.10-1.el9.x86_64. 30 MB/s | 2.2 MB 00:00 2024-01-22T10:10:43.846 INFO:teuthology.orchestra.run.smithi161.stdout:(58/149): postgresql-13.11-1.el9.x86_64.rpm 11 MB/s | 1.5 MB 00:00 2024-01-22T10:10:43.888 INFO:teuthology.orchestra.run.smithi161.stdout:(59/149): postgresql-contrib-13.11-1.el9.x86_64 8.3 MB/s | 811 kB 00:00 2024-01-22T10:10:43.914 INFO:teuthology.orchestra.run.smithi161.stdout:(60/149): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2024-01-22T10:10:43.917 INFO:teuthology.orchestra.run.smithi088.stdout:(136/149): NetworkManager-libnm-1.45.10-1.el9.x 24 MB/s | 1.8 MB 00:00 2024-01-22T10:10:43.967 INFO:teuthology.orchestra.run.smithi088.stdout:(137/149): NetworkManager-team-1.45.10-1.el9.x8 843 kB/s | 42 kB 00:00 2024-01-22T10:10:44.034 INFO:teuthology.orchestra.run.smithi088.stdout:(138/149): NetworkManager-tui-1.45.10-1.el9.x86 3.6 MB/s | 246 kB 00:00 2024-01-22T10:10:44.073 INFO:teuthology.orchestra.run.smithi161.stdout:(61/149): postgresql-server-13.11-1.el9.x86_64. 31 MB/s | 5.7 MB 00:00 2024-01-22T10:10:44.084 INFO:teuthology.orchestra.run.smithi088.stdout:(139/149): librbd1-19.0.0-815.g1db5459e.el9.x86 6.7 MB/s | 3.1 MB 00:00 2024-01-22T10:10:44.109 INFO:teuthology.orchestra.run.smithi088.stdout:(140/149): acl-2.3.1-4.el9.x86_64.rpm 916 kB/s | 69 kB 00:00 2024-01-22T10:10:44.135 INFO:teuthology.orchestra.run.smithi088.stdout:(141/149): elfutils-debuginfod-client-0.190-2.e 706 kB/s | 35 kB 00:00 2024-01-22T10:10:44.160 INFO:teuthology.orchestra.run.smithi088.stdout:(142/149): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 191 kB 00:00 2024-01-22T10:10:44.186 INFO:teuthology.orchestra.run.smithi088.stdout:(143/149): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-01-22T10:10:44.206 INFO:teuthology.orchestra.run.smithi161.stdout:(62/149): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2024-01-22T10:10:44.211 INFO:teuthology.orchestra.run.smithi088.stdout:(144/149): libacl-2.3.1-4.el9.x86_64.rpm 440 kB/s | 22 kB 00:00 2024-01-22T10:10:44.231 INFO:teuthology.orchestra.run.smithi161.stdout:(63/149): python3-jinja2-2.11.3-4.el9.noarch.rp 1.5 MB/s | 228 kB 00:00 2024-01-22T10:10:44.253 INFO:teuthology.orchestra.run.smithi088.stdout:(145/149): openssl-3.0.7-25.el9.x86_64.rpm 17 MB/s | 1.2 MB 00:00 2024-01-22T10:10:44.265 INFO:teuthology.orchestra.run.smithi161.stdout:(64/149): python3-jsonpatch-1.21-16.el9.noarch. 760 kB/s | 24 kB 00:00 2024-01-22T10:10:44.290 INFO:teuthology.orchestra.run.smithi161.stdout:(65/149): python3-jsonpointer-2.0-4.el9.noarch. 316 kB/s | 18 kB 00:00 2024-01-22T10:10:44.303 INFO:teuthology.orchestra.run.smithi088.stdout:(146/149): openssl-libs-3.0.7-25.el9.x86_64.rpm 24 MB/s | 2.1 MB 00:00 2024-01-22T10:10:44.315 INFO:teuthology.orchestra.run.smithi161.stdout:(66/149): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2024-01-22T10:10:44.328 INFO:teuthology.orchestra.run.smithi088.stdout:(147/149): xfsdump-3.1.12-4.el9.x86_64.rpm 4.3 MB/s | 321 kB 00:00 2024-01-22T10:10:44.332 INFO:teuthology.orchestra.run.smithi161.stdout:(67/149): python3-markupsafe-1.1.1-12.el9.x86_6 787 kB/s | 32 kB 00:00 2024-01-22T10:10:44.362 INFO:teuthology.orchestra.run.smithi088.stdout:(148/149): xfsprogs-6.3.0-1.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2024-01-22T10:10:44.500 INFO:teuthology.orchestra.run.smithi161.stdout:(68/149): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2024-01-22T10:10:44.533 INFO:teuthology.orchestra.run.smithi161.stdout:(69/149): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2024-01-22T10:10:44.567 INFO:teuthology.orchestra.run.smithi161.stdout:(70/149): python3-oauthlib-3.1.1-5.el9.noarch.r 2.7 MB/s | 174 kB 00:00 2024-01-22T10:10:44.579 INFO:teuthology.orchestra.run.smithi088.stdout:(149/149): librados2-19.0.0-815.g1db5459e.el9.x 3.4 MB/s | 3.4 MB 00:00 2024-01-22T10:10:44.584 INFO:teuthology.orchestra.run.smithi161.stdout:(71/149): python3-prettytable-0.7.2-27.el9.noar 858 kB/s | 41 kB 00:00 2024-01-22T10:10:44.586 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-01-22T10:10:44.586 INFO:teuthology.orchestra.run.smithi088.stdout:Total 16 MB/s | 209 MB 00:12 2024-01-22T10:10:44.609 INFO:teuthology.orchestra.run.smithi161.stdout:(72/149): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2024-01-22T10:10:44.616 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-01-22T10:10:44.642 INFO:teuthology.orchestra.run.smithi161.stdout:(73/149): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-01-22T10:10:44.668 INFO:teuthology.orchestra.run.smithi161.stdout:(74/149): python3-pytz-2021.1-5.el9.noarch.rpm 835 kB/s | 47 kB 00:00 2024-01-22T10:10:44.693 INFO:teuthology.orchestra.run.smithi161.stdout:(75/149): python3-requests-oauthlib-1.3.0-12.el 875 kB/s | 43 kB 00:00 2024-01-22T10:10:44.867 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-01-22T10:10:44.868 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-01-22T10:10:44.952 INFO:teuthology.orchestra.run.smithi161.stdout:(76/149): python3-toml-0.10.2-6.el9.noarch.rpm 159 kB/s | 39 kB 00:00 2024-01-22T10:10:45.177 INFO:teuthology.orchestra.run.smithi161.stdout:(77/149): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-01-22T10:10:45.211 INFO:teuthology.orchestra.run.smithi161.stdout:(78/149): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 300 kB 00:00 2024-01-22T10:10:45.236 INFO:teuthology.orchestra.run.smithi161.stdout:(79/149): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-01-22T10:10:45.261 INFO:teuthology.orchestra.run.smithi161.stdout:(80/149): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-01-22T10:10:45.286 INFO:teuthology.orchestra.run.smithi161.stdout:(81/149): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2024-01-22T10:10:45.312 INFO:teuthology.orchestra.run.smithi161.stdout:(82/149): zlib-devel-1.2.11-40.el9.x86_64.rpm 895 kB/s | 44 kB 00:00 2024-01-22T10:10:45.337 INFO:teuthology.orchestra.run.smithi161.stdout:(83/149): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2024-01-22T10:10:45.371 INFO:teuthology.orchestra.run.smithi161.stdout:(84/149): jq-1.6-16.el9.x86_64.rpm 3.2 MB/s | 186 kB 00:00 2024-01-22T10:10:45.421 INFO:teuthology.orchestra.run.smithi161.stdout:(85/149): libgfortran-11.4.1-3.el9.x86_64.rpm 9.6 MB/s | 802 kB 00:00 2024-01-22T10:10:45.454 INFO:teuthology.orchestra.run.smithi161.stdout:(86/149): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 194 kB 00:00 2024-01-22T10:10:45.488 INFO:teuthology.orchestra.run.smithi161.stdout:(87/149): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-01-22T10:10:45.550 INFO:teuthology.orchestra.run.smithi161.stdout:(88/149): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 241 kB 00:00 2024-01-22T10:10:45.605 INFO:teuthology.orchestra.run.smithi161.stdout:(89/149): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.1 MB 00:00 2024-01-22T10:10:45.630 INFO:teuthology.orchestra.run.smithi161.stdout:(90/149): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-01-22T10:10:45.656 INFO:teuthology.orchestra.run.smithi161.stdout:(91/149): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2024-01-22T10:10:45.681 INFO:teuthology.orchestra.run.smithi161.stdout:(92/149): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2024-01-22T10:10:45.715 INFO:teuthology.orchestra.run.smithi161.stdout:(93/149): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-01-22T10:10:45.798 INFO:teuthology.orchestra.run.smithi161.stdout:(94/149): lua-devel-5.4.4-4.el9.x86_64.rpm 271 kB/s | 22 kB 00:00 2024-01-22T10:10:45.840 INFO:teuthology.orchestra.run.smithi161.stdout:(95/149): python3-devel-3.9.17-2.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-01-22T10:10:46.068 INFO:teuthology.orchestra.run.smithi161.stdout:(96/149): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.1 MB/s | 309 kB 00:00 2024-01-22T10:10:46.127 INFO:teuthology.orchestra.run.smithi161.stdout:(97/149): libarrow-doc-9.0.0-10.el9.noarch.rpm 452 kB/s | 26 kB 00:00 2024-01-22T10:10:46.185 INFO:teuthology.orchestra.run.smithi161.stdout:(98/149): liboath-2.6.7-2.el9.x86_64.rpm 845 kB/s | 49 kB 00:00 2024-01-22T10:10:46.252 INFO:teuthology.orchestra.run.smithi161.stdout:(99/149): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-01-22T10:10:46.336 INFO:teuthology.orchestra.run.smithi161.stdout:(100/149): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-01-22T10:10:46.401 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-01-22T10:10:46.402 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-01-22T10:10:46.427 INFO:teuthology.orchestra.run.smithi161.stdout:(101/149): libarrow-9.0.0-10.el9.x86_64.rpm 7.5 MB/s | 4.4 MB 00:00 2024-01-22T10:10:46.511 INFO:teuthology.orchestra.run.smithi161.stdout:(102/149): python3-asyncssh-2.13.2-3.el9.noarch 6.5 MB/s | 548 kB 00:00 2024-01-22T10:10:46.545 INFO:teuthology.orchestra.run.smithi161.stdout:(103/149): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2024-01-22T10:10:46.578 INFO:teuthology.orchestra.run.smithi161.stdout:(104/149): python3-bcrypt-3.2.2-1.el9.x86_64.rp 657 kB/s | 43 kB 00:00 2024-01-22T10:10:46.612 INFO:teuthology.orchestra.run.smithi161.stdout:(105/149): python3-cachetools-4.2.4-1.el9.noarc 486 kB/s | 32 kB 00:00 2024-01-22T10:10:46.646 INFO:teuthology.orchestra.run.smithi161.stdout:(106/149): python3-certifi-2021.10.8-2.el9.noar 226 kB/s | 15 kB 00:00 2024-01-22T10:10:46.696 INFO:teuthology.orchestra.run.smithi161.stdout:(107/149): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-01-22T10:10:46.730 INFO:teuthology.orchestra.run.smithi161.stdout:(108/149): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-01-22T10:10:46.763 INFO:teuthology.orchestra.run.smithi161.stdout:(109/149): python3-google-auth-2.26.2-1.el9.noa 3.0 MB/s | 202 kB 00:00 2024-01-22T10:10:46.797 INFO:teuthology.orchestra.run.smithi161.stdout:(110/149): python3-jaraco-8.2.1-3.el9.noarch.rp 161 kB/s | 11 kB 00:00 2024-01-22T10:10:46.830 INFO:teuthology.orchestra.run.smithi161.stdout:(111/149): python3-jaraco-classes-3.2.1-5.el9.n 267 kB/s | 18 kB 00:00 2024-01-22T10:10:46.864 INFO:teuthology.orchestra.run.smithi161.stdout:(112/149): python3-jaraco-collections-3.0.0-8.e 349 kB/s | 23 kB 00:00 2024-01-22T10:10:46.897 INFO:teuthology.orchestra.run.smithi161.stdout:(113/149): python3-jaraco-functools-3.5.0-2.el9 294 kB/s | 19 kB 00:00 2024-01-22T10:10:46.931 INFO:teuthology.orchestra.run.smithi161.stdout:(114/149): python3-jaraco-text-3.2.0-6.el9.noar 296 kB/s | 20 kB 00:00 2024-01-22T10:10:47.015 INFO:teuthology.orchestra.run.smithi161.stdout:(115/149): python3-kubernetes-26.1.0-2.el9.noar 8.8 MB/s | 1.0 MB 00:00 2024-01-22T10:10:47.069 INFO:teuthology.orchestra.run.smithi161.stdout:(116/149): python3-logutils-0.3.5-21.el9.noarch 337 kB/s | 46 kB 00:00 2024-01-22T10:10:47.099 INFO:teuthology.orchestra.run.smithi161.stdout:(117/149): python3-more-itertools-8.12.0-2.el9. 953 kB/s | 79 kB 00:00 2024-01-22T10:10:47.140 INFO:teuthology.orchestra.run.smithi161.stdout:(118/149): python3-natsort-7.1.1-5.el9.noarch.r 826 kB/s | 58 kB 00:00 2024-01-22T10:10:47.174 INFO:teuthology.orchestra.run.smithi161.stdout:(119/149): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-01-22T10:10:47.208 INFO:teuthology.orchestra.run.smithi161.stdout:(120/149): python3-portend-3.1.0-2.el9.noarch.r 247 kB/s | 16 kB 00:00 2024-01-22T10:10:47.241 INFO:teuthology.orchestra.run.smithi161.stdout:(121/149): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-01-22T10:10:47.275 INFO:teuthology.orchestra.run.smithi161.stdout:(122/149): python3-repoze-lru-0.7-16.el9.noarch 465 kB/s | 31 kB 00:00 2024-01-22T10:10:47.309 INFO:teuthology.orchestra.run.smithi161.stdout:(123/149): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-01-22T10:10:47.342 INFO:teuthology.orchestra.run.smithi161.stdout:(124/149): python3-rsa-4.9-2.el9.noarch.rpm 892 kB/s | 59 kB 00:00 2024-01-22T10:10:47.480 INFO:teuthology.orchestra.run.smithi161.stdout:(125/149): python3-tempora-5.0.0-2.el9.noarch.r 209 kB/s | 36 kB 00:00 2024-01-22T10:10:47.518 INFO:teuthology.orchestra.run.smithi161.stdout:(126/149): python3-typing-extensions-4.4.0-2.el 291 kB/s | 51 kB 00:00 2024-01-22T10:10:47.568 INFO:teuthology.orchestra.run.smithi161.stdout:(127/149): python3-webob-1.8.7-6.el9.noarch.rpm 2.6 MB/s | 230 kB 00:00 2024-01-22T10:10:47.594 INFO:teuthology.orchestra.run.smithi161.stdout:(128/149): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-01-22T10:10:47.644 INFO:teuthology.orchestra.run.smithi161.stdout:(129/149): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-01-22T10:10:47.647 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-01-22T10:10:47.669 INFO:teuthology.orchestra.run.smithi161.stdout:(130/149): python3-zc-lockfile-2.0-10.el9.noarc 268 kB/s | 20 kB 00:00 2024-01-22T10:10:47.711 INFO:teuthology.orchestra.run.smithi161.stdout:(131/149): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-01-22T10:10:47.770 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/165 2024-01-22T10:10:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:(132/149): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-01-22T10:10:47.808 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-01-22T10:10:47.870 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-01-22T10:10:47.904 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-01-22T10:10:47.930 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-01-22T10:10:47.972 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-01-22T10:10:48.087 INFO:teuthology.orchestra.run.smithi161.stdout:(133/149): librados2-19.0.0-815.g1db5459e.el9.x 9.0 MB/s | 3.4 MB 00:00 2024-01-22T10:10:48.120 INFO:teuthology.orchestra.run.smithi161.stdout:(134/149): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-01-22T10:10:48.244 INFO:teuthology.orchestra.run.smithi161.stdout:(135/149): NetworkManager-1.45.10-1.el9.x86_64. 18 MB/s | 2.2 MB 00:00 2024-01-22T10:10:48.289 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-01-22T10:10:48.321 INFO:teuthology.orchestra.run.smithi161.stdout:(136/149): librbd1-19.0.0-815.g1db5459e.el9.x86 5.9 MB/s | 3.1 MB 00:00 2024-01-22T10:10:48.356 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:19.0.0-815.g1db5459e.el9.x86_64 8/165 2024-01-22T10:10:48.388 INFO:teuthology.orchestra.run.smithi161.stdout:(137/149): NetworkManager-libnm-1.45.10-1.el9.x 13 MB/s | 1.8 MB 00:00 2024-01-22T10:10:48.413 INFO:teuthology.orchestra.run.smithi161.stdout:(138/149): NetworkManager-team-1.45.10-1.el9.x8 534 kB/s | 42 kB 00:00 2024-01-22T10:10:48.446 INFO:teuthology.orchestra.run.smithi161.stdout:(139/149): NetworkManager-tui-1.45.10-1.el9.x86 4.2 MB/s | 246 kB 00:00 2024-01-22T10:10:48.460 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:19.0.0-815.g1db5459e.el9.x86_64 8/165 2024-01-22T10:10:48.472 INFO:teuthology.orchestra.run.smithi161.stdout:(140/149): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2024-01-22T10:10:48.491 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:19.0.0-815.g1db5459e.el9.x86_64 9/165 2024-01-22T10:10:48.497 INFO:teuthology.orchestra.run.smithi161.stdout:(141/149): elfutils-debuginfod-client-0.190-2.e 725 kB/s | 35 kB 00:00 2024-01-22T10:10:48.522 INFO:teuthology.orchestra.run.smithi161.stdout:(142/149): elfutils-libelf-0.190-2.el9.x86_64.r 3.8 MB/s | 191 kB 00:00 2024-01-22T10:10:48.556 INFO:teuthology.orchestra.run.smithi161.stdout:(143/149): elfutils-libs-0.190-2.el9.x86_64.rpm 4.4 MB/s | 254 kB 00:00 2024-01-22T10:10:48.581 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:19.0.0-815.g1db5459e.el9.x86_64 9/165 2024-01-22T10:10:48.589 INFO:teuthology.orchestra.run.smithi161.stdout:(144/149): libacl-2.3.1-4.el9.x86_64.rpm 343 kB/s | 22 kB 00:00 2024-01-22T10:10:48.611 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:19.0.0-815.g1db5459e.el9.x86_64 10/165 2024-01-22T10:10:48.648 INFO:teuthology.orchestra.run.smithi161.stdout:(145/149): openssl-3.0.7-25.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2024-01-22T10:10:48.689 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/165 2024-01-22T10:10:48.732 INFO:teuthology.orchestra.run.smithi161.stdout:(146/149): openssl-libs-3.0.7-25.el9.x86_64.rpm 16 MB/s | 2.1 MB 00:00 2024-01-22T10:10:48.765 INFO:teuthology.orchestra.run.smithi161.stdout:(147/149): xfsdump-3.1.12-4.el9.x86_64.rpm 3.0 MB/s | 321 kB 00:00 2024-01-22T10:10:48.770 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/165 2024-01-22T10:10:48.815 INFO:teuthology.orchestra.run.smithi161.stdout:(148/149): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-01-22T10:10:48.935 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/165 2024-01-22T10:10:48.985 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/165 2024-01-22T10:10:49.014 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:19.0.0-815.g1db5459e.el9.x86_64 15/165 2024-01-22T10:10:49.101 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:19.0.0-815.g1db5459e.el9.x86_64 15/165 2024-01-22T10:10:49.123 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:19.0.0-815.g1db5459e.el9.x86_ 16/165 2024-01-22T10:10:49.168 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:19.0.0-815.g1db5459e.el9.x86_ 16/165 2024-01-22T10:10:49.263 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/165 2024-01-22T10:10:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/165 2024-01-22T10:10:49.421 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/165 2024-01-22T10:10:49.489 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/165 2024-01-22T10:10:49.539 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/165 2024-01-22T10:10:49.803 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/165 2024-01-22T10:10:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/165 2024-01-22T10:10:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/165 2024-01-22T10:10:49.983 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/165 2024-01-22T10:10:50.022 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/165 2024-01-22T10:10:50.066 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/165 2024-01-22T10:10:50.106 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/165 2024-01-22T10:10:50.182 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/165 2024-01-22T10:10:50.221 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/165 2024-01-22T10:10:50.255 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/165 2024-01-22T10:10:50.283 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/165 2024-01-22T10:10:50.352 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/165 2024-01-22T10:10:50.388 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:19.0.0-815.g1db5459e.el9.x 31/165 2024-01-22T10:10:50.431 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:19.0.0-815.g1db5459e.el9 32/165 2024-01-22T10:10:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:19.0.0-815.g1db5459e.el9.x86_64 33/165 2024-01-22T10:10:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/165 2024-01-22T10:10:50.621 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/165 2024-01-22T10:10:50.764 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/165 2024-01-22T10:10:50.817 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/165 2024-01-22T10:10:51.337 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/165 2024-01-22T10:10:51.413 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/165 2024-01-22T10:10:51.446 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/165 2024-01-22T10:10:51.486 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/165 2024-01-22T10:10:51.524 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:19.0.0-815.g1db5459e.el9.x86_64 42/165 2024-01-22T10:10:51.567 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/165 2024-01-22T10:10:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/165 2024-01-22T10:10:51.749 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/165 2024-01-22T10:10:51.864 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/165 2024-01-22T10:10:51.911 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/165 2024-01-22T10:10:51.965 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/165 2024-01-22T10:10:52.039 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/165 2024-01-22T10:10:52.070 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/165 2024-01-22T10:10:52.106 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/165 2024-01-22T10:10:52.157 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/165 2024-01-22T10:10:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/165 2024-01-22T10:10:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/165 2024-01-22T10:10:52.312 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-01-22T10:10:52.385 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/165 2024-01-22T10:10:52.407 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/165 2024-01-22T10:10:52.421 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/165 2024-01-22T10:10:52.445 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-01-22T10:10:52.462 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 57/165 2024-01-22T10:10:52.498 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-01-22T10:10:52.532 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-01-22T10:10:52.556 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/165 2024-01-22T10:10:52.558 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-01-22T10:10:52.596 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 59/165 2024-01-22T10:10:52.600 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-01-22T10:10:52.636 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/165 2024-01-22T10:10:52.670 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/165 2024-01-22T10:10:52.762 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 62/165 2024-01-22T10:10:52.805 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 63/165 2024-01-22T10:10:52.854 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ply-3.11-14.el9.noarch 64/165 2024-01-22T10:10:52.910 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 65/165 2024-01-22T10:10:52.983 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-01-22T10:10:53.027 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:19.0.0-815.g1db5459e.el9.x86_64 8/165 2024-01-22T10:10:53.093 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 66/165 2024-01-22T10:10:53.147 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:19.0.0-815.g1db5459e.el9.x86_64 8/165 2024-01-22T10:10:53.177 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:19.0.0-815.g1db5459e.el9.x86_64 9/165 2024-01-22T10:10:53.243 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 67/165 2024-01-22T10:10:53.269 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:19.0.0-815.g1db5459e.el9.x86_64 9/165 2024-01-22T10:10:53.298 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:19.0.0-815.g1db5459e.el9.x86_64 10/165 2024-01-22T10:10:53.371 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/165 2024-01-22T10:10:53.380 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 68/165 2024-01-22T10:10:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 69/165 2024-01-22T10:10:53.448 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/165 2024-01-22T10:10:53.449 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 70/165 2024-01-22T10:10:53.480 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 71/165 2024-01-22T10:10:53.515 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : jq-1.6-16.el9.x86_64 72/165 2024-01-22T10:10:53.546 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.9-15.el9.x86_64 73/165 2024-01-22T10:10:53.574 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 74/165 2024-01-22T10:10:53.609 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 75/165 2024-01-22T10:10:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/165 2024-01-22T10:10:53.645 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : uuid-1.6.2-55.el9.x86_64 76/165 2024-01-22T10:10:53.675 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/165 2024-01-22T10:10:53.681 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/165 2024-01-22T10:10:53.709 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:19.0.0-815.g1db5459e.el9.x86_64 15/165 2024-01-22T10:10:53.750 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/165 2024-01-22T10:10:53.785 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/165 2024-01-22T10:10:53.819 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/165 2024-01-22T10:10:53.820 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:19.0.0-815.g1db5459e.el9.x86_64 15/165 2024-01-22T10:10:53.844 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:19.0.0-815.g1db5459e.el9.x86_ 16/165 2024-01-22T10:10:53.860 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/165 2024-01-22T10:10:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/165 2024-01-22T10:10:53.905 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:19.0.0-815.g1db5459e.el9.x86_ 16/165 2024-01-22T10:10:53.982 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/165 2024-01-22T10:10:54.006 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/165 2024-01-22T10:10:54.014 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/165 2024-01-22T10:10:54.023 INFO:teuthology.orchestra.run.smithi161.stdout:(149/149): ceph-test-19.0.0-815.g1db5459e.el9.x 3.1 MB/s | 46 MB 00:14 2024-01-22T10:10:54.033 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-01-22T10:10:54.034 INFO:teuthology.orchestra.run.smithi161.stdout:Total 10 MB/s | 209 MB 00:20 2024-01-22T10:10:54.115 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/165 2024-01-22T10:10:54.123 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/165 2024-01-22T10:10:54.125 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-01-22T10:10:54.164 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-01-22T10:10:54.183 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/165 2024-01-22T10:10:54.253 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/165 2024-01-22T10:10:54.302 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/165 2024-01-22T10:10:54.467 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-01-22T10:10:54.468 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-01-22T10:10:54.581 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/165 2024-01-22T10:10:54.624 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/165 2024-01-22T10:10:54.692 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/165 2024-01-22T10:10:54.745 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/165 2024-01-22T10:10:54.776 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/165 2024-01-22T10:10:54.811 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/165 2024-01-22T10:10:54.851 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/165 2024-01-22T10:10:54.881 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/165 2024-01-22T10:10:54.925 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/165 2024-01-22T10:10:54.928 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/165 2024-01-22T10:10:54.962 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/165 2024-01-22T10:10:54.967 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/165 2024-01-22T10:10:54.995 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/165 2024-01-22T10:10:55.009 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/165 2024-01-22T10:10:55.038 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/165 2024-01-22T10:10:55.107 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/165 2024-01-22T10:10:55.143 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:19.0.0-815.g1db5459e.el9.x 31/165 2024-01-22T10:10:55.162 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/165 2024-01-22T10:10:55.193 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/165 2024-01-22T10:10:55.269 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/165 2024-01-22T10:10:55.312 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:19.0.0-815.g1db5459e.el9 32/165 2024-01-22T10:10:55.518 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:19.0.0-815.g1db5459e.el9.x86_64 33/165 2024-01-22T10:10:55.608 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/165 2024-01-22T10:10:55.694 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/165 2024-01-22T10:10:55.824 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/165 2024-01-22T10:10:55.874 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/165 2024-01-22T10:10:55.901 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/165 2024-01-22T10:10:56.006 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/165 2024-01-22T10:10:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/165 2024-01-22T10:10:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/165 2024-01-22T10:10:56.501 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/165 2024-01-22T10:10:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/165 2024-01-22T10:10:56.580 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:19.0.0-815.g1db5459e.el9.x86_64 42/165 2024-01-22T10:10:56.622 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/165 2024-01-22T10:10:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-01-22T10:10:56.714 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-01-22T10:10:56.756 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/165 2024-01-22T10:10:56.797 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/165 2024-01-22T10:10:56.903 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/165 2024-01-22T10:10:56.942 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/165 2024-01-22T10:10:56.997 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/165 2024-01-22T10:10:57.061 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/165 2024-01-22T10:10:57.093 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/165 2024-01-22T10:10:57.130 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/165 2024-01-22T10:10:57.176 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/165 2024-01-22T10:10:57.216 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/165 2024-01-22T10:10:57.221 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/165 2024-01-22T10:10:57.264 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/165 2024-01-22T10:10:57.279 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/165 2024-01-22T10:10:57.307 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/165 2024-01-22T10:10:57.340 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 99/165 2024-01-22T10:10:57.396 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/165 2024-01-22T10:10:57.437 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/165 2024-01-22T10:10:57.478 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 57/165 2024-01-22T10:10:57.572 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/165 2024-01-22T10:10:57.612 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 59/165 2024-01-22T10:10:57.645 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/165 2024-01-22T10:10:57.675 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/165 2024-01-22T10:10:57.678 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:19.0.0-815.g1db5459e.el9.x86_64 101/165 2024-01-22T10:10:57.703 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/165 2024-01-22T10:10:57.767 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:19.0.0-815.g1db5459e.el9.x86_64 101/165 2024-01-22T10:10:57.799 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:19.0.0-815.g1db5459e.el9.x86_64 102/165 2024-01-22T10:10:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/165 2024-01-22T10:10:58.000 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 62/165 2024-01-22T10:10:58.039 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 63/165 2024-01-22T10:10:58.088 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ply-3.11-14.el9.noarch 64/165 2024-01-22T10:10:58.142 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 65/165 2024-01-22T10:10:58.261 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 104/165 2024-01-22T10:10:58.325 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 66/165 2024-01-22T10:10:58.377 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 67/165 2024-01-22T10:10:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:19.0.0-815.g1db5459e.el9.x86_64 105/165 2024-01-22T10:10:58.477 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:19.0.0-815.g1db5459e.el9.x86_64 105/165 2024-01-22T10:10:58.499 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:19.0.0-815.g1db5459e.el9.x86_64 106/165 2024-01-22T10:10:58.516 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 68/165 2024-01-22T10:10:58.558 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 69/165 2024-01-22T10:10:58.591 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 70/165 2024-01-22T10:10:58.630 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 71/165 2024-01-22T10:10:58.665 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.6-16.el9.x86_64 72/165 2024-01-22T10:10:58.697 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.9-15.el9.x86_64 73/165 2024-01-22T10:10:58.725 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 74/165 2024-01-22T10:10:58.759 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 75/165 2024-01-22T10:10:58.795 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : uuid-1.6.2-55.el9.x86_64 76/165 2024-01-22T10:10:58.826 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/165 2024-01-22T10:10:58.903 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/165 2024-01-22T10:10:58.936 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/165 2024-01-22T10:10:58.969 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/165 2024-01-22T10:10:59.010 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/165 2024-01-22T10:10:59.045 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/165 2024-01-22T10:10:59.135 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/165 2024-01-22T10:10:59.173 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/165 2024-01-22T10:10:59.276 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/165 2024-01-22T10:10:59.332 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-01-22T10:11:00.053 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/165 2024-01-22T10:11:00.104 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/165 2024-01-22T10:11:00.138 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/165 2024-01-22T10:11:00.170 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/165 2024-01-22T10:11:00.338 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/165 2024-01-22T10:11:00.368 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/165 2024-01-22T10:11:00.445 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/165 2024-01-22T10:11:00.617 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 107/165 2024-01-22T10:11:00.645 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 107/165 2024-01-22T10:11:01.081 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/165 2024-01-22T10:11:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 107/165 2024-01-22T10:11:01.198 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/165 2024-01-22T10:11:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:19.0.0-815.g1db5459e.el9.x86_64 108/165 2024-01-22T10:11:01.295 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:19.0.0-815.g1db5459e.el9.x86_64 108/165 2024-01-22T10:11:01.295 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-22T10:11:01.295 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-22T10:11:01.295 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:01.490 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:19.0.0-815.g1db5459e.el9.x86_64 109/165 2024-01-22T10:11:02.405 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/165 2024-01-22T10:11:02.488 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/165 2024-01-22T10:11:02.516 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/165 2024-01-22T10:11:02.549 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 99/165 2024-01-22T10:11:02.856 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/165 2024-01-22T10:11:02.887 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:19.0.0-815.g1db5459e.el9.x86_64 101/165 2024-01-22T10:11:02.977 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:19.0.0-815.g1db5459e.el9.x86_64 101/165 2024-01-22T10:11:03.008 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:19.0.0-815.g1db5459e.el9.x86_64 102/165 2024-01-22T10:11:03.044 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/165 2024-01-22T10:11:03.392 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-01-22T10:11:03.469 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 104/165 2024-01-22T10:11:03.498 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:19.0.0-815.g1db5459e.el9.x86_64 105/165 2024-01-22T10:11:03.513 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/165 2024-01-22T10:11:03.569 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:19.0.0-815.g1db5459e.el9.x86_64 105/165 2024-01-22T10:11:03.591 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:19.0.0-815.g1db5459e.el9.x86_64 106/165 2024-01-22T10:11:03.598 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-01-22T10:11:03.724 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-01-22T10:11:03.777 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-01-22T10:11:03.806 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-01-22T10:11:03.934 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-01-22T10:11:04.352 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-01-22T10:11:04.395 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librados2-2:19.0.0-815.g1db5459e.el9.x86_64 8/165 2024-01-22T10:11:04.556 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:19.0.0-815.g1db5459e.el9.x86_64 8/165 2024-01-22T10:11:04.605 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs2-2:19.0.0-815.g1db5459e.el9.x86_64 9/165 2024-01-22T10:11:04.728 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs2-2:19.0.0-815.g1db5459e.el9.x86_64 9/165 2024-01-22T10:11:04.771 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rados-2:19.0.0-815.g1db5459e.el9.x86_64 10/165 2024-01-22T10:11:04.935 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/165 2024-01-22T10:11:05.057 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/165 2024-01-22T10:11:05.339 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/165 2024-01-22T10:11:05.394 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/165 2024-01-22T10:11:05.420 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephsqlite-2:19.0.0-815.g1db5459e.el9.x86_64 15/165 2024-01-22T10:11:05.586 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephsqlite-2:19.0.0-815.g1db5459e.el9.x86_64 15/165 2024-01-22T10:11:05.621 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libradosstriper1-2:19.0.0-815.g1db5459e.el9.x86_ 16/165 2024-01-22T10:11:05.726 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libradosstriper1-2:19.0.0-815.g1db5459e.el9.x86_ 16/165 2024-01-22T10:11:05.751 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 107/165 2024-01-22T10:11:05.779 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 107/165 2024-01-22T10:11:06.069 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/165 2024-01-22T10:11:06.251 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/165 2024-01-22T10:11:06.295 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 107/165 2024-01-22T10:11:06.332 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:19.0.0-815.g1db5459e.el9.x86_64 108/165 2024-01-22T10:11:06.338 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/165 2024-01-22T10:11:06.416 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:19.0.0-815.g1db5459e.el9.x86_64 108/165 2024-01-22T10:11:06.416 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-22T10:11:06.416 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-22T10:11:06.417 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:06.450 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:19.0.0-815.g1db5459e.el9.x86_64 109/165 2024-01-22T10:11:06.509 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/165 2024-01-22T10:11:06.587 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/165 2024-01-22T10:11:07.037 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/165 2024-01-22T10:11:07.067 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/165 2024-01-22T10:11:07.156 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/165 2024-01-22T10:11:07.229 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/165 2024-01-22T10:11:07.279 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/165 2024-01-22T10:11:07.345 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/165 2024-01-22T10:11:07.399 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/165 2024-01-22T10:11:07.506 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/165 2024-01-22T10:11:07.547 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/165 2024-01-22T10:11:07.594 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/165 2024-01-22T10:11:07.633 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/165 2024-01-22T10:11:07.749 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/165 2024-01-22T10:11:07.787 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-common-2:19.0.0-815.g1db5459e.el9.x 31/165 2024-01-22T10:11:07.837 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-argparse-2:19.0.0-815.g1db5459e.el9 32/165 2024-01-22T10:11:07.868 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cephfs-2:19.0.0-815.g1db5459e.el9.x86_64 33/165 2024-01-22T10:11:07.982 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/165 2024-01-22T10:11:08.091 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/165 2024-01-22T10:11:08.272 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/165 2024-01-22T10:11:08.340 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/165 2024-01-22T10:11:09.053 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/165 2024-01-22T10:11:09.167 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/165 2024-01-22T10:11:09.219 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/165 2024-01-22T10:11:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/165 2024-01-22T10:11:09.319 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librados-devel-2:19.0.0-815.g1db5459e.el9.x86_64 42/165 2024-01-22T10:11:09.382 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/165 2024-01-22T10:11:09.571 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/165 2024-01-22T10:11:09.622 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/165 2024-01-22T10:11:09.775 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/165 2024-01-22T10:11:09.816 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/165 2024-01-22T10:11:09.881 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/165 2024-01-22T10:11:10.074 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/165 2024-01-22T10:11:10.118 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/165 2024-01-22T10:11:10.159 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/165 2024-01-22T10:11:10.230 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/165 2024-01-22T10:11:10.316 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/165 2024-01-22T10:11:10.378 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/165 2024-01-22T10:11:10.571 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/165 2024-01-22T10:11:10.624 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/165 2024-01-22T10:11:10.694 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 57/165 2024-01-22T10:11:10.825 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/165 2024-01-22T10:11:10.857 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 59/165 2024-01-22T10:11:10.903 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/165 2024-01-22T10:11:10.939 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/165 2024-01-22T10:11:11.087 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 62/165 2024-01-22T10:11:11.144 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 63/165 2024-01-22T10:11:11.211 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ply-3.11-14.el9.noarch 64/165 2024-01-22T10:11:11.291 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 65/165 2024-01-22T10:11:11.551 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 66/165 2024-01-22T10:11:11.614 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 67/165 2024-01-22T10:11:11.788 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 68/165 2024-01-22T10:11:11.844 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 69/165 2024-01-22T10:11:11.887 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 70/165 2024-01-22T10:11:11.933 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 71/165 2024-01-22T10:11:11.975 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : jq-1.6-16.el9.x86_64 72/165 2024-01-22T10:11:12.019 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fuse-2.9.9-15.el9.x86_64 73/165 2024-01-22T10:11:12.062 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 74/165 2024-01-22T10:11:12.127 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 75/165 2024-01-22T10:11:12.205 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : uuid-1.6.2-55.el9.x86_64 76/165 2024-01-22T10:11:12.246 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/165 2024-01-22T10:11:12.376 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/165 2024-01-22T10:11:12.422 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/165 2024-01-22T10:11:12.457 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/165 2024-01-22T10:11:12.511 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/165 2024-01-22T10:11:12.569 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/165 2024-01-22T10:11:12.715 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/165 2024-01-22T10:11:12.767 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/165 2024-01-22T10:11:12.910 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/165 2024-01-22T10:11:12.980 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-01-22T10:11:13.186 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:19.0.0-815.g1db5459e.el9.x86_64 109/165 2024-01-22T10:11:13.187 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2024-01-22T10:11:13.187 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2024-01-22T10:11:13.187 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2024-01-22T10:11:13.187 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2024-01-22T10:11:13.187 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2024-01-22T10:11:13.187 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /root 2024-01-22T10:11:13.187 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2024-01-22T10:11:13.187 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:13.361 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:19.0.0-815.g1db5459e.el9.noarch 110/165 2024-01-22T10:11:13.377 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:19.0.0-815.g1db5459e.el9.noarch 110/165 2024-01-22T10:11:13.377 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:13.377 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-22T10:11:13.377 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:13.962 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/165 2024-01-22T10:11:14.012 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/165 2024-01-22T10:11:14.063 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/165 2024-01-22T10:11:14.096 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/165 2024-01-22T10:11:14.347 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/165 2024-01-22T10:11:14.375 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/165 2024-01-22T10:11:14.500 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/165 2024-01-22T10:11:14.806 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:19.0.0-815.g1db5459e.el9.x86_64 111/165 2024-01-22T10:11:14.831 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:19.0.0-815.g1db5459e.el9.x86_64 111/165 2024-01-22T10:11:14.831 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:14.831 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-22T10:11:14.831 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-22T10:11:14.831 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-22T10:11:14.831 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:15.039 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:19.0.0-815.g1db5459e.el9.x86_64 112/165 2024-01-22T10:11:15.062 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:19.0.0-815.g1db5459e.el9.x86_64 112/165 2024-01-22T10:11:15.062 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:15.062 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-22T10:11:15.063 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-22T10:11:15.063 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-22T10:11:15.063 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:15.300 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/165 2024-01-22T10:11:15.431 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/165 2024-01-22T10:11:15.499 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:19.0.0-815.g1db5459e.el9.x86_64 113/165 2024-01-22T10:11:15.521 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:19.0.0-815.g1db5459e.el9.x86_64 113/165 2024-01-22T10:11:15.522 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:15.522 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-22T10:11:15.522 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-22T10:11:15.522 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-22T10:11:15.522 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:15.617 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : automake-1.16.2-8.el9.noarch 114/165 2024-01-22T10:11:16.074 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:19.0.0-815.g1db5459e.el9.noarch 115/165 2024-01-22T10:11:16.107 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:19.0.0-815.g1db5459e.el9.noarch 115/165 2024-01-22T10:11:16.137 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-815.g1db5459e.el 116/165 2024-01-22T10:11:16.197 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-815.g1db5459e.e 117/165 2024-01-22T10:11:16.222 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-815.g1db5459e.el9.noar 118/165 2024-01-22T10:11:16.446 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-815.g1db5459e.el9.noar 118/165 2024-01-22T10:11:16.481 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-815.g1db5459e.el9.no 119/165 2024-01-22T10:11:16.979 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/165 2024-01-22T10:11:17.074 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/165 2024-01-22T10:11:17.110 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/165 2024-01-22T10:11:17.146 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 99/165 2024-01-22T10:11:17.444 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-815.g1db5459e.el9.no 119/165 2024-01-22T10:11:17.473 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-815.g1db5 120/165 2024-01-22T10:11:17.520 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/165 2024-01-22T10:11:17.554 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librbd1-2:19.0.0-815.g1db5459e.el9.x86_64 101/165 2024-01-22T10:11:17.573 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-815.g1db5 120/165 2024-01-22T10:11:17.665 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:19.0.0-815.g1db5459e.el9.x86_64 101/165 2024-01-22T10:11:17.692 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rbd-2:19.0.0-815.g1db5459e.el9.x86_64 102/165 2024-01-22T10:11:17.737 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/165 2024-01-22T10:11:17.743 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-815.g1db5459e.el9 121/165 2024-01-22T10:11:17.775 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:19.0.0-815.g1db5459e.el9.x86_64 122/165 2024-01-22T10:11:17.798 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:19.0.0-815.g1db5459e.el9.x86_64 122/165 2024-01-22T10:11:17.799 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:17.799 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-22T10:11:17.799 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-22T10:11:17.799 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-22T10:11:17.799 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:17.838 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:19.0.0-815.g1db5459e.el9.x86_64 109/165 2024-01-22T10:11:17.838 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2024-01-22T10:11:17.838 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2024-01-22T10:11:17.838 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2024-01-22T10:11:17.838 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2024-01-22T10:11:17.838 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2024-01-22T10:11:17.838 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /root 2024-01-22T10:11:17.839 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2024-01-22T10:11:17.839 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:17.842 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:19.0.0-815.g1db5459e.el9.noarch 123/165 2024-01-22T10:11:17.854 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-815.g1db5459e.el9.noarch 123/165 2024-01-22T10:11:17.898 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:19.0.0-815.g1db5459e.el9.x86_64 124/165 2024-01-22T10:11:18.003 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-volume-2:19.0.0-815.g1db5459e.el9.noarch 110/165 2024-01-22T10:11:18.018 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-volume-2:19.0.0-815.g1db5459e.el9.noarch 110/165 2024-01-22T10:11:18.019 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:18.019 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-22T10:11:18.019 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:18.212 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 104/165 2024-01-22T10:11:18.248 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librgw2-2:19.0.0-815.g1db5459e.el9.x86_64 105/165 2024-01-22T10:11:18.339 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librgw2-2:19.0.0-815.g1db5459e.el9.x86_64 105/165 2024-01-22T10:11:18.367 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rgw-2:19.0.0-815.g1db5459e.el9.x86_64 106/165 2024-01-22T10:11:18.675 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libtool-2.4.6-45.el9.x86_64 125/165 2024-01-22T10:11:18.702 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:19.0.0-815.g1db5459e.el9.x86_64 126/165 2024-01-22T10:11:18.725 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-815.g1db5459e.el9.x86_64 126/165 2024-01-22T10:11:18.726 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:18.726 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-22T10:11:18.726 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-22T10:11:18.726 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-22T10:11:18.726 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:18.778 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-815.g1db545 127/165 2024-01-22T10:11:18.800 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-815.g1db545 127/165 2024-01-22T10:11:18.800 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:18.800 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-22T10:11:18.801 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:18.845 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 128/165 2024-01-22T10:11:18.867 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 128/165 2024-01-22T10:11:18.868 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:18.868 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-22T10:11:18.868 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-22T10:11:18.868 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-22T10:11:18.868 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 129/165 2024-01-22T10:11:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 129/165 2024-01-22T10:11:19.194 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:19.194 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-22T10:11:19.194 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-22T10:11:19.194 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-22T10:11:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:19.464 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:19.0.0-815.g1db5459e.el9.x86_64 111/165 2024-01-22T10:11:19.490 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:19.0.0-815.g1db5459e.el9.x86_64 111/165 2024-01-22T10:11:19.490 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:19.490 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-22T10:11:19.490 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-22T10:11:19.490 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-22T10:11:19.490 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:19.698 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:19.0.0-815.g1db5459e.el9.x86_64 112/165 2024-01-22T10:11:19.720 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:19.0.0-815.g1db5459e.el9.x86_64 112/165 2024-01-22T10:11:19.720 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:19.720 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-22T10:11:19.720 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-22T10:11:19.720 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-22T10:11:19.720 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:20.157 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:19.0.0-815.g1db5459e.el9.x86_64 113/165 2024-01-22T10:11:20.180 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:19.0.0-815.g1db5459e.el9.x86_64 113/165 2024-01-22T10:11:20.180 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:20.180 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-22T10:11:20.180 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-22T10:11:20.180 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-22T10:11:20.180 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:20.267 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : automake-1.16.2-8.el9.noarch 114/165 2024-01-22T10:11:20.633 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:19.0.0-815.g1db5459e.el9.noarch 115/165 2024-01-22T10:11:20.659 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:19.0.0-815.g1db5459e.el9.noarch 115/165 2024-01-22T10:11:20.687 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-815.g1db5459e.el 116/165 2024-01-22T10:11:20.748 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-815.g1db5459e.e 117/165 2024-01-22T10:11:20.772 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-815.g1db5459e.el9.noar 118/165 2024-01-22T10:11:20.774 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 107/165 2024-01-22T10:11:20.813 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 107/165 2024-01-22T10:11:20.994 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-815.g1db5459e.el9.noar 118/165 2024-01-22T10:11:21.023 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-815.g1db5459e.el9.no 119/165 2024-01-22T10:11:21.413 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 107/165 2024-01-22T10:11:21.458 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-base-2:19.0.0-815.g1db5459e.el9.x86_64 108/165 2024-01-22T10:11:21.604 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-base-2:19.0.0-815.g1db5459e.el9.x86_64 108/165 2024-01-22T10:11:21.604 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-22T10:11:21.604 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-22T10:11:21.604 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:21.651 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-selinux-2:19.0.0-815.g1db5459e.el9.x86_64 109/165 2024-01-22T10:11:21.982 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-815.g1db5459e.el9.no 119/165 2024-01-22T10:11:22.006 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-815.g1db5 120/165 2024-01-22T10:11:22.107 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-815.g1db5 120/165 2024-01-22T10:11:22.260 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-815.g1db5459e.el9 121/165 2024-01-22T10:11:22.291 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:19.0.0-815.g1db5459e.el9.x86_64 122/165 2024-01-22T10:11:22.315 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:19.0.0-815.g1db5459e.el9.x86_64 122/165 2024-01-22T10:11:22.315 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:22.315 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-22T10:11:22.315 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-22T10:11:22.316 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-22T10:11:22.316 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:22.351 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:19.0.0-815.g1db5459e.el9.noarch 123/165 2024-01-22T10:11:22.362 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-815.g1db5459e.el9.noarch 123/165 2024-01-22T10:11:22.408 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:19.0.0-815.g1db5459e.el9.x86_64 124/165 2024-01-22T10:11:23.177 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtool-2.4.6-45.el9.x86_64 125/165 2024-01-22T10:11:23.211 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:19.0.0-815.g1db5459e.el9.x86_64 126/165 2024-01-22T10:11:23.233 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-815.g1db5459e.el9.x86_64 126/165 2024-01-22T10:11:23.233 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:23.233 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-22T10:11:23.233 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-22T10:11:23.234 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-22T10:11:23.234 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:23.278 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-815.g1db545 127/165 2024-01-22T10:11:23.300 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-815.g1db545 127/165 2024-01-22T10:11:23.300 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:23.300 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-22T10:11:23.300 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:23.345 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 128/165 2024-01-22T10:11:23.368 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 128/165 2024-01-22T10:11:23.368 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:23.368 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-22T10:11:23.368 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-22T10:11:23.368 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-22T10:11:23.368 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:23.466 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:19.0.0-815.g1db5459e.el9.x86_64 130/165 2024-01-22T10:11:23.507 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 131/165 2024-01-22T10:11:23.548 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:19.0.0-815.g1db5459e.el9.x86_64 132/165 2024-01-22T10:11:23.580 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 133/165 2024-01-22T10:11:23.671 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 129/165 2024-01-22T10:11:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 129/165 2024-01-22T10:11:23.694 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:23.694 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-22T10:11:23.694 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-22T10:11:23.694 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-22T10:11:23.694 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:23.750 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 134/165 2024-01-22T10:11:23.864 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 135/165 2024-01-22T10:11:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 136/165 2024-01-22T10:11:23.928 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:19.0.0-815.g1db5459e.el9.x86_6 137/165 2024-01-22T10:11:23.961 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 138/165 2024-01-22T10:11:23.990 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 139/165 2024-01-22T10:11:24.046 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 140/165 2024-01-22T10:11:24.095 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 141/165 2024-01-22T10:11:24.147 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 142/165 2024-01-22T10:11:24.723 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/165 2024-01-22T10:11:24.762 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 143/165 2024-01-22T10:11:24.788 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/165 2024-01-22T10:11:24.843 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/165 2024-01-22T10:11:25.658 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-top-2:19.0.0-815.g1db5459e.el9.noarch 145/165 2024-01-22T10:11:25.732 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 146/165 2024-01-22T10:11:25.776 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 147/165 2024-01-22T10:11:25.862 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flex-2.6.4-9.el9.x86_64 148/165 2024-01-22T10:11:25.911 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : bison-3.7.4-5.el9.x86_64 149/165 2024-01-22T10:11:25.936 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 150/165 2024-01-22T10:11:25.962 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/165 2024-01-22T10:11:25.988 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 152/165 2024-01-22T10:11:25.988 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-01-22T10:11:26.073 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-01-22T10:11:26.100 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 154/165 2024-01-22T10:11:26.131 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 155/165 2024-01-22T10:11:26.156 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 156/165 2024-01-22T10:11:26.184 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 157/165 2024-01-22T10:11:26.185 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 158/165 2024-01-22T10:11:26.258 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 158/165 2024-01-22T10:11:26.284 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2024-01-22T10:11:26.289 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2024-01-22T10:11:26.290 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2024-01-22T10:11:26.469 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2024-01-22T10:11:26.469 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2024-01-22T10:11:26.536 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2024-01-22T10:11:26.560 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 162/165 2024-01-22T10:11:26.587 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 163/165 2024-01-22T10:11:26.620 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 164/165 2024-01-22T10:11:26.683 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 165/165 2024-01-22T10:11:27.974 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:19.0.0-815.g1db5459e.el9.x86_64 130/165 2024-01-22T10:11:28.015 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 131/165 2024-01-22T10:11:28.056 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:19.0.0-815.g1db5459e.el9.x86_64 132/165 2024-01-22T10:11:28.088 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 133/165 2024-01-22T10:11:28.262 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 134/165 2024-01-22T10:11:28.382 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 135/165 2024-01-22T10:11:28.428 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 136/165 2024-01-22T10:11:28.461 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:19.0.0-815.g1db5459e.el9.x86_6 137/165 2024-01-22T10:11:28.502 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 138/165 2024-01-22T10:11:28.531 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 139/165 2024-01-22T10:11:28.598 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 140/165 2024-01-22T10:11:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 141/165 2024-01-22T10:11:28.688 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 142/165 2024-01-22T10:11:29.263 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/165 2024-01-22T10:11:29.303 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 143/165 2024-01-22T10:11:29.329 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/165 2024-01-22T10:11:29.392 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/165 2024-01-22T10:11:30.207 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-top-2:19.0.0-815.g1db5459e.el9.noarch 145/165 2024-01-22T10:11:30.282 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 146/165 2024-01-22T10:11:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 147/165 2024-01-22T10:11:30.404 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flex-2.6.4-9.el9.x86_64 148/165 2024-01-22T10:11:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bison-3.7.4-5.el9.x86_64 149/165 2024-01-22T10:11:30.461 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 150/165 2024-01-22T10:11:30.486 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/165 2024-01-22T10:11:30.512 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 152/165 2024-01-22T10:11:30.513 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-01-22T10:11:30.580 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-01-22T10:11:30.608 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 154/165 2024-01-22T10:11:30.639 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 155/165 2024-01-22T10:11:30.689 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 156/165 2024-01-22T10:11:30.723 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 157/165 2024-01-22T10:11:30.723 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 158/165 2024-01-22T10:11:30.807 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 158/165 2024-01-22T10:11:30.832 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2024-01-22T10:11:30.838 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2024-01-22T10:11:30.838 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2024-01-22T10:11:31.018 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2024-01-22T10:11:31.018 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2024-01-22T10:11:31.101 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2024-01-22T10:11:31.126 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 162/165 2024-01-22T10:11:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 163/165 2024-01-22T10:11:31.177 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 164/165 2024-01-22T10:11:31.240 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 165/165 2024-01-22T10:11:31.387 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 165/165 2024-01-22T10:11:31.388 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:19.0.0-815.g1db5459e.el9.x86_64 1/165 2024-01-22T10:11:31.388 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:19.0.0-815.g1db5459e.el9.x86_64 2/165 2024-01-22T10:11:31.388 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 3/165 2024-01-22T10:11:31.388 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 4/165 2024-01-22T10:11:31.388 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-815.g1db545 5/165 2024-01-22T10:11:31.388 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:19.0.0-815.g1db5459e.el9.x86_64 6/165 2024-01-22T10:11:31.388 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:19.0.0-815.g1db5459e.el9.x86_64 7/165 2024-01-22T10:11:31.388 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:19.0.0-815.g1db5459e.el9.x86_64 8/165 2024-01-22T10:11:31.388 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:19.0.0-815.g1db5459e.el9.x86_64 9/165 2024-01-22T10:11:31.388 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:19.0.0-815.g1db5459e.el9.x86_64 10/165 2024-01-22T10:11:31.388 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:19.0.0-815.g1db5459e.el9.x86_64 11/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:19.0.0-815.g1db5459e.el9.x86_64 12/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 13/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:19.0.0-815.g1db5459e.el9.x86_6 14/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:19.0.0-815.g1db5459e.el9.x86_64 15/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:19.0.0-815.g1db5459e.el9.x86_64 16/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:19.0.0-815.g1db5459e.el9.x86_64 17/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:19.0.0-815.g1db5459e.el9.x86_ 18/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:19.0.0-815.g1db5459e.el9.x86_64 19/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:19.0.0-815.g1db5459e.el9 20/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:19.0.0-815.g1db5459e.el9.x 21/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:19.0.0-815.g1db5459e.el9.x86_64 22/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:19.0.0-815.g1db5459e.el9.x86_64 23/165 2024-01-22T10:11:31.389 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:19.0.0-815.g1db5459e.el9.x86_64 24/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:19.0.0-815.g1db5459e.el9.x86_64 25/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 26/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 27/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:19.0.0-815.g1db5459e.el9.x86_64 28/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-815.g1db5459e.e 29/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-815.g1db5459e.el9.noar 30/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-815.g1db5459e.el9.no 31/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-815.g1db5 32/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-815.g1db5459e.el9 33/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:19.0.0-815.g1db5459e.el9.noarch 34/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-815.g1db5459e.el 35/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:19.0.0-815.g1db5459e.el9.noarch 36/165 2024-01-22T10:11:31.390 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:19.0.0-815.g1db5459e.el9.noarch 37/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-top-2:19.0.0-815.g1db5459e.el9.noarch 38/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 42/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/165 2024-01-22T10:11:31.391 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/165 2024-01-22T10:11:31.392 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/165 2024-01-22T10:11:31.392 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 52/165 2024-01-22T10:11:31.392 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 53/165 2024-01-22T10:11:31.392 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 54/165 2024-01-22T10:11:31.392 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-5.4.4-4.el9.x86_64 55/165 2024-01-22T10:11:31.392 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/165 2024-01-22T10:11:31.392 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/165 2024-01-22T10:11:31.392 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 58/165 2024-01-22T10:11:31.392 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/165 2024-01-22T10:11:31.392 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/165 2024-01-22T10:11:31.392 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/165 2024-01-22T10:11:31.392 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/165 2024-01-22T10:11:31.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/165 2024-01-22T10:11:31.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/165 2024-01-22T10:11:31.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/165 2024-01-22T10:11:31.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/165 2024-01-22T10:11:31.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/165 2024-01-22T10:11:31.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/165 2024-01-22T10:11:31.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/165 2024-01-22T10:11:31.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/165 2024-01-22T10:11:31.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/165 2024-01-22T10:11:31.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/165 2024-01-22T10:11:31.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/165 2024-01-22T10:11:31.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 81/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : jq-1.6-16.el9.x86_64 85/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 86/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 87/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 88/165 2024-01-22T10:11:31.394 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 89/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 90/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 91/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 92/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 93/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 96/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/165 2024-01-22T10:11:31.395 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 103/165 2024-01-22T10:11:31.396 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 104/165 2024-01-22T10:11:31.396 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/165 2024-01-22T10:11:31.396 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/165 2024-01-22T10:11:31.396 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/165 2024-01-22T10:11:31.396 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/165 2024-01-22T10:11:31.396 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/165 2024-01-22T10:11:31.396 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 110/165 2024-01-22T10:11:31.396 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 111/165 2024-01-22T10:11:31.396 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 112/165 2024-01-22T10:11:31.396 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 113/165 2024-01-22T10:11:31.397 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/165 2024-01-22T10:11:31.397 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 115/165 2024-01-22T10:11:31.397 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/165 2024-01-22T10:11:31.397 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/165 2024-01-22T10:11:31.397 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/165 2024-01-22T10:11:31.397 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/165 2024-01-22T10:11:31.397 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/165 2024-01-22T10:11:31.397 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/165 2024-01-22T10:11:31.397 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/165 2024-01-22T10:11:31.397 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/165 2024-01-22T10:11:31.397 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/165 2024-01-22T10:11:31.397 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:19.0.0-815.g1db5459e.el9.x86_64 134/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:19.0.0-815.g1db5459e.el9.x86_64 136/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/165 2024-01-22T10:11:31.398 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 140/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 142/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 144/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 150/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 152/165 2024-01-22T10:11:31.399 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 153/165 2024-01-22T10:11:31.400 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 154/165 2024-01-22T10:11:31.400 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 155/165 2024-01-22T10:11:31.400 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 156/165 2024-01-22T10:11:31.400 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 157/165 2024-01-22T10:11:31.400 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 158/165 2024-01-22T10:11:31.400 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 159/165 2024-01-22T10:11:31.400 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 160/165 2024-01-22T10:11:31.400 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 161/165 2024-01-22T10:11:31.400 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 162/165 2024-01-22T10:11:31.400 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 163/165 2024-01-22T10:11:31.400 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 164/165 2024-01-22T10:11:33.796 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 165/165 2024-01-22T10:11:33.796 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:33.796 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2024-01-22T10:11:33.796 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: acl-2.3.1-4.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-22T10:11:33.797 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout: automake-1.16.2-8.el9.noarch 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout: bison-3.7.4-5.el9.x86_64 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.798 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:33.799 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-22T10:11:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: flex-2.6.4-9.el9.x86_64 2024-01-22T10:11:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-22T10:11:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-22T10:11:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-22T10:11:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-22T10:11:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-22T10:11:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: jq-1.6-16.el9.x86_64 2024-01-22T10:11:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-22T10:11:33.800 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-22T10:11:33.801 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: lua-5.4.4-4.el9.x86_64 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-22T10:11:33.802 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-22T10:11:33.803 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-13.11-1.el9.x86_64 2024-01-22T10:11:33.803 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-22T10:11:33.803 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-22T10:11:33.803 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-22T10:11:33.803 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-22T10:11:33.803 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-22T10:11:33.803 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-22T10:11:33.803 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-22T10:11:33.803 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.803 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.803 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.804 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-22T10:11:33.804 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-22T10:11:33.804 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-22T10:11:33.804 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-22T10:11:33.804 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-22T10:11:33.804 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-22T10:11:33.804 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-22T10:11:33.804 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-22T10:11:33.804 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-22T10:11:33.804 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-22T10:11:33.805 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-22T10:11:33.805 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-22T10:11:33.805 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-22T10:11:33.805 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-22T10:11:33.805 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-22T10:11:33.805 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-22T10:11:33.805 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-22T10:11:33.805 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-22T10:11:33.805 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-22T10:11:33.805 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-22T10:11:33.805 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-22T10:11:33.805 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-22T10:11:33.806 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-22T10:11:33.806 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-22T10:11:33.806 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-22T10:11:33.806 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply-3.11-14.el9.noarch 2024-01-22T10:11:33.806 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-22T10:11:33.806 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-22T10:11:33.806 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-22T10:11:33.806 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-22T10:11:33.806 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-22T10:11:33.806 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-22T10:11:33.806 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-22T10:11:33.807 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.807 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.807 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-22T10:11:33.807 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-22T10:11:33.807 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-22T10:11:33.807 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.807 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-22T10:11:33.807 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-22T10:11:33.807 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-22T10:11:33.807 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-22T10:11:33.807 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-22T10:11:33.807 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-22T10:11:33.808 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-22T10:11:33.808 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-22T10:11:33.808 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-22T10:11:33.808 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-22T10:11:33.808 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-22T10:11:33.808 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.808 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.808 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:33.808 INFO:teuthology.orchestra.run.smithi119.stdout: re2-1:20211101-3.el9.x86_64 2024-01-22T10:11:33.808 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-22T10:11:33.808 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-22T10:11:33.809 INFO:teuthology.orchestra.run.smithi119.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-22T10:11:33.809 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-22T10:11:33.809 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-22T10:11:33.809 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-22T10:11:33.809 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:11:33.809 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-01-22T10:11:34.386 DEBUG:teuthology.parallel:result is None 2024-01-22T10:11:34.392 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-selinux-2:19.0.0-815.g1db5459e.el9.x86_64 109/165 2024-01-22T10:11:34.392 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /sys 2024-01-22T10:11:34.392 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /proc 2024-01-22T10:11:34.392 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /mnt 2024-01-22T10:11:34.393 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /var/tmp 2024-01-22T10:11:34.393 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /home 2024-01-22T10:11:34.393 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /root 2024-01-22T10:11:34.393 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /tmp 2024-01-22T10:11:34.393 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:34.628 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-volume-2:19.0.0-815.g1db5459e.el9.noarch 110/165 2024-01-22T10:11:34.680 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-volume-2:19.0.0-815.g1db5459e.el9.noarch 110/165 2024-01-22T10:11:34.680 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:34.680 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-22T10:11:34.680 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:36.026 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 165/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:19.0.0-815.g1db5459e.el9.x86_64 1/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:19.0.0-815.g1db5459e.el9.x86_64 2/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 3/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 4/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-815.g1db545 5/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:19.0.0-815.g1db5459e.el9.x86_64 6/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:19.0.0-815.g1db5459e.el9.x86_64 7/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:19.0.0-815.g1db5459e.el9.x86_64 8/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:19.0.0-815.g1db5459e.el9.x86_64 9/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:19.0.0-815.g1db5459e.el9.x86_64 10/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:19.0.0-815.g1db5459e.el9.x86_64 11/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:19.0.0-815.g1db5459e.el9.x86_64 12/165 2024-01-22T10:11:36.027 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 13/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:19.0.0-815.g1db5459e.el9.x86_6 14/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:19.0.0-815.g1db5459e.el9.x86_64 15/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:19.0.0-815.g1db5459e.el9.x86_64 16/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:19.0.0-815.g1db5459e.el9.x86_64 17/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:19.0.0-815.g1db5459e.el9.x86_ 18/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:19.0.0-815.g1db5459e.el9.x86_64 19/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:19.0.0-815.g1db5459e.el9 20/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:19.0.0-815.g1db5459e.el9.x 21/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:19.0.0-815.g1db5459e.el9.x86_64 22/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:19.0.0-815.g1db5459e.el9.x86_64 23/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:19.0.0-815.g1db5459e.el9.x86_64 24/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:19.0.0-815.g1db5459e.el9.x86_64 25/165 2024-01-22T10:11:36.028 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 26/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 27/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:19.0.0-815.g1db5459e.el9.x86_64 28/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-815.g1db5459e.e 29/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-815.g1db5459e.el9.noar 30/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-815.g1db5459e.el9.no 31/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-815.g1db5 32/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-815.g1db5459e.el9 33/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:19.0.0-815.g1db5459e.el9.noarch 34/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-815.g1db5459e.el 35/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-volume-2:19.0.0-815.g1db5459e.el9.noarch 36/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:19.0.0-815.g1db5459e.el9.noarch 37/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-top-2:19.0.0-815.g1db5459e.el9.noarch 38/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/165 2024-01-22T10:11:36.029 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 42/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 52/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 53/165 2024-01-22T10:11:36.030 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 54/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-5.4.4-4.el9.x86_64 55/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 58/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/165 2024-01-22T10:11:36.031 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/165 2024-01-22T10:11:36.032 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 81/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.6-16.el9.x86_64 85/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 86/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 87/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 88/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 89/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 90/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ply-3.11-14.el9.noarch 91/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 92/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 93/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/165 2024-01-22T10:11:36.033 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 96/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 103/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 104/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/165 2024-01-22T10:11:36.034 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 110/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 111/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 112/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 113/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 115/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/165 2024-01-22T10:11:36.035 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:19.0.0-815.g1db5459e.el9.x86_64 134/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:19.0.0-815.g1db5459e.el9.x86_64 136/165 2024-01-22T10:11:36.036 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 140/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 142/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 144/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 150/165 2024-01-22T10:11:36.037 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 152/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 153/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 154/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 155/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 156/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 157/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 158/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 159/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 160/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 161/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 162/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 163/165 2024-01-22T10:11:36.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 164/165 2024-01-22T10:11:36.323 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-osd-2:19.0.0-815.g1db5459e.el9.x86_64 111/165 2024-01-22T10:11:36.414 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-osd-2:19.0.0-815.g1db5459e.el9.x86_64 111/165 2024-01-22T10:11:36.414 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:36.414 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-22T10:11:36.414 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-22T10:11:36.414 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-22T10:11:36.414 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:36.648 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mds-2:19.0.0-815.g1db5459e.el9.x86_64 112/165 2024-01-22T10:11:36.717 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mds-2:19.0.0-815.g1db5459e.el9.x86_64 112/165 2024-01-22T10:11:36.717 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:36.717 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-22T10:11:36.717 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-22T10:11:36.717 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-22T10:11:36.717 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:37.190 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mon-2:19.0.0-815.g1db5459e.el9.x86_64 113/165 2024-01-22T10:11:37.259 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mon-2:19.0.0-815.g1db5459e.el9.x86_64 113/165 2024-01-22T10:11:37.259 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:37.259 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-22T10:11:37.259 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-22T10:11:37.260 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-22T10:11:37.260 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:37.367 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : automake-1.16.2-8.el9.noarch 114/165 2024-01-22T10:11:37.993 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:19.0.0-815.g1db5459e.el9.noarch 115/165 2024-01-22T10:11:38.034 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephadm-2:19.0.0-815.g1db5459e.el9.noarch 115/165 2024-01-22T10:11:38.078 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-815.g1db5459e.el 116/165 2024-01-22T10:11:38.174 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-815.g1db5459e.e 117/165 2024-01-22T10:11:38.205 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-815.g1db5459e.el9.noar 118/165 2024-01-22T10:11:38.521 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-815.g1db5459e.el9.noar 118/165 2024-01-22T10:11:38.565 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-815.g1db5459e.el9.no 119/165 2024-01-22T10:11:38.606 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 165/165 2024-01-22T10:11:38.606 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:38.606 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2024-01-22T10:11:38.606 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-22T10:11:38.606 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-22T10:11:38.606 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-22T10:11:38.606 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-22T10:11:38.606 INFO:teuthology.orchestra.run.smithi088.stdout: acl-2.3.1-4.el9.x86_64 2024-01-22T10:11:38.606 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-22T10:11:38.606 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout: automake-1.16.2-8.el9.noarch 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout: bison-3.7.4-5.el9.x86_64 2024-01-22T10:11:38.607 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:38.608 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: flex-2.6.4-9.el9.x86_64 2024-01-22T10:11:38.609 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: jq-1.6-16.el9.x86_64 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-22T10:11:38.610 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: lua-5.4.4-4.el9.x86_64 2024-01-22T10:11:38.611 INFO:teuthology.orchestra.run.smithi088.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-13.11-1.el9.x86_64 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-22T10:11:38.612 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-22T10:11:38.613 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-22T10:11:38.614 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply-3.11-14.el9.noarch 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-22T10:11:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-22T10:11:38.616 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-22T10:11:38.617 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.617 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.617 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:38.617 INFO:teuthology.orchestra.run.smithi088.stdout: re2-1:20211101-3.el9.x86_64 2024-01-22T10:11:38.617 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-22T10:11:38.617 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-22T10:11:38.617 INFO:teuthology.orchestra.run.smithi088.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-22T10:11:38.617 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-22T10:11:38.617 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-22T10:11:38.618 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-22T10:11:38.618 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:11:38.618 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-01-22T10:11:39.152 DEBUG:teuthology.parallel:result is None 2024-01-22T10:11:39.688 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-815.g1db5459e.el9.no 119/165 2024-01-22T10:11:39.723 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-815.g1db5 120/165 2024-01-22T10:11:39.864 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-815.g1db5 120/165 2024-01-22T10:11:40.036 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-815.g1db5459e.el9 121/165 2024-01-22T10:11:40.066 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-2:19.0.0-815.g1db5459e.el9.x86_64 122/165 2024-01-22T10:11:40.137 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-2:19.0.0-815.g1db5459e.el9.x86_64 122/165 2024-01-22T10:11:40.137 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:40.137 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-22T10:11:40.138 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-22T10:11:40.138 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-22T10:11:40.138 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:40.192 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-rook-2:19.0.0-815.g1db5459e.el9.noarch 123/165 2024-01-22T10:11:40.229 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-815.g1db5459e.el9.noarch 123/165 2024-01-22T10:11:40.333 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-2:19.0.0-815.g1db5459e.el9.x86_64 124/165 2024-01-22T10:11:41.196 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libtool-2.4.6-45.el9.x86_64 125/165 2024-01-22T10:11:41.227 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-radosgw-2:19.0.0-815.g1db5459e.el9.x86_64 126/165 2024-01-22T10:11:41.296 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-815.g1db5459e.el9.x86_64 126/165 2024-01-22T10:11:41.296 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:41.296 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-22T10:11:41.297 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-22T10:11:41.297 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-22T10:11:41.297 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:41.344 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-815.g1db545 127/165 2024-01-22T10:11:41.410 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-815.g1db545 127/165 2024-01-22T10:11:41.410 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:41.411 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-22T10:11:41.411 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:41.487 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 128/165 2024-01-22T10:11:41.561 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 128/165 2024-01-22T10:11:41.561 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:41.561 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-22T10:11:41.561 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-22T10:11:41.561 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-22T10:11:41.561 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:41.896 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 129/165 2024-01-22T10:11:41.964 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 129/165 2024-01-22T10:11:41.964 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-22T10:11:41.964 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-22T10:11:41.965 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-22T10:11:41.965 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-22T10:11:41.965 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:46.635 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-test-2:19.0.0-815.g1db5459e.el9.x86_64 130/165 2024-01-22T10:11:46.708 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 131/165 2024-01-22T10:11:46.764 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-nbd-2:19.0.0-815.g1db5459e.el9.x86_64 132/165 2024-01-22T10:11:46.800 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 133/165 2024-01-22T10:11:47.068 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 134/165 2024-01-22T10:11:47.186 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 135/165 2024-01-22T10:11:47.221 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 136/165 2024-01-22T10:11:47.254 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs-devel-2:19.0.0-815.g1db5459e.el9.x86_6 137/165 2024-01-22T10:11:47.294 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 138/165 2024-01-22T10:11:47.340 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 139/165 2024-01-22T10:11:47.492 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 140/165 2024-01-22T10:11:47.559 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 141/165 2024-01-22T10:11:47.589 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 142/165 2024-01-22T10:11:48.413 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/165 2024-01-22T10:11:48.470 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 143/165 2024-01-22T10:11:48.567 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/165 2024-01-22T10:11:48.632 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/165 2024-01-22T10:11:50.005 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-top-2:19.0.0-815.g1db5459e.el9.noarch 145/165 2024-01-22T10:11:50.368 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 146/165 2024-01-22T10:11:50.459 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 147/165 2024-01-22T10:11:50.634 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flex-2.6.4-9.el9.x86_64 148/165 2024-01-22T10:11:50.678 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : bison-3.7.4-5.el9.x86_64 149/165 2024-01-22T10:11:50.711 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 150/165 2024-01-22T10:11:50.746 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/165 2024-01-22T10:11:50.788 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 152/165 2024-01-22T10:11:50.788 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-01-22T10:11:50.944 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-01-22T10:11:50.995 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 154/165 2024-01-22T10:11:51.042 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 155/165 2024-01-22T10:11:51.075 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 156/165 2024-01-22T10:11:51.107 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 157/165 2024-01-22T10:11:51.108 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 158/165 2024-01-22T10:11:51.245 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 158/165 2024-01-22T10:11:51.283 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2024-01-22T10:11:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2024-01-22T10:11:51.320 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2024-01-22T10:11:51.658 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2024-01-22T10:11:51.658 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2024-01-22T10:11:51.801 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2024-01-22T10:11:51.837 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 162/165 2024-01-22T10:11:51.876 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 163/165 2024-01-22T10:11:51.921 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 164/165 2024-01-22T10:11:52.039 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 165/165 2024-01-22T10:11:52.292 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 165/165 2024-01-22T10:11:52.292 INFO:teuthology.orchestra.run.smithi161.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-01-22T10:11:52.293 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:56.973 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-2:19.0.0-815.g1db5459e.el9.x86_64 1/165 2024-01-22T10:11:56.973 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-base-2:19.0.0-815.g1db5459e.el9.x86_64 2/165 2024-01-22T10:11:56.973 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 3/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 4/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-815.g1db545 5/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mds-2:19.0.0-815.g1db5459e.el9.x86_64 6/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-2:19.0.0-815.g1db5459e.el9.x86_64 7/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mon-2:19.0.0-815.g1db5459e.el9.x86_64 8/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-osd-2:19.0.0-815.g1db5459e.el9.x86_64 9/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-radosgw-2:19.0.0-815.g1db5459e.el9.x86_64 10/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-selinux-2:19.0.0-815.g1db5459e.el9.x86_64 11/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-test-2:19.0.0-815.g1db5459e.el9.x86_64 12/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 13/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs-devel-2:19.0.0-815.g1db5459e.el9.x86_6 14/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs2-2:19.0.0-815.g1db5459e.el9.x86_64 15/165 2024-01-22T10:11:56.974 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephsqlite-2:19.0.0-815.g1db5459e.el9.x86_64 16/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados-devel-2:19.0.0-815.g1db5459e.el9.x86_64 17/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libradosstriper1-2:19.0.0-815.g1db5459e.el9.x86_ 18/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librgw2-2:19.0.0-815.g1db5459e.el9.x86_64 19/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-argparse-2:19.0.0-815.g1db5459e.el9 20/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-common-2:19.0.0-815.g1db5459e.el9.x 21/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cephfs-2:19.0.0-815.g1db5459e.el9.x86_64 22/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rados-2:19.0.0-815.g1db5459e.el9.x86_64 23/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rbd-2:19.0.0-815.g1db5459e.el9.x86_64 24/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rgw-2:19.0.0-815.g1db5459e.el9.x86_64 25/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 26/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 27/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-nbd-2:19.0.0-815.g1db5459e.el9.x86_64 28/165 2024-01-22T10:11:56.975 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-815.g1db5459e.e 29/165 2024-01-22T10:11:56.988 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-815.g1db5459e.el9.noar 30/165 2024-01-22T10:11:56.988 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-815.g1db5459e.el9.no 31/165 2024-01-22T10:11:56.988 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-815.g1db5 32/165 2024-01-22T10:11:56.988 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-815.g1db5459e.el9 33/165 2024-01-22T10:11:56.988 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-rook-2:19.0.0-815.g1db5459e.el9.noarch 34/165 2024-01-22T10:11:56.988 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-815.g1db5459e.el 35/165 2024-01-22T10:11:56.988 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-volume-2:19.0.0-815.g1db5459e.el9.noarch 36/165 2024-01-22T10:11:56.988 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephadm-2:19.0.0-815.g1db5459e.el9.noarch 37/165 2024-01-22T10:11:56.988 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-top-2:19.0.0-815.g1db5459e.el9.noarch 38/165 2024-01-22T10:11:56.988 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/165 2024-01-22T10:11:56.989 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/165 2024-01-22T10:11:56.989 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/165 2024-01-22T10:11:56.989 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 42/165 2024-01-22T10:11:56.989 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/165 2024-01-22T10:11:56.989 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/165 2024-01-22T10:11:56.989 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/165 2024-01-22T10:11:56.989 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/165 2024-01-22T10:11:56.989 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/165 2024-01-22T10:11:56.989 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/165 2024-01-22T10:11:56.989 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/165 2024-01-22T10:11:56.989 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/165 2024-01-22T10:11:56.989 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 52/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 53/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 54/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lua-5.4.4-4.el9.x86_64 55/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 58/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/165 2024-01-22T10:11:56.990 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/165 2024-01-22T10:11:56.991 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 81/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : jq-1.6-16.el9.x86_64 85/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 86/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 87/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 88/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 89/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 90/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ply-3.11-14.el9.noarch 91/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 92/165 2024-01-22T10:11:56.992 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 93/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 96/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 103/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 104/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/165 2024-01-22T10:11:56.993 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 110/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 111/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 112/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 113/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 115/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/165 2024-01-22T10:11:56.994 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/165 2024-01-22T10:11:56.995 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/165 2024-01-22T10:11:56.995 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/165 2024-01-22T10:11:56.995 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/165 2024-01-22T10:11:56.995 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/165 2024-01-22T10:11:56.995 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/165 2024-01-22T10:11:56.995 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/165 2024-01-22T10:11:56.995 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/165 2024-01-22T10:11:56.995 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/165 2024-01-22T10:11:56.995 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/165 2024-01-22T10:11:56.995 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/165 2024-01-22T10:11:56.995 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/165 2024-01-22T10:11:56.995 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/165 2024-01-22T10:11:56.996 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:19.0.0-815.g1db5459e.el9.x86_64 134/165 2024-01-22T10:11:56.996 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/165 2024-01-22T10:11:56.996 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:19.0.0-815.g1db5459e.el9.x86_64 136/165 2024-01-22T10:11:56.996 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/165 2024-01-22T10:11:56.996 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/165 2024-01-22T10:11:56.996 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/165 2024-01-22T10:11:56.996 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 140/165 2024-01-22T10:11:56.996 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/165 2024-01-22T10:11:56.996 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 142/165 2024-01-22T10:11:56.996 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/165 2024-01-22T10:11:56.996 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 144/165 2024-01-22T10:11:56.996 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 150/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 152/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 153/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 154/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 155/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 156/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 157/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 158/165 2024-01-22T10:11:56.997 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 159/165 2024-01-22T10:11:56.998 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 160/165 2024-01-22T10:11:56.998 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 161/165 2024-01-22T10:11:56.998 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 162/165 2024-01-22T10:11:56.998 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 163/165 2024-01-22T10:11:56.998 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 164/165 2024-01-22T10:11:59.222 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 165/165 2024-01-22T10:11:59.223 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:59.223 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2024-01-22T10:11:59.223 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-22T10:11:59.223 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-22T10:11:59.223 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-22T10:11:59.223 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-22T10:11:59.223 INFO:teuthology.orchestra.run.smithi161.stdout: acl-2.3.1-4.el9.x86_64 2024-01-22T10:11:59.223 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-22T10:11:59.223 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-22T10:11:59.223 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-22T10:11:59.224 INFO:teuthology.orchestra.run.smithi161.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-22T10:11:59.224 INFO:teuthology.orchestra.run.smithi161.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-22T10:11:59.224 INFO:teuthology.orchestra.run.smithi161.stdout: librados2-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.224 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.224 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-22T10:11:59.224 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-22T10:11:59.224 INFO:teuthology.orchestra.run.smithi161.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-22T10:11:59.224 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-22T10:11:59.224 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-01-22T10:11:59.224 INFO:teuthology.orchestra.run.smithi161.stdout: automake-1.16.2-8.el9.noarch 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: bison-3.7.4-5.el9.x86_64 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:59.225 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:59.226 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:59.226 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:59.226 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.226 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.226 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:59.226 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.226 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.226 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.226 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:59.226 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:59.226 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.226 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top-2:19.0.0-815.g1db5459e.el9.noarch 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: flex-2.6.4-9.el9.x86_64 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: jq-1.6-16.el9.x86_64 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.227 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-22T10:11:59.228 INFO:teuthology.orchestra.run.smithi161.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: lua-5.4.4-4.el9.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-13.11-1.el9.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-22T10:11:59.229 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-22T10:11:59.230 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-22T10:11:59.231 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply-3.11-14.el9.noarch 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.232 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-22T10:11:59.233 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-22T10:11:59.234 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.234 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.234 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-2:19.0.0-815.g1db5459e.el9.x86_64 2024-01-22T10:11:59.234 INFO:teuthology.orchestra.run.smithi161.stdout: re2-1:20211101-3.el9.x86_64 2024-01-22T10:11:59.234 INFO:teuthology.orchestra.run.smithi161.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-22T10:11:59.234 INFO:teuthology.orchestra.run.smithi161.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-22T10:11:59.234 INFO:teuthology.orchestra.run.smithi161.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-22T10:11:59.234 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-22T10:11:59.234 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-22T10:11:59.234 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-22T10:11:59.235 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:11:59.235 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-01-22T10:11:59.828 DEBUG:teuthology.parallel:result is None 2024-01-22T10:11:59.829 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1db5459e688287ea17e1bda532d3c81a51b40e23 2024-01-22T10:11:59.968 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-22T10:11:59.994 INFO:teuthology.orchestra.run.smithi088.stdout:19.0.0-815.g1db5459e.el9 2024-01-22T10:11:59.994 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-815.g1db5459e.el9 2024-01-22T10:11:59.994 INFO:teuthology.task.install:The correct ceph version 19.0.0-815.g1db5459e is installed. 2024-01-22T10:11:59.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1db5459e688287ea17e1bda532d3c81a51b40e23 2024-01-22T10:12:00.134 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-22T10:12:00.160 INFO:teuthology.orchestra.run.smithi119.stdout:19.0.0-815.g1db5459e.el9 2024-01-22T10:12:00.160 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-815.g1db5459e.el9 2024-01-22T10:12:00.160 INFO:teuthology.task.install:The correct ceph version 19.0.0-815.g1db5459e is installed. 2024-01-22T10:12:00.162 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1db5459e688287ea17e1bda532d3c81a51b40e23 2024-01-22T10:12:00.373 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-22T10:12:00.433 INFO:teuthology.orchestra.run.smithi161.stdout:19.0.0-815.g1db5459e.el9 2024-01-22T10:12:00.433 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-815.g1db5459e.el9 2024-01-22T10:12:00.433 INFO:teuthology.task.install:The correct ceph version 19.0.0-815.g1db5459e is installed. 2024-01-22T10:12:00.435 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-22T10:12:00.435 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:00.436 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-22T10:12:00.471 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:00.471 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-22T10:12:00.505 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:12:00.506 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-22T10:12:00.582 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-22T10:12:00.583 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:00.583 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2024-01-22T10:12:00.614 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-22T10:12:00.683 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:00.684 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-01-22T10:12:00.715 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-22T10:12:00.786 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:12:00.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2024-01-22T10:12:00.865 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-22T10:12:00.977 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-22T10:12:00.978 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:00.978 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-22T10:12:01.006 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-22T10:12:01.074 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:01.074 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-22T10:12:01.101 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-22T10:12:01.169 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:12:01.170 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-22T10:12:01.261 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-22T10:12:01.376 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-22T10:12:01.376 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:01.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2024-01-22T10:12:01.403 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-22T10:12:01.470 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:01.470 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-01-22T10:12:01.497 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-22T10:12:01.564 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:12:01.564 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2024-01-22T10:12:01.651 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-22T10:12:01.724 INFO:teuthology.run_tasks:Running task ceph... 2024-01-22T10:12:01.815 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-22T10:12:01.816 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2024-01-22T10:12:01.818 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2024-01-22T10:12:01.820 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2024-01-22T10:12:01.894 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-22T10:12:01.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-22T10:12:01.896 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-22T10:12:01.898 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-22T10:12:01.968 INFO:tasks.ceph:Creating extra log directories... 2024-01-22T10:12:01.968 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-22T10:12:01.971 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-22T10:12:01.973 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-22T10:12:02.055 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-22T10:12:02.055 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-22T10:12:02.055 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-22T10:12:02.055 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:02.055 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-22T10:12:02.070 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-22T10:12:02.186 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-22T10:12:02.212 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:02.212 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-22T10:12:02.226 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-22T10:12:02.345 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-22T10:12:02.371 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:12:02.372 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-22T10:12:02.413 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-22T10:12:02.617 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-22T10:12:02.689 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-22T10:12:02.689 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-22T10:12:02.689 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821', 'branch': 'wip-vshankar-testing-20240119.075157-1', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-common}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7525821', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '06652275eb934672217aaf9d4180f4a90395eb16'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240119.075157-1'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1db5459e688287ea17e1bda532d3c81a51b40e23'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1db5459e688287ea17e1bda532d3c81a51b40e23'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240119.075157-1', 'sha1': '1db5459e688287ea17e1bda532d3c81a51b40e23'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 2348, 'sha1': '1db5459e688287ea17e1bda532d3c81a51b40e23', 'sleep_before_teardown': 0, 'subset': '48/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240119.075157-1', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1db5459e688287ea17e1bda532d3c81a51b40e23/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1db5459e688287ea17e1bda532d3c81a51b40e23', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGm5qBD0MFmF8O4lnKGEV6qA0sCe4oCTIPKXrZ7F3jhJe9dA72pdz5ZT53WhJ1X0wob/kQHl6oFQiBqWYfH3pjo=', 'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCY0m/WpUHgCVnUUbvaYPkk/w+THGvIi/cNKNAZvjymIqqgQLUoISRXPsIPcRbLekfvBUKvLgs+lfl6KCwQLxYs=', 'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC2rvdlHQbUj1hPmC8FBgSykvYQbw/1D74T2kAubvxkL9ZH4gsqn9nigCpVq58EdCyzuMuTCTLyMYsbSWK3olCE='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '06652275eb934672217aaf9d4180f4a90395eb16'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1db5459e688287ea17e1bda532d3c81a51b40e23'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1db5459e688287ea17e1bda532d3c81a51b40e23', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-22_07:03:31', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-22T10:12:02.690 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-22T10:12:02.692 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-22T10:12:02.694 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-22T10:12:02.731 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2024-01-22T10:12:02.747 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2024-01-22T10:12:02.749 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2024-01-22T10:12:02.841 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:02.841 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2024-01-22T10:12:02.857 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-22T10:12:02.857 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2024-01-22T10:12:02.912 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-22T10:12:02.912 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T10:12:02.912 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 661 Links: 1 2024-01-22T10:12:02.912 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T10:12:02.913 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T10:12:02.913 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-01-22 10:11:31.581166468 +0000 2024-01-22T10:12:02.913 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-01-22 10:08:22.695344890 +0000 2024-01-22T10:12:02.913 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-01-22 10:08:22.695344890 +0000 2024-01-22T10:12:02.913 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-01-22 10:08:22.695344890 +0000 2024-01-22T10:12:02.913 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-22T10:12:02.978 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-01-22T10:12:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-01-22T10:12:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000183015 s, 2.8 MB/s 2024-01-22T10:12:02.980 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-22T10:12:03.035 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2024-01-22T10:12:03.090 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-22T10:12:03.090 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T10:12:03.090 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 680 Links: 1 2024-01-22T10:12:03.091 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T10:12:03.091 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T10:12:03.091 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-01-22 10:11:31.581166468 +0000 2024-01-22T10:12:03.091 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-01-22 10:08:23.047337414 +0000 2024-01-22T10:12:03.091 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-01-22 10:08:23.047337414 +0000 2024-01-22T10:12:03.091 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-01-22 10:08:23.047337414 +0000 2024-01-22T10:12:03.091 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-22T10:12:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-01-22T10:12:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-01-22T10:12:03.156 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000208205 s, 2.5 MB/s 2024-01-22T10:12:03.157 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-22T10:12:03.213 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2024-01-22T10:12:03.268 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-22T10:12:03.268 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T10:12:03.268 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-01-22T10:12:03.268 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T10:12:03.268 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T10:12:03.268 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-01-22 10:11:31.582166447 +0000 2024-01-22T10:12:03.269 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-01-22 10:08:23.383330277 +0000 2024-01-22T10:12:03.269 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-01-22 10:08:23.383330277 +0000 2024-01-22T10:12:03.269 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-01-22 10:08:23.383330277 +0000 2024-01-22T10:12:03.269 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-22T10:12:03.333 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-01-22T10:12:03.334 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-01-22T10:12:03.334 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000177452 s, 2.9 MB/s 2024-01-22T10:12:03.335 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-22T10:12:03.390 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2024-01-22T10:12:03.444 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-22T10:12:03.444 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T10:12:03.444 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-01-22T10:12:03.444 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T10:12:03.444 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T10:12:03.444 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-01-22 10:11:31.582166447 +0000 2024-01-22T10:12:03.444 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-01-22 10:08:23.730322906 +0000 2024-01-22T10:12:03.444 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-01-22 10:08:23.730322906 +0000 2024-01-22T10:12:03.445 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-01-22 10:08:23.730322906 +0000 2024-01-22T10:12:03.445 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-22T10:12:03.509 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-01-22T10:12:03.509 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-01-22T10:12:03.510 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000196309 s, 2.6 MB/s 2024-01-22T10:12:03.511 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-22T10:12:03.566 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T10:12:03.566 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:03.566 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-01-22T10:12:03.586 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-22T10:12:03.586 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-01-22T10:12:03.644 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-22T10:12:03.645 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T10:12:03.645 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 662 Links: 1 2024-01-22T10:12:03.645 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T10:12:03.645 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T10:12:03.645 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-01-22 10:11:27.018574737 +0000 2024-01-22T10:12:03.645 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-01-22 10:08:22.706945635 +0000 2024-01-22T10:12:03.645 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-01-22 10:08:22.706945635 +0000 2024-01-22T10:12:03.646 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-01-22 10:08:22.706945635 +0000 2024-01-22T10:12:03.646 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-22T10:12:03.713 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-01-22T10:12:03.713 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-01-22T10:12:03.713 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000216431 s, 2.4 MB/s 2024-01-22T10:12:03.714 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-22T10:12:03.773 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-01-22T10:12:03.831 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-22T10:12:03.832 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T10:12:03.832 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 680 Links: 1 2024-01-22T10:12:03.832 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T10:12:03.832 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T10:12:03.832 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-01-22 10:11:27.018574737 +0000 2024-01-22T10:12:03.832 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-01-22 10:08:23.067936489 +0000 2024-01-22T10:12:03.832 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-01-22 10:08:23.067936489 +0000 2024-01-22T10:12:03.832 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-01-22 10:08:23.067936489 +0000 2024-01-22T10:12:03.832 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-22T10:12:03.901 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-01-22T10:12:03.901 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-01-22T10:12:03.901 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000201434 s, 2.5 MB/s 2024-01-22T10:12:03.902 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-22T10:12:03.961 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-01-22T10:12:04.018 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-22T10:12:04.018 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T10:12:04.018 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-01-22T10:12:04.018 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T10:12:04.018 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T10:12:04.019 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-01-22 10:11:27.018574737 +0000 2024-01-22T10:12:04.019 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-01-22 10:08:23.399928078 +0000 2024-01-22T10:12:04.019 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-01-22 10:08:23.399928078 +0000 2024-01-22T10:12:04.019 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-01-22 10:08:23.399928078 +0000 2024-01-22T10:12:04.019 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-22T10:12:04.087 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-01-22T10:12:04.087 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-01-22T10:12:04.087 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000270504 s, 1.9 MB/s 2024-01-22T10:12:04.089 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-22T10:12:04.146 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-01-22T10:12:04.203 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-22T10:12:04.203 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-22T10:12:04.203 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-01-22T10:12:04.203 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-22T10:12:04.203 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-01-22T10:12:04.203 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-01-22 10:11:27.019574712 +0000 2024-01-22T10:12:04.203 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-01-22 10:08:23.739919464 +0000 2024-01-22T10:12:04.203 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-01-22 10:08:23.739919464 +0000 2024-01-22T10:12:04.203 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-01-22 10:08:23.739919464 +0000 2024-01-22T10:12:04.204 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-22T10:12:04.270 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-01-22T10:12:04.270 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-01-22T10:12:04.270 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000204629 s, 2.5 MB/s 2024-01-22T10:12:04.271 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-22T10:12:04.328 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T10:12:04.328 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-22T10:12:04.329 INFO:tasks.ceph:Generating config... 2024-01-22T10:12:04.330 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-22T10:12:04.330 INFO:tasks.ceph:[client] debug client = 20 2024-01-22T10:12:04.330 INFO:tasks.ceph:[client] debug ms = 1 2024-01-22T10:12:04.330 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-22T10:12:04.330 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-22T10:12:04.330 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-01-22T10:12:04.330 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-01-22T10:12:04.330 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-22T10:12:04.330 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-22T10:12:04.330 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-22T10:12:04.330 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-22T10:12:04.331 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-22T10:12:04.331 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-22T10:12:04.331 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-22T10:12:04.331 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-22T10:12:04.331 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-22T10:12:04.331 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-22T10:12:04.331 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-22T10:12:04.331 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-22T10:12:04.331 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-22T10:12:04.331 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-22T10:12:04.331 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-22T10:12:04.331 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-22T10:12:04.331 INFO:tasks.ceph:[osd] bdev async discard = True 2024-01-22T10:12:04.331 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-01-22T10:12:04.331 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-22T10:12:04.332 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-22T10:12:04.333 INFO:tasks.ceph:Setting up mon.a... 2024-01-22T10:12:04.333 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-22T10:12:04.394 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2024-01-22T10:12:04.396 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-22T10:12:04.442 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-22T10:12:04.469 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.b', '172.21.15.119'), ('mon.c', '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]')] 2024-01-22T10:12:04.470 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.88,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-22T10:12:04.471 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:04.471 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-22T10:12:04.524 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.88 --add b 172.21.15.119 --addv c '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:04.610 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:04.610 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid f2d9b200-f96e-479f-bf7c-16080c3af8a6 2024-01-22T10:12:04.610 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = quincy 2024-01-22T10:12:04.610 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2024-01-22T10:12:04.611 INFO:teuthology.orchestra.run.smithi088.stdout:fsid f2d9b200-f96e-479f-bf7c-16080c3af8a6 2024-01-22T10:12:04.611 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2024-01-22T10:12:04.628721+0000 2024-01-22T10:12:04.611 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-01-22T10:12:04.628721+0000 2024-01-22T10:12:04.611 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 17 (quincy) 2024-01-22T10:12:04.611 INFO:teuthology.orchestra.run.smithi088.stdout:election_strategy: 1 2024-01-22T10:12:04.611 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-01-22T10:12:04.611 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-01-22T10:12:04.611 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-01-22T10:12:04.611 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-22T10:12:04.612 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-22T10:12:04.627 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f2d9b200-f96e-479f-bf7c-16080c3af8a6... 2024-01-22T10:12:04.628 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T10:12:04.670 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T10:12:04.672 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-22T10:12:04.717 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2024-01-22T10:12:04.717 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2024-01-22T10:12:04.717 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T10:12:04.718 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2024-01-22T10:12:04.719 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2024-01-22T10:12:04.720 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn min per osd = 0 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on skipped message = False 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = f2d9b200-f96e-479f-bf7c-16080c3af8a6 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.721 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug trim objects = true 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2024-01-22T10:12:04.722 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2024-01-22T10:12:04.723 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.723 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2024-01-22T10:12:04.723 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2024-01-22T10:12:04.723 INFO:teuthology.orchestra.run.smithi088.stdout: bdev async discard = True 2024-01-22T10:12:04.723 INFO:teuthology.orchestra.run.smithi088.stdout: bdev enable discard = True 2024-01-22T10:12:04.723 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore allocator = bitmap 2024-01-22T10:12:04.723 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2024-01-22T10:12:04.723 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2024-01-22T10:12:04.723 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 1/20 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 20 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 4/10 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-01-22T10:12:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2024-01-22T10:12:04.725 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2024-01-22T10:12:04.726 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.727 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2024-01-22T10:12:04.727 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2024-01-22T10:12:04.727 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:04.727 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2024-01-22T10:12:04.727 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2024-01-22T10:12:04.727 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2024-01-22T10:12:04.727 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2024-01-22T10:12:04.727 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T10:12:04.727 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T10:12:04.727 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2024-01-22T10:12:04.727 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2024-01-22T10:12:04.727 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-01-22T10:12:04.728 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2024-01-22T10:12:04.728 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2024-01-22T10:12:04.728 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2024-01-22T10:12:04.728 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2024-01-22T10:12:04.728 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2024-01-22T10:12:04.728 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-01-22T10:12:04.728 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2024-01-22T10:12:04.728 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2024-01-22T10:12:04.728 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2024-01-22T10:12:04.728 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2024-01-22T10:12:04.728 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds balancer = 20 2024-01-22T10:12:04.728 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-01-22T10:12:04.729 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2024-01-22T10:12:04.729 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2024-01-22T10:12:04.729 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2024-01-22T10:12:04.729 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2024-01-22T10:12:04.729 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2024-01-22T10:12:04.729 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2024-01-22T10:12:04.729 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2024-01-22T10:12:04.729 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2024-01-22T10:12:04.729 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2024-01-22T10:12:04.730 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2024-01-22T10:12:04.731 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2024-01-22T10:12:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.88,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn min per osd = 0 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on skipped message = False 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = f2d9b200-f96e-479f-bf7c-16080c3af8a6 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2024-01-22T10:12:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2024-01-22T10:12:04.734 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.734 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2024-01-22T10:12:04.734 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2024-01-22T10:12:04.734 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2024-01-22T10:12:04.734 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug trim objects = true 2024-01-22T10:12:04.734 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.734 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2024-01-22T10:12:04.734 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2024-01-22T10:12:04.734 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.734 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2024-01-22T10:12:04.734 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2024-01-22T10:12:04.735 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 20 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-01-22T10:12:04.736 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2024-01-22T10:12:04.737 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-01-22T10:12:04.738 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2024-01-22T10:12:04.738 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2024-01-22T10:12:04.738 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-01-22T10:12:04.738 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.738 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T10:12:04.738 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T10:12:04.738 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T10:12:04.738 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2024-01-22T10:12:04.739 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2024-01-22T10:12:04.740 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2024-01-22T10:12:04.741 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2024-01-22T10:12:04.741 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2024-01-22T10:12:04.741 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-01-22T10:12:04.741 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2024-01-22T10:12:04.741 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2024-01-22T10:12:04.741 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2024-01-22T10:12:04.741 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2024-01-22T10:12:04.741 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2024-01-22T10:12:04.741 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2024-01-22T10:12:04.741 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2024-01-22T10:12:04.831 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2024-01-22T10:12:04.832 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2024-01-22T10:12:04.832 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-22T10:12:04.832 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2024-01-22T10:12:04.832 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.832 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2024-01-22T10:12:04.832 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.833 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2024-01-22T10:12:04.833 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.833 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2024-01-22T10:12:04.833 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2024-01-22T10:12:04.833 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.833 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2024-01-22T10:12:04.834 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2024-01-22T10:12:04.834 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.834 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-22T10:12:04.834 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2024-01-22T10:12:04.834 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.834 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2024-01-22T10:12:04.834 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2024-01-22T10:12:04.835 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.88,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn min per osd = 0 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on skipped message = False 2024-01-22T10:12:04.836 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = f2d9b200-f96e-479f-bf7c-16080c3af8a6 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2024-01-22T10:12:04.837 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug trim objects = true 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2024-01-22T10:12:04.838 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.839 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2024-01-22T10:12:04.839 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2024-01-22T10:12:04.839 INFO:teuthology.orchestra.run.smithi161.stdout: bdev async discard = True 2024-01-22T10:12:04.839 INFO:teuthology.orchestra.run.smithi161.stdout: bdev enable discard = True 2024-01-22T10:12:04.839 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore allocator = bitmap 2024-01-22T10:12:04.839 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2024-01-22T10:12:04.839 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2024-01-22T10:12:04.839 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2024-01-22T10:12:04.839 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 20 2024-01-22T10:12:04.839 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-01-22T10:12:04.839 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2024-01-22T10:12:04.839 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-01-22T10:12:04.840 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2024-01-22T10:12:04.841 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-01-22T10:12:04.842 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.842 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-22T10:12:04.842 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2024-01-22T10:12:04.842 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2024-01-22T10:12:04.842 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.842 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2024-01-22T10:12:04.842 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-22T10:12:04.842 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-22T10:12:04.842 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.842 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2024-01-22T10:12:04.842 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2024-01-22T10:12:04.842 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2024-01-22T10:12:04.843 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2024-01-22T10:12:04.844 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2024-01-22T10:12:04.844 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2024-01-22T10:12:04.844 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2024-01-22T10:12:04.844 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2024-01-22T10:12:04.844 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2024-01-22T10:12:04.844 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2024-01-22T10:12:04.844 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2024-01-22T10:12:04.844 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2024-01-22T10:12:04.845 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds balancer = 20 2024-01-22T10:12:04.845 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-01-22T10:12:04.845 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2024-01-22T10:12:04.845 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2024-01-22T10:12:04.845 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2024-01-22T10:12:04.845 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2024-01-22T10:12:04.845 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2024-01-22T10:12:04.845 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2024-01-22T10:12:04.845 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2024-01-22T10:12:04.877 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-22T10:12:04.878 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-22T10:12:04.933 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-22T10:12:04.933 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:04.933 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-22T10:12:04.948 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:04.948 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-22T10:12:05.002 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2024-01-22T10:12:05.002 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:05.002 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-22T10:12:05.002 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-22T10:12:05.081 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:05.081 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:05.135 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2024-01-22T10:12:05.135 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:05.136 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-22T10:12:05.136 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-22T10:12:05.180 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:05.180 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:05.236 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2024-01-22T10:12:05.236 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:12:05.236 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-22T10:12:05.236 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-22T10:12:05.375 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:12:05.375 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:05.465 INFO:tasks.ceph:Setting up mon nodes... 2024-01-22T10:12:05.465 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-22T10:12:05.465 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-22T10:12:05.521 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-22T10:12:05.524 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-22T10:12:05.595 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-22T10:12:05.598 INFO:tasks.ceph:Setting up mds nodes... 2024-01-22T10:12:05.599 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-22T10:12:05.654 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-22T10:12:05.657 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-22T10:12:05.683 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-22T10:12:05.778 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-22T10:12:05.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-22T10:12:05.807 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-22T10:12:05.865 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-22T10:12:05.868 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-22T10:12:05.895 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-22T10:12:05.895 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-22T10:12:06.018 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-22T10:12:06.069 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-22T10:12:06.069 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-22T10:12:06.069 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-22T10:12:06.096 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T10:12:06.097 INFO:tasks.ceph:role: osd.0 2024-01-22T10:12:06.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2024-01-22T10:12:06.097 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-22T10:12:06.171 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T10:12:06.171 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T10:12:06.171 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T10:12:06.171 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-22T10:12:06.171 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T10:12:06.171 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-01-22T10:12:06.171 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T10:12:06.171 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-22T10:12:06.171 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T10:12:06.171 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T10:12:06.674 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-01-22T10:12:06.676 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-01-22T10:12:06.676 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-22T10:12:06.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-22T10:12:06.812 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-22T10:12:06.879 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T10:12:06.879 INFO:tasks.ceph:role: osd.1 2024-01-22T10:12:06.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2024-01-22T10:12:06.879 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-22T10:12:06.957 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T10:12:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T10:12:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T10:12:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-22T10:12:06.957 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T10:12:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-01-22T10:12:06.957 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T10:12:06.957 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-22T10:12:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T10:12:06.957 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T10:12:07.416 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-01-22T10:12:07.419 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-01-22T10:12:07.419 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-22T10:12:07.510 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-22T10:12:07.542 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-22T10:12:07.609 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T10:12:07.609 INFO:tasks.ceph:role: osd.2 2024-01-22T10:12:07.609 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2024-01-22T10:12:07.609 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-22T10:12:07.683 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T10:12:07.683 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T10:12:07.683 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T10:12:07.684 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-22T10:12:07.684 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T10:12:07.684 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-01-22T10:12:07.684 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T10:12:07.684 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-22T10:12:07.684 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T10:12:07.684 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T10:12:08.161 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-01-22T10:12:08.163 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-01-22T10:12:08.164 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-22T10:12:08.286 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-22T10:12:08.322 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-22T10:12:08.392 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-22T10:12:08.392 INFO:tasks.ceph:role: osd.3 2024-01-22T10:12:08.392 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2024-01-22T10:12:08.393 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-22T10:12:08.469 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T10:12:08.469 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T10:12:08.469 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T10:12:08.469 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-22T10:12:08.469 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T10:12:08.469 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-01-22T10:12:08.469 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T10:12:08.470 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-22T10:12:08.470 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T10:12:08.470 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T10:12:08.987 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-01-22T10:12:08.989 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-01-22T10:12:08.989 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-22T10:12:09.119 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-22T10:12:09.153 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:09.262+0000 7f1e26391640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-22T10:12:09.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:09.263+0000 7f1e26391640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-22T10:12:09.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:09.263+0000 7f1e26391640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-22T10:12:09.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:09.263+0000 7f1e26391640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-22T10:12:09.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:09.263+0000 7f1e26391640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-22T10:12:09.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:09.263+0000 7f1e26391640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-22T10:12:12.101 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-22T10:12:12.129 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:12.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:12.234+0000 7f975c80d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-22T10:12:12.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:12.234+0000 7f975c80d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-22T10:12:12.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:12.234+0000 7f975c80d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-22T10:12:12.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:12.234+0000 7f975c80d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-22T10:12:12.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:12.234+0000 7f975c80d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-22T10:12:12.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:12.234+0000 7f975c80d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-22T10:12:15.063 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-22T10:12:15.093 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:15.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:15.201+0000 7fe71a00c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-22T10:12:15.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:15.201+0000 7fe71a00c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-22T10:12:15.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:15.201+0000 7fe71a00c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-22T10:12:15.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:15.201+0000 7fe71a00c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-22T10:12:15.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:15.201+0000 7fe71a00c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-22T10:12:15.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:15.202+0000 7fe71a00c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-22T10:12:18.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-22T10:12:18.066 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:18.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:18.174+0000 7f2594106640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-22T10:12:18.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:18.174+0000 7f2594106640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-22T10:12:18.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:18.174+0000 7f2594106640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-22T10:12:18.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:18.174+0000 7f2594106640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-22T10:12:18.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:18.174+0000 7f2594106640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-22T10:12:18.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:18.175+0000 7f2594106640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-22T10:12:21.015 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-22T10:12:21.046 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-22T10:12:21.078 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T10:12:21.078 INFO:tasks.ceph:role: osd.4 2024-01-22T10:12:21.078 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2024-01-22T10:12:21.078 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-22T10:12:21.155 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T10:12:21.155 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T10:12:21.155 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T10:12:21.155 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-22T10:12:21.155 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T10:12:21.155 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-01-22T10:12:21.155 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T10:12:21.156 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-22T10:12:21.156 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T10:12:21.156 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T10:12:21.666 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-01-22T10:12:21.668 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-01-22T10:12:21.669 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-22T10:12:21.797 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-22T10:12:21.833 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-22T10:12:21.902 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T10:12:21.903 INFO:tasks.ceph:role: osd.5 2024-01-22T10:12:21.903 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2024-01-22T10:12:21.903 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-22T10:12:21.978 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T10:12:21.979 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T10:12:21.979 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T10:12:21.979 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-22T10:12:21.979 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T10:12:21.979 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-01-22T10:12:21.979 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T10:12:21.979 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-22T10:12:21.979 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T10:12:21.979 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T10:12:22.430 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-01-22T10:12:22.433 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-01-22T10:12:22.433 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-22T10:12:22.528 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-22T10:12:22.562 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-22T10:12:22.630 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T10:12:22.631 INFO:tasks.ceph:role: osd.6 2024-01-22T10:12:22.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2024-01-22T10:12:22.631 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-22T10:12:22.706 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T10:12:22.707 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T10:12:22.707 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T10:12:22.707 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-22T10:12:22.707 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T10:12:22.707 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-01-22T10:12:22.707 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T10:12:22.707 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-22T10:12:22.707 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T10:12:22.707 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T10:12:23.197 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-01-22T10:12:23.199 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-01-22T10:12:23.199 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-22T10:12:23.345 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-22T10:12:23.380 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-22T10:12:23.449 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-22T10:12:23.449 INFO:tasks.ceph:role: osd.7 2024-01-22T10:12:23.450 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2024-01-22T10:12:23.450 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-22T10:12:23.525 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-22T10:12:23.525 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-22T10:12:23.525 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-22T10:12:23.526 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-22T10:12:23.526 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-22T10:12:23.526 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-01-22T10:12:23.526 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-22T10:12:23.526 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-22T10:12:23.526 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-22T10:12:23.526 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-22T10:12:24.025 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-01-22T10:12:24.027 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-01-22T10:12:24.027 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-22T10:12:24.172 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-22T10:12:24.209 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:24.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:24.321+0000 7f4ab1716640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-22T10:12:24.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:24.323+0000 7f4ab1716640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-22T10:12:24.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:24.323+0000 7f4ab1716640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-22T10:12:24.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:24.323+0000 7f4ab1716640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-22T10:12:24.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:24.323+0000 7f4ab1716640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-22T10:12:24.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:24.323+0000 7f4ab1716640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-22T10:12:27.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-22T10:12:27.188 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:27.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:27.298+0000 7ff1a14aa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-22T10:12:27.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:27.298+0000 7ff1a14aa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-22T10:12:27.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:27.298+0000 7ff1a14aa640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-22T10:12:27.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:27.298+0000 7ff1a14aa640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-22T10:12:27.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:27.298+0000 7ff1a14aa640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-22T10:12:27.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:27.299+0000 7ff1a14aa640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-22T10:12:30.129 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-22T10:12:30.160 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:30.271+0000 7f09c440b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-22T10:12:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:30.272+0000 7f09c440b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-22T10:12:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:30.272+0000 7f09c440b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-22T10:12:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:30.272+0000 7f09c440b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-22T10:12:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:30.272+0000 7f09c440b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-22T10:12:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:30.272+0000 7f09c440b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-22T10:12:32.691 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:12:32.694 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:12:32.697 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:12:33.107 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-22T10:12:33.140 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:33.249+0000 7fe4848f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-22T10:12:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:33.250+0000 7fe4848f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-22T10:12:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:33.250+0000 7fe4848f9640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-22T10:12:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:33.250+0000 7fe4848f9640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-22T10:12:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:33.250+0000 7fe4848f9640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-22T10:12:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:33.250+0000 7fe4848f9640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-22T10:12:36.086 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-22T10:12:36.117 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-22T10:12:36.117 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:36.118 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-22T10:12:36.150 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:36.150 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-22T10:12:36.220 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:36.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-22T10:12:36.289 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:36.290 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-22T10:12:36.358 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:36.358 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-22T10:12:36.426 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:36.426 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-22T10:12:36.493 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:36.494 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-22T10:12:36.561 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:36.561 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-22T10:12:36.592 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:36.593 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-22T10:12:36.662 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:36.662 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-22T10:12:36.731 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:36.732 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-22T10:12:36.800 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:36.800 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-22T10:12:36.867 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:36.867 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-22T10:12:36.935 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:12:36.935 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-22T10:12:36.993 INFO:tasks.ceph:Adding keys to all mons... 2024-01-22T10:12:36.993 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-22T10:12:36.996 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-22T10:12:37.019 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2024-01-22T10:12:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB1P65lTuEpIBAA0+8EP5AFhERJ6vGeRXFO9A== 2024-01-22T10:12:37.020 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-01-22T10:12:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB1P65lhbsgKBAA+XblNIh/8H8CcCb6d98Szw== 2024-01-22T10:12:37.020 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2024-01-22T10:12:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB1P65lnWJ8LxAAzAtJrfczAuNOeIRoUNpvgg== 2024-01-22T10:12:37.020 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2024-01-22T10:12:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB5P65lGt67DxAADPFZ9WlQ5J8mbh1YMES4og== 2024-01-22T10:12:37.020 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2024-01-22T10:12:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB8P65lhMMEDhAA3QhaJn54hRk2Kf2ChBrwug== 2024-01-22T10:12:37.020 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2024-01-22T10:12:37.020 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB/P65lJloTDBAAJ6lBJHyV5/VQ1K8h6JTewA== 2024-01-22T10:12:37.020 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCCP65lbRV0ChAA8A+7/NrwgivWWcXJGTqm7g== 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB1P65lQeGVJBAAGrgMkgHxH6K49SO/T+4R7g== 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB1P65l2GatNBAAqZOQy739gefVCT0MdXsMtA== 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCIP65l/4svExAAxgIbclvj2hV0LZlRlz0LMg== 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCLP65lZZjOERAAw5r2VKLcaSlMhOPVRnoB2g== 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCOP65lO8M3EBAA3oDlaka1AKbdJ2KtIIFqaw== 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCRP65l1bT1DhAAlneZ8iUqnPWXYsk+yDKWTw== 2024-01-22T10:12:37.021 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2024-01-22T10:12:37.022 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB2P65lTw4wAhAAHkWEm0pUd5uSTZi+mnQAVQ== 2024-01-22T10:12:37.023 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2024-01-22T10:12:37.023 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQB1P65lTuEpIBAA0+8EP5AFhERJ6vGeRXFO9A== 2024-01-22T10:12:37.023 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2024-01-22T10:12:37.023 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQB1P65lhbsgKBAA+XblNIh/8H8CcCb6d98Szw== 2024-01-22T10:12:37.023 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2024-01-22T10:12:37.023 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQB1P65lnWJ8LxAAzAtJrfczAuNOeIRoUNpvgg== 2024-01-22T10:12:37.023 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2024-01-22T10:12:37.023 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQB5P65lGt67DxAADPFZ9WlQ5J8mbh1YMES4og== 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQB8P65lhMMEDhAA3QhaJn54hRk2Kf2ChBrwug== 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQB/P65lJloTDBAAJ6lBJHyV5/VQ1K8h6JTewA== 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQCCP65lbRV0ChAA8A+7/NrwgivWWcXJGTqm7g== 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQB1P65lQeGVJBAAGrgMkgHxH6K49SO/T+4R7g== 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQB1P65l2GatNBAAqZOQy739gefVCT0MdXsMtA== 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQCIP65l/4svExAAxgIbclvj2hV0LZlRlz0LMg== 2024-01-22T10:12:37.024 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2024-01-22T10:12:37.025 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQCLP65lZZjOERAAw5r2VKLcaSlMhOPVRnoB2g== 2024-01-22T10:12:37.025 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2024-01-22T10:12:37.025 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQCOP65lO8M3EBAA3oDlaka1AKbdJ2KtIIFqaw== 2024-01-22T10:12:37.025 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2024-01-22T10:12:37.025 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQCRP65l1bT1DhAAlneZ8iUqnPWXYsk+yDKWTw== 2024-01-22T10:12:37.025 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2024-01-22T10:12:37.025 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQB2P65lTw4wAhAAHkWEm0pUd5uSTZi+mnQAVQ== 2024-01-22T10:12:37.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-22T10:12:37.066 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-22T10:12:37.119 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T10:12:37.121 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T10:12:37.176 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T10:12:37.178 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T10:12:37.234 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.236 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.287 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.290 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.341 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.344 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.395 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.397 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.449 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-22T10:12:37.451 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-22T10:12:37.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T10:12:37.504 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-22T10:12:37.558 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.561 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.612 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.614 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.665 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.667 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.719 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.721 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-22T10:12:37.772 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T10:12:37.774 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-22T10:12:37.828 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-22T10:12:37.828 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-22T10:12:37.855 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-22T10:12:37.950 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-22T10:12:37.977 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-22T10:12:38.003 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-22T10:12:38.100 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-22T10:12:38.127 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-22T10:12:38.194 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-22T10:12:38.289 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-22T10:12:38.316 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:38.318 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-22T10:12:38.370 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-22T10:12:38.371 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-22T10:12:38.371 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-22T10:12:38.373 INFO:tasks.ceph.mon.a:Started 2024-01-22T10:12:38.373 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-22T10:12:38.373 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-22T10:12:38.413 INFO:tasks.ceph.mon.b:Started 2024-01-22T10:12:38.413 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-22T10:12:38.413 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-22T10:12:38.415 INFO:tasks.ceph.mon.c:Started 2024-01-22T10:12:38.415 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-22T10:12:38.415 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-22T10:12:38.415 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-22T10:12:38.417 INFO:tasks.ceph.mgr.y:Started 2024-01-22T10:12:38.417 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-22T10:12:38.418 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-22T10:12:38.420 INFO:tasks.ceph.mgr.x:Started 2024-01-22T10:12:38.420 INFO:tasks.ceph:Setting crush tunables to default 2024-01-22T10:12:38.420 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2024-01-22T10:12:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.537+0000 7f70acf3c640 1 Processor -- start 2024-01-22T10:12:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.537+0000 7f70acf3c640 1 -- start start 2024-01-22T10:12:38.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.538+0000 7f70acf3c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70a80b9b00 0x7f70a80b9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.538+0000 7f70acf3c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a80b5810 con 0x7f70a80bb5a0 2024-01-22T10:12:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.538+0000 7f70acf3c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a80bad10 con 0x7f70a806b800 2024-01-22T10:12:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.538+0000 7f70acf3c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a806c7f0 con 0x7f70a80b9b00 2024-01-22T10:12:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.538+0000 7f70a659c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f70a80bb5a0 0x7f70a806d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35428/0 (socket says 172.21.15.88:35428) 2024-01-22T10:12:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.538+0000 7f70a659c640 1 -- 172.21.15.88:0/3041203132 learned_addr learned my addr 172.21.15.88:0/3041203132 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:12:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.539+0000 7f70a6d9d640 1 --2- 172.21.15.88:0/3041203132 >> v2:172.21.15.119:3300/0 conn(0x7f70a80b9b00 0x7f70a80b9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.539+0000 7f70a6d9d640 1 -- 172.21.15.88:0/3041203132 >> v2:172.21.15.119:3300/0 conn(0x7f70a80b9b00 msgr2=0x7f70a80b9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-22T10:12:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.539+0000 7f70a6d9d640 1 -- 172.21.15.88:0/3041203132 >> v2:172.21.15.119:3300/0 conn(0x7f70a80b9b00 msgr2=0x7f70a80b9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-22T10:12:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.539+0000 7f70a6d9d640 1 --2- 172.21.15.88:0/3041203132 >> v2:172.21.15.119:3300/0 conn(0x7f70a80b9b00 0x7f70a80b9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-22T10:12:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.539+0000 7f70a6d9d640 1 --2- 172.21.15.88:0/3041203132 >> v2:172.21.15.119:3300/0 conn(0x7f70a80b9b00 0x7f70a80b9f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-22T10:12:38.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.740+0000 7f70a6d9d640 1 --2- 172.21.15.88:0/3041203132 >> v2:172.21.15.119:3300/0 conn(0x7f70a80b9b00 0x7f70a80b9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:38.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.740+0000 7f70a559a640 1 -- 172.21.15.88:0/3041203132 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521012314 0 0) 0x7f70a80bad10 con 0x7f70a806b800 2024-01-22T10:12:38.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.740+0000 7f70a559a640 1 -- 172.21.15.88:0/3041203132 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7090003520 con 0x7f70a806b800 2024-01-22T10:12:38.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.740+0000 7f70a6d9d640 1 -- 172.21.15.88:0/3041203132 >> v1:172.21.15.119:6789/0 conn(0x7f70a806b800 legacy=0x7f70a8145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:38.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.740+0000 7f70a6d9d640 1 -- 172.21.15.88:0/3041203132 >> v1:172.21.15.88:6789/0 conn(0x7f70a80bb5a0 legacy=0x7f70a806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:38.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.740+0000 7f70a6d9d640 1 -- 172.21.15.88:0/3041203132 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a80b5a80 con 0x7f70a80b9b00 2024-01-22T10:12:38.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.741+0000 7f70a6d9d640 1 --2- 172.21.15.88:0/3041203132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70a80b9b00 0x7f70a80b9f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009610 tx=0x7f70a002c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e626a2964c617f92 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:38.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.742+0000 7f70a559a640 1 -- 172.21.15.88:0/3041203132 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0034640 con 0x7f70a80b9b00 2024-01-22T10:12:38.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.742+0000 7f70a559a640 1 -- 172.21.15.88:0/3041203132 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a00347a0 con 0x7f70a80b9b00 2024-01-22T10:12:38.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.742+0000 7f70a559a640 1 -- 172.21.15.88:0/3041203132 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0034b30 con 0x7f70a80b9b00 2024-01-22T10:12:38.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.742+0000 7f70acf3c640 1 -- 172.21.15.88:0/3041203132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70a80b9b00 msgr2=0x7f70a80b9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:38.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.742+0000 7f70acf3c640 1 --2- 172.21.15.88:0/3041203132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70a80b9b00 0x7f70a80b9f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009610 tx=0x7f70a002c350 comp rx=0 tx=0).stop 2024-01-22T10:12:38.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.742+0000 7f70acf3c640 1 -- 172.21.15.88:0/3041203132 shutdown_connections 2024-01-22T10:12:38.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.742+0000 7f70acf3c640 1 --2- 172.21.15.88:0/3041203132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70a80b9b00 0x7f70a80b9f20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:38.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.742+0000 7f70acf3c640 1 -- 172.21.15.88:0/3041203132 >> 172.21.15.88:0/3041203132 conn(0x7f70a8071650 msgr2=0x7f70a8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:38.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.743+0000 7f70acf3c640 1 -- 172.21.15.88:0/3041203132 shutdown_connections 2024-01-22T10:12:38.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.743+0000 7f70acf3c640 1 -- 172.21.15.88:0/3041203132 wait complete. 2024-01-22T10:12:38.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.744+0000 7f70acf3c640 1 Processor -- start 2024-01-22T10:12:38.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.744+0000 7f70acf3c640 1 -- start start 2024-01-22T10:12:38.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.744+0000 7f70acf3c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70a806b800 0x7f70a8147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:38.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.744+0000 7f70acf3c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70a80b9b00 0x7f70a8148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:38.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.744+0000 7f70acf3c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70a80bb5a0 0x7f70a81e1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:38.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.744+0000 7f70acf3c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a8147f70 con 0x7f70a80b9b00 2024-01-22T10:12:38.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.744+0000 7f70acf3c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a813abb0 con 0x7f70a806b800 2024-01-22T10:12:38.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.744+0000 7f70acf3c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a8146c40 con 0x7f70a80bb5a0 2024-01-22T10:12:38.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.745+0000 7f70a5d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70a80b9b00 0x7f70a8148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:38.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.745+0000 7f70a659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70a806b800 0x7f70a8147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:38.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.745+0000 7f70a5d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70a80b9b00 0x7f70a8148a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49776/0 (socket says 172.21.15.88:49776) 2024-01-22T10:12:38.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.745+0000 7f70a5d9b640 1 -- 172.21.15.88:0/1797292757 learned_addr learned my addr 172.21.15.88:0/1797292757 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:12:38.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.745+0000 7f70a6d9d640 1 --2- 172.21.15.88:0/1797292757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70a80bb5a0 0x7f70a81e1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:38.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.745+0000 7f70a5d9b640 1 -- 172.21.15.88:0/1797292757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70a80bb5a0 msgr2=0x7f70a81e1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.745+0000 7f70a5d9b640 1 --2- 172.21.15.88:0/1797292757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70a80bb5a0 0x7f70a81e1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.745+0000 7f70a5d9b640 1 -- 172.21.15.88:0/1797292757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70a806b800 msgr2=0x7f70a8147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.745+0000 7f70a5d9b640 1 --2- 172.21.15.88:0/1797292757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70a806b800 0x7f70a8147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.745+0000 7f70a5d9b640 1 -- 172.21.15.88:0/1797292757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a0009ad0 con 0x7f70a80b9b00 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.745+0000 7f70a659c640 1 --2- 172.21.15.88:0/1797292757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70a806b800 0x7f70a8147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.745+0000 7f70a5d9b640 1 --2- 172.21.15.88:0/1797292757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70a80b9b00 0x7f70a8148a40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f709c00c460 tx=0x7f709c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.746+0000 7f7096ffd640 1 -- 172.21.15.88:0/1797292757 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c0052d0 con 0x7f70a80b9b00 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.746+0000 7f7096ffd640 1 -- 172.21.15.88:0/1797292757 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c005450 con 0x7f70a80b9b00 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.746+0000 7f70acf3c640 1 -- 172.21.15.88:0/1797292757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a813e5e0 con 0x7f70a80b9b00 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.746+0000 7f7096ffd640 1 -- 172.21.15.88:0/1797292757 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c003830 con 0x7f70a80b9b00 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.746+0000 7f7096ffd640 1 -- 172.21.15.88:0/1797292757 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f709c003d10 con 0x7f70a80b9b00 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.746+0000 7f70acf3c640 1 -- 172.21.15.88:0/1797292757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a81468d0 con 0x7f70a80b9b00 2024-01-22T10:12:38.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.746+0000 7f7096ffd640 1 -- 172.21.15.88:0/1797292757 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f709c012ad0 con 0x7f70a80b9b00 2024-01-22T10:12:38.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.747+0000 7f70acf3c640 1 -- 172.21.15.88:0/1797292757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a804ea30 con 0x7f70a80b9b00 2024-01-22T10:12:38.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.750+0000 7f7096ffd640 1 -- 172.21.15.88:0/1797292757 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f709c017070 con 0x7f70a80b9b00 2024-01-22T10:12:38.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.815+0000 7f70acf3c640 1 -- 172.21.15.88:0/1797292757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f70a80ba710 con 0x7f70a80b9b00 2024-01-22T10:12:38.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.817+0000 7f7096ffd640 1 -- 172.21.15.88:0/1797292757 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f709c012c90 con 0x7f70a80b9b00 2024-01-22T10:12:38.799 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2024-01-22T10:12:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.817+0000 7f70acf3c640 1 -- 172.21.15.88:0/1797292757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70a80b9b00 msgr2=0x7f70a8148a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.817+0000 7f70acf3c640 1 --2- 172.21.15.88:0/1797292757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70a80b9b00 0x7f70a8148a40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f709c00c460 tx=0x7f709c00c920 comp rx=0 tx=0).stop 2024-01-22T10:12:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.818+0000 7f70acf3c640 1 -- 172.21.15.88:0/1797292757 shutdown_connections 2024-01-22T10:12:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.818+0000 7f70acf3c640 1 --2- 172.21.15.88:0/1797292757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70a80bb5a0 0x7f70a81e1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.818+0000 7f70acf3c640 1 --2- 172.21.15.88:0/1797292757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70a80b9b00 0x7f70a8148a40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.818+0000 7f70acf3c640 1 --2- 172.21.15.88:0/1797292757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70a806b800 0x7f70a8147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.818+0000 7f70acf3c640 1 -- 172.21.15.88:0/1797292757 >> 172.21.15.88:0/1797292757 conn(0x7f70a8071650 msgr2=0x7f70a81401f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.818+0000 7f70acf3c640 1 -- 172.21.15.88:0/1797292757 shutdown_connections 2024-01-22T10:12:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:38.818+0000 7f70acf3c640 1 -- 172.21.15.88:0/1797292757 wait complete. 2024-01-22T10:12:38.814 INFO:tasks.ceph:check_enable_crimson: False 2024-01-22T10:12:38.814 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-22T10:12:38.815 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:38.815 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-22T10:12:38.841 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:38.841 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-22T10:12:38.908 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:38.908 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-22T10:12:38.975 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-01-22T10:12:38.975 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-22T10:12:39.042 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:39.042 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-22T10:12:39.068 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:39.069 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-22T10:12:39.135 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:39.135 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-22T10:12:39.172 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:39.190+0000 7f667da40040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-22T10:12:39.192 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:39.209+0000 7fd35464c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-22T10:12:39.202 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-01-22T10:12:39.202 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-22T10:12:39.225 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:39.242+0000 7f667da40040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-22T10:12:39.247 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:39.264+0000 7fd35464c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-22T10:12:39.269 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 02049f9d-7ab6-4005-a006-c5dc79c82983 0 2024-01-22T10:12:39.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.426+0000 7fd1105a4640 1 Processor -- start 2024-01-22T10:12:39.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.427+0000 7fd1105a4640 1 -- start start 2024-01-22T10:12:39.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.427+0000 7fd1105a4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd10814f7f0 0x7fd1080b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.427+0000 7fd1105a4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1080b9030 con 0x7fd108072050 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.427+0000 7fd1105a4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1080b8d30 con 0x7fd10814ed30 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.427+0000 7fd1105a4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1080b9a00 con 0x7fd10814f7f0 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.428+0000 7fd10e340640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd10814f7f0 0x7fd1080b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.428+0000 7fd10e340640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd10814f7f0 0x7fd1080b94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40900/0 (socket says 172.21.15.119:40900) 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.428+0000 7fd10eb41640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd10814ed30 0x7fd1081560c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53598/0 (socket says 172.21.15.119:53598) 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.428+0000 7fd10e340640 1 -- 172.21.15.119:0/1593702796 learned_addr learned my addr 172.21.15.119:0/1593702796 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.428+0000 7fd10e340640 1 -- 172.21.15.119:0/1593702796 >> v1:172.21.15.119:6789/0 conn(0x7fd10814ed30 legacy=0x7fd1081560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.428+0000 7fd10e340640 1 -- 172.21.15.119:0/1593702796 >> v1:172.21.15.88:6789/0 conn(0x7fd108072050 legacy=0x7fd10806a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.428+0000 7fd10e340640 1 -- 172.21.15.119:0/1593702796 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10806ae00 con 0x7fd10814f7f0 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.429+0000 7fd10e340640 1 --2- 172.21.15.119:0/1593702796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd10814f7f0 0x7fd1080b94c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd104009870 tx=0x7fd10402bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33cbda4b49a274c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.429+0000 7fd10d33e640 1 -- 172.21.15.119:0/1593702796 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10402d870 con 0x7fd10814f7f0 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.429+0000 7fd10d33e640 1 -- 172.21.15.119:0/1593702796 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10402d9d0 con 0x7fd10814f7f0 2024-01-22T10:12:39.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.429+0000 7fd10d33e640 1 -- 172.21.15.119:0/1593702796 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10402dd60 con 0x7fd10814f7f0 2024-01-22T10:12:39.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.429+0000 7fd1105a4640 1 -- 172.21.15.119:0/1593702796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd10814f7f0 msgr2=0x7fd1080b94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.429+0000 7fd1105a4640 1 --2- 172.21.15.119:0/1593702796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd10814f7f0 0x7fd1080b94c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd104009870 tx=0x7fd10402bab0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.429+0000 7fd1105a4640 1 -- 172.21.15.119:0/1593702796 shutdown_connections 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.429+0000 7fd1105a4640 1 --2- 172.21.15.119:0/1593702796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd10814f7f0 0x7fd1080b94c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.429+0000 7fd1105a4640 1 -- 172.21.15.119:0/1593702796 >> 172.21.15.119:0/1593702796 conn(0x7fd10806b800 msgr2=0x7fd10806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.429+0000 7fd1105a4640 1 -- 172.21.15.119:0/1593702796 shutdown_connections 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.429+0000 7fd1105a4640 1 -- 172.21.15.119:0/1593702796 wait complete. 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.430+0000 7fd1105a4640 1 Processor -- start 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.430+0000 7fd1105a4640 1 -- start start 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd1105a4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd108072050 0x7fd10814af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd1105a4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd10814ed30 0x7fd1080b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd1105a4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10814f7f0 0x7fd10814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd1105a4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10814a700 con 0x7fd10814f7f0 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd1105a4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080b6c70 con 0x7fd10814ed30 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd1105a4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10814b630 con 0x7fd108072050 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd10db3f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd10814ed30 0x7fd1080b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd10e340640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd108072050 0x7fd10814af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd10db3f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd10814ed30 0x7fd1080b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40910/0 (socket says 172.21.15.119:40910) 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd10db3f640 1 -- 172.21.15.119:0/2980469675 learned_addr learned my addr 172.21.15.119:0/2980469675 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd10e340640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd108072050 0x7fd10814af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:44938/0 (socket says 172.21.15.119:44938) 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd10eb41640 1 --2- 172.21.15.119:0/2980469675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10814f7f0 0x7fd10814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd10db3f640 1 -- 172.21.15.119:0/2980469675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd108072050 msgr2=0x7fd10814af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd10db3f640 1 --2- 172.21.15.119:0/2980469675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd108072050 0x7fd10814af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd10db3f640 1 -- 172.21.15.119:0/2980469675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10814f7f0 msgr2=0x7fd10814bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd10db3f640 1 --2- 172.21.15.119:0/2980469675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10814f7f0 0x7fd10814bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.431+0000 7fd10db3f640 1 -- 172.21.15.119:0/2980469675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1040094d0 con 0x7fd10814ed30 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.432+0000 7fd10db3f640 1 --2- 172.21.15.119:0/2980469675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd10814ed30 0x7fd1080b6730 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800c400 tx=0x7fd0f800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.432+0000 7fd0feffd640 1 -- 172.21.15.119:0/2980469675 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f80052d0 con 0x7fd10814ed30 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.432+0000 7fd0feffd640 1 -- 172.21.15.119:0/2980469675 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f8005450 con 0x7fd10814ed30 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.432+0000 7fd0feffd640 1 -- 172.21.15.119:0/2980469675 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8007260 con 0x7fd10814ed30 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.432+0000 7fd1105a4640 1 -- 172.21.15.119:0/2980469675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd108147330 con 0x7fd10814ed30 2024-01-22T10:12:39.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.432+0000 7fd1105a4640 1 -- 172.21.15.119:0/2980469675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10814a090 con 0x7fd10814ed30 2024-01-22T10:12:39.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.432+0000 7fd0feffd640 1 -- 172.21.15.119:0/2980469675 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fd0f80067d0 con 0x7fd10814ed30 2024-01-22T10:12:39.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.432+0000 7fd0feffd640 1 -- 172.21.15.119:0/2980469675 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd0f8003da0 con 0x7fd10814ed30 2024-01-22T10:12:39.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.433+0000 7fd1105a4640 1 -- 172.21.15.119:0/2980469675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10804ea30 con 0x7fd10814ed30 2024-01-22T10:12:39.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.435+0000 7fd0feffd640 1 -- 172.21.15.119:0/2980469675 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fd0f8020060 con 0x7fd10814ed30 2024-01-22T10:12:39.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.506+0000 7fd1105a4640 1 -- 172.21.15.119:0/2980469675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "02049f9d-7ab6-4005-a006-c5dc79c82983", "id": 0} v 0) v1 -- 0x7fd1080707d0 con 0x7fd10814ed30 2024-01-22T10:12:39.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.509+0000 7fd0feffd640 1 -- 172.21.15.119:0/2980469675 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02049f9d-7ab6-4005-a006-c5dc79c82983", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd0f8006c60 con 0x7fd10814ed30 2024-01-22T10:12:39.492 INFO:teuthology.orchestra.run.smithi119.stdout:0 2024-01-22T10:12:39.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.510+0000 7fd1105a4640 1 -- 172.21.15.119:0/2980469675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd10814ed30 msgr2=0x7fd1080b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.510+0000 7fd1105a4640 1 --2- 172.21.15.119:0/2980469675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd10814ed30 0x7fd1080b6730 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800c400 tx=0x7fd0f800c8c0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.510+0000 7fd1105a4640 1 -- 172.21.15.119:0/2980469675 shutdown_connections 2024-01-22T10:12:39.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.510+0000 7fd1105a4640 1 --2- 172.21.15.119:0/2980469675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10814f7f0 0x7fd10814bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.510+0000 7fd1105a4640 1 --2- 172.21.15.119:0/2980469675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd10814ed30 0x7fd1080b6730 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.510+0000 7fd1105a4640 1 --2- 172.21.15.119:0/2980469675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd108072050 0x7fd10814af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.510+0000 7fd1105a4640 1 -- 172.21.15.119:0/2980469675 >> 172.21.15.119:0/2980469675 conn(0x7fd10806b800 msgr2=0x7fd1080b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:39.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.510+0000 7fd1105a4640 1 -- 172.21.15.119:0/2980469675 shutdown_connections 2024-01-22T10:12:39.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.510+0000 7fd1105a4640 1 -- 172.21.15.119:0/2980469675 wait complete. 2024-01-22T10:12:39.503 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new dd14b1ba-d048-4a3c-b3ce-788dba5a4771 1 2024-01-22T10:12:39.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.619+0000 7fa556343640 1 Processor -- start 2024-01-22T10:12:39.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.620+0000 7fa556343640 1 -- start start 2024-01-22T10:12:39.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.620+0000 7fa556343640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa5500ba2c0 0x7fa550070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.620+0000 7fa556343640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa550072670 0x7fa5500b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.620+0000 7fa556343640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5500b77d0 con 0x7fa55006ff30 2024-01-22T10:12:39.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.620+0000 7fa556343640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa550070620 con 0x7fa550072670 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.620+0000 7fa556343640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55006fcd0 con 0x7fa5500ba2c0 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.620+0000 7fa54ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa5500ba2c0 0x7fa550070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.620+0000 7fa54ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa5500ba2c0 0x7fa550070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40916/0 (socket says 172.21.15.119:40916) 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.620+0000 7fa54ffff640 1 -- 172.21.15.119:0/615558751 learned_addr learned my addr 172.21.15.119:0/615558751 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.620+0000 7fa54f7fe640 1 --2- 172.21.15.119:0/615558751 >> v2:172.21.15.88:3300/0 conn(0x7fa550072670 0x7fa5500b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.621+0000 7fa54ffff640 1 -- 172.21.15.119:0/615558751 >> v2:172.21.15.88:3300/0 conn(0x7fa550072670 msgr2=0x7fa5500b8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.621+0000 7fa54ffff640 1 --2- 172.21.15.119:0/615558751 >> v2:172.21.15.88:3300/0 conn(0x7fa550072670 0x7fa5500b8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.621+0000 7fa54ffff640 1 -- 172.21.15.119:0/615558751 >> v1:172.21.15.88:6789/0 conn(0x7fa55006ff30 legacy=0x7fa5501488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.621+0000 7fa54ffff640 1 -- 172.21.15.119:0/615558751 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5500b74f0 con 0x7fa5500ba2c0 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.621+0000 7fa54ffff640 1 --2- 172.21.15.119:0/615558751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5500ba2c0 0x7fa550070de0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa550066b70 tx=0x7fa54002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a63372545e83930 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.621+0000 7fa54effd640 1 -- 172.21.15.119:0/615558751 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54002f850 con 0x7fa5500ba2c0 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.622+0000 7fa54effd640 1 -- 172.21.15.119:0/615558751 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54002f9b0 con 0x7fa5500ba2c0 2024-01-22T10:12:39.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.622+0000 7fa54effd640 1 -- 172.21.15.119:0/615558751 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54002fd40 con 0x7fa5500ba2c0 2024-01-22T10:12:39.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.622+0000 7fa556343640 1 -- 172.21.15.119:0/615558751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5500ba2c0 msgr2=0x7fa550070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.622+0000 7fa556343640 1 --2- 172.21.15.119:0/615558751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5500ba2c0 0x7fa550070de0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa550066b70 tx=0x7fa54002ba30 comp rx=0 tx=0).stop 2024-01-22T10:12:39.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.622+0000 7fa556343640 1 -- 172.21.15.119:0/615558751 shutdown_connections 2024-01-22T10:12:39.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.622+0000 7fa556343640 1 --2- 172.21.15.119:0/615558751 >> v2:172.21.15.88:3300/0 conn(0x7fa550072670 0x7fa5500b8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.622+0000 7fa556343640 1 --2- 172.21.15.119:0/615558751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5500ba2c0 0x7fa550070de0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.622+0000 7fa556343640 1 -- 172.21.15.119:0/615558751 >> 172.21.15.119:0/615558751 conn(0x7fa55006a8d0 msgr2=0x7fa55006ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:39.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.622+0000 7fa556343640 1 -- 172.21.15.119:0/615558751 shutdown_connections 2024-01-22T10:12:39.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.622+0000 7fa556343640 1 -- 172.21.15.119:0/615558751 wait complete. 2024-01-22T10:12:39.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.623+0000 7fa556343640 1 Processor -- start 2024-01-22T10:12:39.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.623+0000 7fa556343640 1 -- start start 2024-01-22T10:12:39.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa556343640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa55006ff30 0x7fa5500b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa556343640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa550072670 0x7fa5501e4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa556343640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5500ba2c0 0x7fa5501e4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa556343640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55014c6a0 con 0x7fa5500ba2c0 2024-01-22T10:12:39.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa556343640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500b6530 con 0x7fa550072670 2024-01-22T10:12:39.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa556343640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55014a430 con 0x7fa55006ff30 2024-01-22T10:12:39.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa550072670 0x7fa5501e4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa54ffff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa55006ff30 0x7fa5500b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa550072670 0x7fa5501e4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40924/0 (socket says 172.21.15.119:40924) 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa54f7fe640 1 -- 172.21.15.119:0/3867301785 learned_addr learned my addr 172.21.15.119:0/3867301785 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa5548e0640 1 --2- 172.21.15.119:0/3867301785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5500ba2c0 0x7fa5501e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa54f7fe640 1 -- 172.21.15.119:0/3867301785 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa55006ff30 msgr2=0x7fa5500b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa54f7fe640 1 --2- 172.21.15.119:0/3867301785 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa55006ff30 0x7fa5500b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa54f7fe640 1 -- 172.21.15.119:0/3867301785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5500ba2c0 msgr2=0x7fa5501e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa54f7fe640 1 --2- 172.21.15.119:0/3867301785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5500ba2c0 0x7fa5501e4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.624+0000 7fa54f7fe640 1 -- 172.21.15.119:0/3867301785 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5400094d0 con 0x7fa550072670 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.625+0000 7fa54f7fe640 1 --2- 172.21.15.119:0/3867301785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa550072670 0x7fa5501e4420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa54400e930 tx=0x7fa54400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.625+0000 7fa54cff9640 1 -- 172.21.15.119:0/3867301785 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544009660 con 0x7fa550072670 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.625+0000 7fa54cff9640 1 -- 172.21.15.119:0/3867301785 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54400ca00 con 0x7fa550072670 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.625+0000 7fa556343640 1 -- 172.21.15.119:0/3867301785 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55014b7e0 con 0x7fa550072670 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.625+0000 7fa54cff9640 1 -- 172.21.15.119:0/3867301785 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400cd70 con 0x7fa550072670 2024-01-22T10:12:39.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.625+0000 7fa556343640 1 -- 172.21.15.119:0/3867301785 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55014a0c0 con 0x7fa550072670 2024-01-22T10:12:39.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.625+0000 7fa54cff9640 1 -- 172.21.15.119:0/3867301785 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fa544013470 con 0x7fa550072670 2024-01-22T10:12:39.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.625+0000 7fa54cff9640 1 -- 172.21.15.119:0/3867301785 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fa54401cdc0 con 0x7fa550072670 2024-01-22T10:12:39.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.626+0000 7fa556343640 1 -- 172.21.15.119:0/3867301785 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55004ea30 con 0x7fa550072670 2024-01-22T10:12:39.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.628+0000 7fa54cff9640 1 -- 172.21.15.119:0/3867301785 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fa54403bcf0 con 0x7fa550072670 2024-01-22T10:12:39.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.700+0000 7fa556343640 1 -- 172.21.15.119:0/3867301785 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dd14b1ba-d048-4a3c-b3ce-788dba5a4771", "id": 1} v 0) v1 -- 0x7fa5500b97a0 con 0x7fa550072670 2024-01-22T10:12:39.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.705+0000 7fa54cff9640 1 -- 172.21.15.119:0/3867301785 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd14b1ba-d048-4a3c-b3ce-788dba5a4771", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa54402a030 con 0x7fa550072670 2024-01-22T10:12:39.688 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-01-22T10:12:39.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.706+0000 7fa556343640 1 -- 172.21.15.119:0/3867301785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa550072670 msgr2=0x7fa5501e4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.706+0000 7fa556343640 1 --2- 172.21.15.119:0/3867301785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa550072670 0x7fa5501e4420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa54400e930 tx=0x7fa54400edf0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.706+0000 7fa556343640 1 -- 172.21.15.119:0/3867301785 shutdown_connections 2024-01-22T10:12:39.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.706+0000 7fa556343640 1 --2- 172.21.15.119:0/3867301785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5500ba2c0 0x7fa5501e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.706+0000 7fa556343640 1 --2- 172.21.15.119:0/3867301785 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa550072670 0x7fa5501e4420 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.706+0000 7fa556343640 1 --2- 172.21.15.119:0/3867301785 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa55006ff30 0x7fa5500b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.706+0000 7fa556343640 1 -- 172.21.15.119:0/3867301785 >> 172.21.15.119:0/3867301785 conn(0x7fa55006a8d0 msgr2=0x7fa5500b7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:39.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.706+0000 7fa556343640 1 -- 172.21.15.119:0/3867301785 shutdown_connections 2024-01-22T10:12:39.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.706+0000 7fa556343640 1 -- 172.21.15.119:0/3867301785 wait complete. 2024-01-22T10:12:39.700 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new d4ad137b-6e61-475a-a670-7e83088441a3 2 2024-01-22T10:12:39.723 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:39.741+0000 7f667da40040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-22T10:12:39.763 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:39.780+0000 7fd35464c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-22T10:12:39.775 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:39.793+0000 7f667da40040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-22T10:12:39.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.817+0000 7f6667a31640 1 Processor -- start 2024-01-22T10:12:39.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.817+0000 7f6667a31640 1 -- start start 2024-01-22T10:12:39.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f6667a31640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f666006a960 0x7f66600b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f6667a31640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66600ba130 0x7f6660153e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f6667a31640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66600b6d60 con 0x7f66600b8fb0 2024-01-22T10:12:39.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f6667a31640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66600b7370 con 0x7f666006a960 2024-01-22T10:12:39.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f6667a31640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666006b660 con 0x7f66600ba130 2024-01-22T10:12:39.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f66657cd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f666006a960 0x7f66600b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f6665fce640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66600ba130 0x7f6660153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f6665fce640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66600ba130 0x7f6660153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:44968/0 (socket says 172.21.15.119:44968) 2024-01-22T10:12:39.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f6665fce640 1 -- 172.21.15.119:0/710925558 learned_addr learned my addr 172.21.15.119:0/710925558 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:39.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f66657cd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f666006a960 0x7f66600b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40940/0 (socket says 172.21.15.119:40940) 2024-01-22T10:12:39.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f6665fce640 1 -- 172.21.15.119:0/710925558 >> v2:172.21.15.119:3300/0 conn(0x7f666006a960 msgr2=0x7f66600b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:39.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f6665fce640 1 --2- 172.21.15.119:0/710925558 >> v2:172.21.15.119:3300/0 conn(0x7f666006a960 0x7f66600b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f6665fce640 1 -- 172.21.15.119:0/710925558 >> v1:172.21.15.88:6789/0 conn(0x7f66600b8fb0 legacy=0x7f66601432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f6665fce640 1 -- 172.21.15.119:0/710925558 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66600b55a0 con 0x7f66600ba130 2024-01-22T10:12:39.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.818+0000 7f66657cd640 1 --2- 172.21.15.119:0/710925558 >> v2:172.21.15.119:3300/0 conn(0x7f666006a960 0x7f66600b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:12:39.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.819+0000 7f6665fce640 1 --2- 172.21.15.119:0/710925558 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66600ba130 0x7f6660153e40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6658009e50 tx=0x7f665802bfe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=941e5907d85737ca server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.819+0000 7f6657fff640 1 -- 172.21.15.119:0/710925558 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665802cb80 con 0x7f66600ba130 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.819+0000 7f6657fff640 1 -- 172.21.15.119:0/710925558 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665802cce0 con 0x7f66600ba130 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.819+0000 7f6657fff640 1 -- 172.21.15.119:0/710925558 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6658034610 con 0x7f66600ba130 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.820+0000 7f6667a31640 1 -- 172.21.15.119:0/710925558 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66600ba130 msgr2=0x7f6660153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.820+0000 7f6667a31640 1 --2- 172.21.15.119:0/710925558 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66600ba130 0x7f6660153e40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6658009e50 tx=0x7f665802bfe0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.820+0000 7f6667a31640 1 -- 172.21.15.119:0/710925558 shutdown_connections 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.820+0000 7f6667a31640 1 --2- 172.21.15.119:0/710925558 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66600ba130 0x7f6660153e40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.820+0000 7f6667a31640 1 --2- 172.21.15.119:0/710925558 >> v2:172.21.15.119:3300/0 conn(0x7f666006a960 0x7f66600b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.820+0000 7f6667a31640 1 -- 172.21.15.119:0/710925558 >> 172.21.15.119:0/710925558 conn(0x7f666006b800 msgr2=0x7f666006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.820+0000 7f6667a31640 1 -- 172.21.15.119:0/710925558 shutdown_connections 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.820+0000 7f6667a31640 1 -- 172.21.15.119:0/710925558 wait complete. 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.821+0000 7f6667a31640 1 Processor -- start 2024-01-22T10:12:39.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.821+0000 7f6667a31640 1 -- start start 2024-01-22T10:12:39.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.821+0000 7f6667a31640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f666006a960 0x7f66601deb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.821+0000 7f6667a31640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66600ba130 0x7f66601df070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.821+0000 7f6667a31640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6660144410 0x7f6660149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.821+0000 7f6667a31640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6660148300 con 0x7f6660144410 2024-01-22T10:12:39.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.821+0000 7f6667a31640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66601487e0 con 0x7f66600ba130 2024-01-22T10:12:39.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.821+0000 7f6667a31640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6660144960 con 0x7f666006a960 2024-01-22T10:12:39.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f66657cd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f666006a960 0x7f66601deb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f6664fcc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66600ba130 0x7f66601df070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f66657cd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f666006a960 0x7f66601deb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:44978/0 (socket says 172.21.15.119:44978) 2024-01-22T10:12:39.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f66657cd640 1 -- 172.21.15.119:0/2165946957 learned_addr learned my addr 172.21.15.119:0/2165946957 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:39.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f6665fce640 1 --2- 172.21.15.119:0/2165946957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6660144410 0x7f6660149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f66657cd640 1 -- 172.21.15.119:0/2165946957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66600ba130 msgr2=0x7f66601df070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f66657cd640 1 --2- 172.21.15.119:0/2165946957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66600ba130 0x7f66601df070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f66657cd640 1 -- 172.21.15.119:0/2165946957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6660144410 msgr2=0x7f6660149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f66657cd640 1 --2- 172.21.15.119:0/2165946957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6660144410 0x7f6660149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f66657cd640 1 -- 172.21.15.119:0/2165946957 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6650009400 con 0x7f666006a960 2024-01-22T10:12:39.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f6664fcc640 1 --2- 172.21.15.119:0/2165946957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66600ba130 0x7f66601df070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:12:39.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f66657cd640 1 --2- 172.21.15.119:0/2165946957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f666006a960 0x7f66601deb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f665000ebe0 tx=0x7f665000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:39.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f6655ffb640 1 -- 172.21.15.119:0/2165946957 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6650009760 con 0x7f666006a960 2024-01-22T10:12:39.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f6655ffb640 1 -- 172.21.15.119:0/2165946957 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665000cc30 con 0x7f666006a960 2024-01-22T10:12:39.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f6667a31640 1 -- 172.21.15.119:0/2165946957 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6658009b30 con 0x7f666006a960 2024-01-22T10:12:39.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f6655ffb640 1 -- 172.21.15.119:0/2165946957 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665000eee0 con 0x7f666006a960 2024-01-22T10:12:39.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.822+0000 7f6667a31640 1 -- 172.21.15.119:0/2165946957 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6660147f90 con 0x7f666006a960 2024-01-22T10:12:39.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.823+0000 7f6655ffb640 1 -- 172.21.15.119:0/2165946957 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f6650005990 con 0x7f666006a960 2024-01-22T10:12:39.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.823+0000 7f6655ffb640 1 -- 172.21.15.119:0/2165946957 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f6650013890 con 0x7f666006a960 2024-01-22T10:12:39.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.823+0000 7f6667a31640 1 -- 172.21.15.119:0/2165946957 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666004ea30 con 0x7f666006a960 2024-01-22T10:12:39.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.827+0000 7f6655ffb640 1 -- 172.21.15.119:0/2165946957 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f6650021060 con 0x7f666006a960 2024-01-22T10:12:39.820 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:39.837+0000 7fd35464c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-22T10:12:39.820 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:39.837+0000 7f667da40040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-22T10:12:39.866 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:39.883+0000 7fd35464c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-22T10:12:39.872 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:39.889+0000 7f667da40040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-22T10:12:39.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.899+0000 7f6667a31640 1 -- 172.21.15.119:0/2165946957 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d4ad137b-6e61-475a-a670-7e83088441a3", "id": 2} v 0) v1 -- 0x7f66600b7020 con 0x7f666006a960 2024-01-22T10:12:39.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.903+0000 7f6655ffb640 1 -- 172.21.15.119:0/2165946957 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d4ad137b-6e61-475a-a670-7e83088441a3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6650017070 con 0x7f666006a960 2024-01-22T10:12:39.886 INFO:teuthology.orchestra.run.smithi119.stdout:2 2024-01-22T10:12:39.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.904+0000 7f6667a31640 1 -- 172.21.15.119:0/2165946957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f666006a960 msgr2=0x7f66601deb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.904+0000 7f6667a31640 1 --2- 172.21.15.119:0/2165946957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f666006a960 0x7f66601deb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f665000ebe0 tx=0x7f665000c520 comp rx=0 tx=0).stop 2024-01-22T10:12:39.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.904+0000 7f6667a31640 1 -- 172.21.15.119:0/2165946957 shutdown_connections 2024-01-22T10:12:39.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.904+0000 7f6667a31640 1 --2- 172.21.15.119:0/2165946957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6660144410 0x7f6660149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.904+0000 7f6667a31640 1 --2- 172.21.15.119:0/2165946957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66600ba130 0x7f66601df070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.904+0000 7f6667a31640 1 --2- 172.21.15.119:0/2165946957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f666006a960 0x7f66601deb30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.904+0000 7f6667a31640 1 -- 172.21.15.119:0/2165946957 >> 172.21.15.119:0/2165946957 conn(0x7f666006b800 msgr2=0x7f66600bc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:39.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.904+0000 7f6667a31640 1 -- 172.21.15.119:0/2165946957 shutdown_connections 2024-01-22T10:12:39.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:39.904+0000 7f6667a31640 1 -- 172.21.15.119:0/2165946957 wait complete. 2024-01-22T10:12:39.896 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new f4df3d72-db57-4750-95d8-815dc00450df 3 2024-01-22T10:12:39.914 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:39.932+0000 7f667da40040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-22T10:12:39.923 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:39.941+0000 7fd35464c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-22T10:12:39.967 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:39.985+0000 7fd35464c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-22T10:12:39.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.013+0000 7f5981d25640 1 Processor -- start 2024-01-22T10:12:39.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.013+0000 7f5981d25640 1 -- start start 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f5981d25640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f597c0ba2c0 0x7f597c070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f5981d25640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f597c072670 0x7f597c0b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f5981d25640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597c0b77d0 con 0x7f597c06ff30 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f5981d25640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c070620 con 0x7f597c072670 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f5981d25640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c06fcd0 con 0x7f597c0ba2c0 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f597b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f597c0ba2c0 0x7f597c070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f597bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f597c06ff30 0x7f597c1488f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53610/0 (socket says 172.21.15.119:53610) 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f597bfff640 1 -- 172.21.15.119:0/1760530183 learned_addr learned my addr 172.21.15.119:0/1760530183 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f597affd640 1 --2- 172.21.15.119:0/1760530183 >> v2:172.21.15.88:3300/0 conn(0x7f597c072670 0x7f597c0b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f597b7fe640 1 -- 172.21.15.119:0/1760530183 >> v2:172.21.15.88:3300/0 conn(0x7f597c072670 msgr2=0x7f597c0b8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f597b7fe640 1 --2- 172.21.15.119:0/1760530183 >> v2:172.21.15.88:3300/0 conn(0x7f597c072670 0x7f597c0b8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f597b7fe640 1 -- 172.21.15.119:0/1760530183 >> v1:172.21.15.119:6789/0 conn(0x7f597c06ff30 legacy=0x7f597c1488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:39.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.014+0000 7f597b7fe640 1 -- 172.21.15.119:0/1760530183 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c0b74f0 con 0x7f597c0ba2c0 2024-01-22T10:12:39.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.015+0000 7f597b7fe640 1 --2- 172.21.15.119:0/1760530183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597c0ba2c0 0x7f597c070de0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f597c066b70 tx=0x7f597002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39386ff86ba09ad server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:39.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.015+0000 7f597a7fc640 1 -- 172.21.15.119:0/1760530183 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5970030610 con 0x7f597c0ba2c0 2024-01-22T10:12:39.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.015+0000 7f597a7fc640 1 -- 172.21.15.119:0/1760530183 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5970030770 con 0x7f597c0ba2c0 2024-01-22T10:12:39.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.015+0000 7f597a7fc640 1 -- 172.21.15.119:0/1760530183 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5970030b00 con 0x7f597c0ba2c0 2024-01-22T10:12:40.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.016+0000 7f5981d25640 1 -- 172.21.15.119:0/1760530183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597c0ba2c0 msgr2=0x7f597c070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.016+0000 7f5981d25640 1 --2- 172.21.15.119:0/1760530183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597c0ba2c0 0x7f597c070de0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f597c066b70 tx=0x7f597002b960 comp rx=0 tx=0).stop 2024-01-22T10:12:40.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.016+0000 7f5981d25640 1 -- 172.21.15.119:0/1760530183 shutdown_connections 2024-01-22T10:12:40.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.016+0000 7f5981d25640 1 --2- 172.21.15.119:0/1760530183 >> v2:172.21.15.88:3300/0 conn(0x7f597c072670 0x7f597c0b8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.016+0000 7f5981d25640 1 --2- 172.21.15.119:0/1760530183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597c0ba2c0 0x7f597c070de0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.016+0000 7f5981d25640 1 -- 172.21.15.119:0/1760530183 >> 172.21.15.119:0/1760530183 conn(0x7f597c06a8d0 msgr2=0x7f597c06ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:40.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.016+0000 7f5981d25640 1 -- 172.21.15.119:0/1760530183 shutdown_connections 2024-01-22T10:12:40.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.016+0000 7f5981d25640 1 -- 172.21.15.119:0/1760530183 wait complete. 2024-01-22T10:12:40.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.017+0000 7f5981d25640 1 Processor -- start 2024-01-22T10:12:40.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.017+0000 7f5981d25640 1 -- start start 2024-01-22T10:12:40.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.017+0000 7f5981d25640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f597c06ff30 0x7f597c14c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.017+0000 7f5981d25640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f597c072670 0x7f597c14a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.017+0000 7f5981d25640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597c0ba2c0 0x7f597c14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.017+0000 7f5981d25640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c14a6d0 con 0x7f597c072670 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.017+0000 7f5981d25640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c1e1150 con 0x7f597c0ba2c0 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.017+0000 7f5981d25640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c1e1430 con 0x7f597c06ff30 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f597bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597c0ba2c0 0x7f597c14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f597b7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f597c06ff30 0x7f597c14c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f597bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597c0ba2c0 0x7f597c14eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40958/0 (socket says 172.21.15.119:40958) 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f597b7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f597c06ff30 0x7f597c14c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:44992/0 (socket says 172.21.15.119:44992) 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f597bfff640 1 -- 172.21.15.119:0/4065143264 learned_addr learned my addr 172.21.15.119:0/4065143264 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f597affd640 1 --2- 172.21.15.119:0/4065143264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f597c072670 0x7f597c14a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f597bfff640 1 -- 172.21.15.119:0/4065143264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f597c06ff30 msgr2=0x7f597c14c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f597bfff640 1 --2- 172.21.15.119:0/4065143264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f597c06ff30 0x7f597c14c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f597bfff640 1 -- 172.21.15.119:0/4065143264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f597c072670 msgr2=0x7f597c14a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f597bfff640 1 --2- 172.21.15.119:0/4065143264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f597c072670 0x7f597c14a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f597bfff640 1 -- 172.21.15.119:0/4065143264 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970009400 con 0x7f597c0ba2c0 2024-01-22T10:12:40.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f597bfff640 1 --2- 172.21.15.119:0/4065143264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597c0ba2c0 0x7f597c14eb60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f597400cbc0 tx=0x7f597400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:40.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f5963fff640 1 -- 172.21.15.119:0/4065143264 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400ad40 con 0x7f597c0ba2c0 2024-01-22T10:12:40.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f5963fff640 1 -- 172.21.15.119:0/4065143264 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5974012400 con 0x7f597c0ba2c0 2024-01-22T10:12:40.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f5981d25640 1 -- 172.21.15.119:0/4065143264 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597c1e1710 con 0x7f597c0ba2c0 2024-01-22T10:12:40.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f5963fff640 1 -- 172.21.15.119:0/4065143264 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400aea0 con 0x7f597c0ba2c0 2024-01-22T10:12:40.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f5981d25640 1 -- 172.21.15.119:0/4065143264 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597c0b6370 con 0x7f597c0ba2c0 2024-01-22T10:12:40.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f5963fff640 1 -- 172.21.15.119:0/4065143264 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f5974012af0 con 0x7f597c0ba2c0 2024-01-22T10:12:40.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.018+0000 7f5963fff640 1 -- 172.21.15.119:0/4065143264 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f5974007500 con 0x7f597c0ba2c0 2024-01-22T10:12:40.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.019+0000 7f5981d25640 1 -- 172.21.15.119:0/4065143264 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597c1e1900 con 0x7f597c0ba2c0 2024-01-22T10:12:40.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.021+0000 7f5963fff640 1 -- 172.21.15.119:0/4065143264 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f5974021060 con 0x7f597c0ba2c0 2024-01-22T10:12:40.015 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:40.032+0000 7f667da40040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-22T10:12:40.072 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:40.089+0000 7fd35464c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-22T10:12:40.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.092+0000 7f5981d25640 1 -- 172.21.15.119:0/4065143264 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f4df3d72-db57-4750-95d8-815dc00450df", "id": 3} v 0) v1 -- 0x7f597c04ea30 con 0x7f597c0ba2c0 2024-01-22T10:12:40.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.095+0000 7f5963fff640 1 -- 172.21.15.119:0/4065143264 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4df3d72-db57-4750-95d8-815dc00450df", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5974017070 con 0x7f597c0ba2c0 2024-01-22T10:12:40.078 INFO:teuthology.orchestra.run.smithi119.stdout:3 2024-01-22T10:12:40.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.096+0000 7f5981d25640 1 -- 172.21.15.119:0/4065143264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597c0ba2c0 msgr2=0x7f597c14eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.096+0000 7f5981d25640 1 --2- 172.21.15.119:0/4065143264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597c0ba2c0 0x7f597c14eb60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f597400cbc0 tx=0x7f597400a430 comp rx=0 tx=0).stop 2024-01-22T10:12:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.096+0000 7f5981d25640 1 -- 172.21.15.119:0/4065143264 shutdown_connections 2024-01-22T10:12:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.096+0000 7f5981d25640 1 --2- 172.21.15.119:0/4065143264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f597c0ba2c0 0x7f597c14eb60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.096+0000 7f5981d25640 1 --2- 172.21.15.119:0/4065143264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f597c072670 0x7f597c14a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.096+0000 7f5981d25640 1 --2- 172.21.15.119:0/4065143264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f597c06ff30 0x7f597c14c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.096+0000 7f5981d25640 1 -- 172.21.15.119:0/4065143264 >> 172.21.15.119:0/4065143264 conn(0x7f597c06a8d0 msgr2=0x7f597c0b7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.096+0000 7f5981d25640 1 -- 172.21.15.119:0/4065143264 shutdown_connections 2024-01-22T10:12:40.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.096+0000 7f5981d25640 1 -- 172.21.15.119:0/4065143264 wait complete. 2024-01-22T10:12:40.083 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:40.101+0000 7f667da40040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-22T10:12:40.089 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 713e1bcc-7b75-4a4f-b7a5-355d66a50d50 4 2024-01-22T10:12:40.129 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:40.146+0000 7f667da40040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-22T10:12:40.145 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:40.162+0000 7fd35464c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-22T10:12:40.179 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:40.197+0000 7f667da40040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-22T10:12:40.193 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:40.210+0000 7fd35464c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-22T10:12:40.225 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:40.242+0000 7f667da40040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-22T10:12:40.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.245+0000 7f767cb33640 1 Processor -- start 2024-01-22T10:12:40.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.245+0000 7f767cb33640 1 -- start start 2024-01-22T10:12:40.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f767cb33640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7678072050 0x7f76780b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f767cb33640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f767814ed30 0x7f76781560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f767cb33640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76780b9030 con 0x7f767814f7f0 2024-01-22T10:12:40.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f767cb33640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76780b9a00 con 0x7f7678072050 2024-01-22T10:12:40.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f767cb33640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76780b8d30 con 0x7f767814ed30 2024-01-22T10:12:40.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f7676d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f767814ed30 0x7f76781560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f7676d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f767814ed30 0x7f76781560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40968/0 (socket says 172.21.15.119:40968) 2024-01-22T10:12:40.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f7676d9d640 1 -- 172.21.15.119:0/3393615786 learned_addr learned my addr 172.21.15.119:0/3393615786 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:40.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f766ffff640 1 --2- 172.21.15.119:0/3393615786 >> v2:172.21.15.88:3300/0 conn(0x7f7678072050 0x7f76780b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f7676d9d640 1 -- 172.21.15.119:0/3393615786 >> v2:172.21.15.88:3300/0 conn(0x7f7678072050 msgr2=0x7f76780b94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:40.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f7676d9d640 1 --2- 172.21.15.119:0/3393615786 >> v2:172.21.15.88:3300/0 conn(0x7f7678072050 0x7f76780b94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f7676d9d640 1 -- 172.21.15.119:0/3393615786 >> v1:172.21.15.88:6789/0 conn(0x7f767814f7f0 legacy=0x7f767806a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.246+0000 7f7676d9d640 1 -- 172.21.15.119:0/3393615786 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767806ae00 con 0x7f767814ed30 2024-01-22T10:12:40.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.247+0000 7f7676d9d640 1 --2- 172.21.15.119:0/3393615786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767814ed30 0x7f76781560c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f76780724b0 tx=0x7f767002c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2de46a5126a3312 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:40.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.248+0000 7f7675d9b640 1 -- 172.21.15.119:0/3393615786 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767002cbb0 con 0x7f767814ed30 2024-01-22T10:12:40.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.248+0000 7f7675d9b640 1 -- 172.21.15.119:0/3393615786 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767002cd10 con 0x7f767814ed30 2024-01-22T10:12:40.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.248+0000 7f7675d9b640 1 -- 172.21.15.119:0/3393615786 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670034610 con 0x7f767814ed30 2024-01-22T10:12:40.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.248+0000 7f767cb33640 1 -- 172.21.15.119:0/3393615786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767814ed30 msgr2=0x7f76781560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.248+0000 7f767cb33640 1 --2- 172.21.15.119:0/3393615786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767814ed30 0x7f76781560c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f76780724b0 tx=0x7f767002c010 comp rx=0 tx=0).stop 2024-01-22T10:12:40.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.248+0000 7f767cb33640 1 -- 172.21.15.119:0/3393615786 shutdown_connections 2024-01-22T10:12:40.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.248+0000 7f767cb33640 1 --2- 172.21.15.119:0/3393615786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767814ed30 0x7f76781560c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.248+0000 7f767cb33640 1 --2- 172.21.15.119:0/3393615786 >> v2:172.21.15.88:3300/0 conn(0x7f7678072050 0x7f76780b94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.248+0000 7f767cb33640 1 -- 172.21.15.119:0/3393615786 >> 172.21.15.119:0/3393615786 conn(0x7f767806b800 msgr2=0x7f767806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:40.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.248+0000 7f767cb33640 1 -- 172.21.15.119:0/3393615786 shutdown_connections 2024-01-22T10:12:40.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.248+0000 7f767cb33640 1 -- 172.21.15.119:0/3393615786 wait complete. 2024-01-22T10:12:40.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.250+0000 7f767cb33640 1 Processor -- start 2024-01-22T10:12:40.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.250+0000 7f767cb33640 1 -- start start 2024-01-22T10:12:40.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.251+0000 7f767cb33640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7678072050 0x7f76780b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.251+0000 7f767cb33640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f767814ed30 0x7f7678147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.251+0000 7f767cb33640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767814f7f0 0x7f76781469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.251+0000 7f767cb33640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780b7180 con 0x7f767814ed30 2024-01-22T10:12:40.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.251+0000 7f767cb33640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76781e4520 con 0x7f767814f7f0 2024-01-22T10:12:40.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.251+0000 7f767cb33640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76781491e0 con 0x7f7678072050 2024-01-22T10:12:40.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.251+0000 7f7676d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767814f7f0 0x7f76781469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.251+0000 7f767659c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7678072050 0x7f76780b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.251+0000 7f7676d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767814f7f0 0x7f76781469a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40978/0 (socket says 172.21.15.119:40978) 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.251+0000 7f767659c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7678072050 0x7f76780b6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:44996/0 (socket says 172.21.15.119:44996) 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.251+0000 7f7676d9d640 1 -- 172.21.15.119:0/1783759428 learned_addr learned my addr 172.21.15.119:0/1783759428 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.251+0000 7f766ffff640 1 --2- 172.21.15.119:0/1783759428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f767814ed30 0x7f7678147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f7676d9d640 1 -- 172.21.15.119:0/1783759428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7678072050 msgr2=0x7f76780b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f7676d9d640 1 --2- 172.21.15.119:0/1783759428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7678072050 0x7f76780b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f7676d9d640 1 -- 172.21.15.119:0/1783759428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f767814ed30 msgr2=0x7f7678147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f7676d9d640 1 --2- 172.21.15.119:0/1783759428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f767814ed30 0x7f7678147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f7676d9d640 1 -- 172.21.15.119:0/1783759428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7670009b30 con 0x7f767814f7f0 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f767659c640 1 --2- 172.21.15.119:0/1783759428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7678072050 0x7f76780b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f7676d9d640 1 --2- 172.21.15.119:0/1783759428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767814f7f0 0x7f76781469a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7670009f40 tx=0x7f7670004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f766effd640 1 -- 172.21.15.119:0/1783759428 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670009510 con 0x7f767814f7f0 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f766effd640 1 -- 172.21.15.119:0/1783759428 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767003e450 con 0x7f767814f7f0 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f767cb33640 1 -- 172.21.15.119:0/1783759428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76781482f0 con 0x7f767814f7f0 2024-01-22T10:12:40.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f766effd640 1 -- 172.21.15.119:0/1783759428 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767003e800 con 0x7f767814f7f0 2024-01-22T10:12:40.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f767cb33640 1 -- 172.21.15.119:0/1783759428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767814ab70 con 0x7f767814f7f0 2024-01-22T10:12:40.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f766effd640 1 -- 172.21.15.119:0/1783759428 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f767003e960 con 0x7f767814f7f0 2024-01-22T10:12:40.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.252+0000 7f766effd640 1 -- 172.21.15.119:0/1783759428 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f767003f400 con 0x7f767814f7f0 2024-01-22T10:12:40.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.253+0000 7f767cb33640 1 -- 172.21.15.119:0/1783759428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76781466c0 con 0x7f767814f7f0 2024-01-22T10:12:40.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.255+0000 7f766effd640 1 -- 172.21.15.119:0/1783759428 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f7670066cf0 con 0x7f767814f7f0 2024-01-22T10:12:40.248 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:40.266+0000 7fd35464c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-22T10:12:40.295 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:40.312+0000 7fd35464c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-22T10:12:40.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.325+0000 7f767cb33640 1 -- 172.21.15.119:0/1783759428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "713e1bcc-7b75-4a4f-b7a5-355d66a50d50", "id": 4} v 0) v1 -- 0x7f767804ea30 con 0x7f767814f7f0 2024-01-22T10:12:40.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.332+0000 7f766effd640 1 -- 172.21.15.119:0/1783759428 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "713e1bcc-7b75-4a4f-b7a5-355d66a50d50", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7670055030 con 0x7f767814f7f0 2024-01-22T10:12:40.315 INFO:teuthology.orchestra.run.smithi119.stdout:4 2024-01-22T10:12:40.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.333+0000 7f767cb33640 1 -- 172.21.15.119:0/1783759428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767814f7f0 msgr2=0x7f76781469a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.333+0000 7f767cb33640 1 --2- 172.21.15.119:0/1783759428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767814f7f0 0x7f76781469a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7670009f40 tx=0x7f7670004a40 comp rx=0 tx=0).stop 2024-01-22T10:12:40.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.333+0000 7f767cb33640 1 -- 172.21.15.119:0/1783759428 shutdown_connections 2024-01-22T10:12:40.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.333+0000 7f767cb33640 1 --2- 172.21.15.119:0/1783759428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f767814f7f0 0x7f76781469a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.333+0000 7f767cb33640 1 --2- 172.21.15.119:0/1783759428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f767814ed30 0x7f7678147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.333+0000 7f767cb33640 1 --2- 172.21.15.119:0/1783759428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7678072050 0x7f76780b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.333+0000 7f767cb33640 1 -- 172.21.15.119:0/1783759428 >> 172.21.15.119:0/1783759428 conn(0x7f767806b800 msgr2=0x7f76780bbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:40.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.333+0000 7f767cb33640 1 -- 172.21.15.119:0/1783759428 shutdown_connections 2024-01-22T10:12:40.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.333+0000 7f767cb33640 1 -- 172.21.15.119:0/1783759428 wait complete. 2024-01-22T10:12:40.326 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 697c6b66-3193-4096-bb71-3b9c084ef899 5 2024-01-22T10:12:40.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.483+0000 7f7918656640 1 Processor -- start 2024-01-22T10:12:40.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.483+0000 7f7918656640 1 -- start start 2024-01-22T10:12:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.483+0000 7f7918656640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f791014c020 0x7f79101570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.483+0000 7f7918656640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79100bbe80 con 0x7f79100b45d0 2024-01-22T10:12:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.483+0000 7f7918656640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79100c0b70 con 0x7f791006acc0 2024-01-22T10:12:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.483+0000 7f7918656640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79100bcf40 con 0x7f791014c020 2024-01-22T10:12:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.483+0000 7f7916bf3640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f791014c020 0x7f79101570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.483+0000 7f79163f2640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f791006acc0 0x7f791014b910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53622/0 (socket says 172.21.15.119:53622) 2024-01-22T10:12:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.483+0000 7f79163f2640 1 -- 172.21.15.119:0/1669119723 learned_addr learned my addr 172.21.15.119:0/1669119723 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-01-22T10:12:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.484+0000 7f79153f0640 1 -- 172.21.15.119:0/1669119723 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818742185 0 0) 0x7f79100c0b70 con 0x7f791006acc0 2024-01-22T10:12:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.484+0000 7f79153f0640 1 -- 172.21.15.119:0/1669119723 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78fc003520 con 0x7f791006acc0 2024-01-22T10:12:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.484+0000 7f7916bf3640 1 -- 172.21.15.119:0/1669119723 >> v1:172.21.15.119:6789/0 conn(0x7f791006acc0 legacy=0x7f791014b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.484+0000 7f7916bf3640 1 -- 172.21.15.119:0/1669119723 >> v1:172.21.15.88:6789/0 conn(0x7f79100b45d0 legacy=0x7f79100a63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.484+0000 7f7916bf3640 1 -- 172.21.15.119:0/1669119723 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79100bb830 con 0x7f791014c020 2024-01-22T10:12:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.484+0000 7f7916bf3640 1 --2- 172.21.15.119:0/1669119723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f791014c020 0x7f79101570c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7908009dc0 tx=0x7f790802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c3abbc79712b2f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.485+0000 7f79153f0640 1 -- 172.21.15.119:0/1669119723 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790802cc40 con 0x7f791014c020 2024-01-22T10:12:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.485+0000 7f79153f0640 1 -- 172.21.15.119:0/1669119723 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790802cda0 con 0x7f791014c020 2024-01-22T10:12:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.485+0000 7f79153f0640 1 -- 172.21.15.119:0/1669119723 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908034660 con 0x7f791014c020 2024-01-22T10:12:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.485+0000 7f7918656640 1 -- 172.21.15.119:0/1669119723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f791014c020 msgr2=0x7f79101570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.485+0000 7f7918656640 1 --2- 172.21.15.119:0/1669119723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f791014c020 0x7f79101570c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7908009dc0 tx=0x7f790802be90 comp rx=0 tx=0).stop 2024-01-22T10:12:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.485+0000 7f7918656640 1 -- 172.21.15.119:0/1669119723 shutdown_connections 2024-01-22T10:12:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.485+0000 7f7918656640 1 --2- 172.21.15.119:0/1669119723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f791014c020 0x7f79101570c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.485+0000 7f7918656640 1 -- 172.21.15.119:0/1669119723 >> 172.21.15.119:0/1669119723 conn(0x7f79100c0eb0 msgr2=0x7f79100c12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.485+0000 7f7918656640 1 -- 172.21.15.119:0/1669119723 shutdown_connections 2024-01-22T10:12:40.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.485+0000 7f7918656640 1 -- 172.21.15.119:0/1669119723 wait complete. 2024-01-22T10:12:40.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7918656640 1 Processor -- start 2024-01-22T10:12:40.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7918656640 1 -- start start 2024-01-22T10:12:40.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7918656640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f791006acc0 0x7f79100ba270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7918656640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79100b45d0 0x7f7910148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7918656640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f791014c020 0x7f79100b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7918656640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7910148b70 con 0x7f791006acc0 2024-01-22T10:12:40.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7918656640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79100bb590 con 0x7f791014c020 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7918656640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79100bb360 con 0x7f79100b45d0 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7916bf3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f791014c020 0x7f79100b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7915bf1640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79100b45d0 0x7f7910148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7916bf3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f791014c020 0x7f79100b8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40992/0 (socket says 172.21.15.119:40992) 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7915bf1640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79100b45d0 0x7f7910148630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:45008/0 (socket says 172.21.15.119:45008) 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f7916bf3640 1 -- 172.21.15.119:0/1600776791 learned_addr learned my addr 172.21.15.119:0/1600776791 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.487+0000 7f79163f2640 1 --2- 172.21.15.119:0/1600776791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f791006acc0 0x7f79100ba270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7916bf3640 1 -- 172.21.15.119:0/1600776791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79100b45d0 msgr2=0x7f7910148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7916bf3640 1 --2- 172.21.15.119:0/1600776791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79100b45d0 0x7f7910148630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7916bf3640 1 -- 172.21.15.119:0/1600776791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f791006acc0 msgr2=0x7f79100ba270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7916bf3640 1 --2- 172.21.15.119:0/1600776791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f791006acc0 0x7f79100ba270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7916bf3640 1 -- 172.21.15.119:0/1600776791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908009a70 con 0x7f791014c020 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7915bf1640 1 --2- 172.21.15.119:0/1600776791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79100b45d0 0x7f7910148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:12:40.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7916bf3640 1 --2- 172.21.15.119:0/1600776791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f791014c020 0x7f79100b8a40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7908009ee0 tx=0x7f7908004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7906ffd640 1 -- 172.21.15.119:0/1600776791 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908040650 con 0x7f791014c020 2024-01-22T10:12:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7906ffd640 1 -- 172.21.15.119:0/1600776791 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79080407b0 con 0x7f791014c020 2024-01-22T10:12:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7918656640 1 -- 172.21.15.119:0/1600776791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79100b7580 con 0x7f791014c020 2024-01-22T10:12:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7906ffd640 1 -- 172.21.15.119:0/1600776791 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908040b60 con 0x7f791014c020 2024-01-22T10:12:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7918656640 1 -- 172.21.15.119:0/1600776791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79100ba980 con 0x7f791014c020 2024-01-22T10:12:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7906ffd640 1 -- 172.21.15.119:0/1600776791 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f7908040cc0 con 0x7f791014c020 2024-01-22T10:12:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.488+0000 7f7906ffd640 1 -- 172.21.15.119:0/1600776791 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7908049e00 con 0x7f791014c020 2024-01-22T10:12:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.489+0000 7f7918656640 1 -- 172.21.15.119:0/1600776791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79100b70b0 con 0x7f791014c020 2024-01-22T10:12:40.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.491+0000 7f7906ffd640 1 -- 172.21.15.119:0/1600776791 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f7908068cf0 con 0x7f791014c020 2024-01-22T10:12:40.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.563+0000 7f7918656640 1 -- 172.21.15.119:0/1600776791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "697c6b66-3193-4096-bb71-3b9c084ef899", "id": 5} v 0) v1 -- 0x7f79100b7710 con 0x7f791014c020 2024-01-22T10:12:40.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.568+0000 7f7906ffd640 1 -- 172.21.15.119:0/1600776791 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "697c6b66-3193-4096-bb71-3b9c084ef899", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7908057030 con 0x7f791014c020 2024-01-22T10:12:40.551 INFO:teuthology.orchestra.run.smithi119.stdout:5 2024-01-22T10:12:40.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.569+0000 7f7918656640 1 -- 172.21.15.119:0/1600776791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f791014c020 msgr2=0x7f79100b8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.569+0000 7f7918656640 1 --2- 172.21.15.119:0/1600776791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f791014c020 0x7f79100b8a40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7908009ee0 tx=0x7f7908004a40 comp rx=0 tx=0).stop 2024-01-22T10:12:40.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.569+0000 7f7918656640 1 -- 172.21.15.119:0/1600776791 shutdown_connections 2024-01-22T10:12:40.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.569+0000 7f7918656640 1 --2- 172.21.15.119:0/1600776791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79100b45d0 0x7f7910148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.569+0000 7f7918656640 1 --2- 172.21.15.119:0/1600776791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f791014c020 0x7f79100b8a40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.569+0000 7f7918656640 1 --2- 172.21.15.119:0/1600776791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f791006acc0 0x7f79100ba270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.569+0000 7f7918656640 1 -- 172.21.15.119:0/1600776791 >> 172.21.15.119:0/1600776791 conn(0x7f79100c0eb0 msgr2=0x7f79100a6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:40.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.569+0000 7f7918656640 1 -- 172.21.15.119:0/1600776791 shutdown_connections 2024-01-22T10:12:40.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.569+0000 7f7918656640 1 -- 172.21.15.119:0/1600776791 wait complete. 2024-01-22T10:12:40.562 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new ff1eade6-459c-4eb2-87fc-ce162bdd81a0 6 2024-01-22T10:12:40.601 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:40.619+0000 7f667da40040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-22T10:12:40.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.677+0000 7f091759e640 1 Processor -- start 2024-01-22T10:12:40.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.677+0000 7f091759e640 1 -- start start 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.678+0000 7f091759e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091006a960 0x7f09100b8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.678+0000 7f091759e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09100ba2a0 con 0x7f09100b6d60 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.678+0000 7f091759e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09100b5120 con 0x7f09100b4780 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.678+0000 7f091759e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0910143d50 con 0x7f091006a960 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.678+0000 7f0914b39640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f09100b4780 0x7f09100b9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:53634/0 (socket says 172.21.15.119:53634) 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.678+0000 7f091533a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091006a960 0x7f09100b8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.678+0000 7f0914b39640 1 -- 172.21.15.119:0/3942083778 learned_addr learned my addr 172.21.15.119:0/3942083778 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.678+0000 7f0907fff640 1 -- 172.21.15.119:0/3942083778 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856778527 0 0) 0x7f09100b5120 con 0x7f09100b4780 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.678+0000 7f0907fff640 1 -- 172.21.15.119:0/3942083778 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc003520 con 0x7f09100b4780 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.679+0000 7f091533a640 1 -- 172.21.15.119:0/3942083778 >> v1:172.21.15.119:6789/0 conn(0x7f09100b4780 legacy=0x7f09100b9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.679+0000 7f091533a640 1 -- 172.21.15.119:0/3942083778 >> v1:172.21.15.88:6789/0 conn(0x7f09100b6d60 legacy=0x7f0910143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.679+0000 7f091533a640 1 -- 172.21.15.119:0/3942083778 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100b53c0 con 0x7f091006a960 2024-01-22T10:12:40.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.679+0000 7f091533a640 1 --2- 172.21.15.119:0/3942083778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091006a960 0x7f09100b8f00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f09000097d0 tx=0x7f090002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25ad6a6da1977619 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.679+0000 7f0907fff640 1 -- 172.21.15.119:0/3942083778 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090002d040 con 0x7f091006a960 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.679+0000 7f0907fff640 1 -- 172.21.15.119:0/3942083778 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0900031810 con 0x7f091006a960 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.679+0000 7f0907fff640 1 -- 172.21.15.119:0/3942083778 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900031ba0 con 0x7f091006a960 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.680+0000 7f091759e640 1 -- 172.21.15.119:0/3942083778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091006a960 msgr2=0x7f09100b8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.680+0000 7f091759e640 1 --2- 172.21.15.119:0/3942083778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091006a960 0x7f09100b8f00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f09000097d0 tx=0x7f090002b8b0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.680+0000 7f091759e640 1 -- 172.21.15.119:0/3942083778 shutdown_connections 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.680+0000 7f091759e640 1 --2- 172.21.15.119:0/3942083778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091006a960 0x7f09100b8f00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.680+0000 7f091759e640 1 -- 172.21.15.119:0/3942083778 >> 172.21.15.119:0/3942083778 conn(0x7f091006b800 msgr2=0x7f091006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.680+0000 7f091759e640 1 -- 172.21.15.119:0/3942083778 shutdown_connections 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.680+0000 7f091759e640 1 -- 172.21.15.119:0/3942083778 wait complete. 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.681+0000 7f091759e640 1 Processor -- start 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.681+0000 7f091759e640 1 -- start start 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f091759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f091006a960 0x7f09101e2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f091759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09100b4780 0x7f09101492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f091759e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09100b6d60 0x7f0910147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f091759e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910147770 con 0x7f091006a960 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f091759e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09101442c0 con 0x7f09100b4780 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f091759e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0910144530 con 0x7f09100b6d60 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f0915b3b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09100b6d60 0x7f0910147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f0914b39640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09100b4780 0x7f09101492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f0915b3b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09100b6d60 0x7f0910147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:45026/0 (socket says 172.21.15.119:45026) 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f0915b3b640 1 -- 172.21.15.119:0/1134110145 learned_addr learned my addr 172.21.15.119:0/1134110145 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f0914b39640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09100b4780 0x7f09101492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40994/0 (socket says 172.21.15.119:40994) 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f091533a640 1 --2- 172.21.15.119:0/1134110145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f091006a960 0x7f09101e2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f0915b3b640 1 -- 172.21.15.119:0/1134110145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09100b4780 msgr2=0x7f09101492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f0915b3b640 1 --2- 172.21.15.119:0/1134110145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09100b4780 0x7f09101492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f0915b3b640 1 -- 172.21.15.119:0/1134110145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f091006a960 msgr2=0x7f09101e2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f0915b3b640 1 --2- 172.21.15.119:0/1134110145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f091006a960 0x7f09101e2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f0915b3b640 1 -- 172.21.15.119:0/1134110145 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900009400 con 0x7f09100b6d60 2024-01-22T10:12:40.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f0915b3b640 1 --2- 172.21.15.119:0/1134110145 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09100b6d60 0x7f0910147ee0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f090800c6b0 tx=0x7f090800cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:40.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.682+0000 7f0905ffb640 1 -- 172.21.15.119:0/1134110145 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0908003b70 con 0x7f09100b6d60 2024-01-22T10:12:40.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.683+0000 7f0905ffb640 1 -- 172.21.15.119:0/1134110145 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0908003cd0 con 0x7f09100b6d60 2024-01-22T10:12:40.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.683+0000 7f091759e640 1 -- 172.21.15.119:0/1134110145 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09101e31b0 con 0x7f09100b6d60 2024-01-22T10:12:40.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.683+0000 7f0905ffb640 1 -- 172.21.15.119:0/1134110145 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0908005310 con 0x7f09100b6d60 2024-01-22T10:12:40.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.683+0000 7f091759e640 1 -- 172.21.15.119:0/1134110145 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09101479c0 con 0x7f09100b6d60 2024-01-22T10:12:40.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.683+0000 7f0905ffb640 1 -- 172.21.15.119:0/1134110145 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f090800a640 con 0x7f09100b6d60 2024-01-22T10:12:40.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.683+0000 7f0905ffb640 1 -- 172.21.15.119:0/1134110145 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f0908012d80 con 0x7f09100b6d60 2024-01-22T10:12:40.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.684+0000 7f091759e640 1 -- 172.21.15.119:0/1134110145 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091004ea30 con 0x7f09100b6d60 2024-01-22T10:12:40.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.687+0000 7f0905ffb640 1 -- 172.21.15.119:0/1134110145 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f0908003e40 con 0x7f09100b6d60 2024-01-22T10:12:40.697 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:40.713+0000 7fd35464c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-22T10:12:40.735 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:40.753+0000 7f667da40040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-22T10:12:40.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.761+0000 7f091759e640 1 -- 172.21.15.119:0/1134110145 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ff1eade6-459c-4eb2-87fc-ce162bdd81a0", "id": 6} v 0) v1 -- 0x7f09100b8a50 con 0x7f09100b6d60 2024-01-22T10:12:40.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.766+0000 7f0905ffb640 1 -- 172.21.15.119:0/1134110145 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff1eade6-459c-4eb2-87fc-ce162bdd81a0", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f09080057f0 con 0x7f09100b6d60 2024-01-22T10:12:40.749 INFO:teuthology.orchestra.run.smithi119.stdout:6 2024-01-22T10:12:40.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.767+0000 7f091759e640 1 -- 172.21.15.119:0/1134110145 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09100b6d60 msgr2=0x7f0910147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.767+0000 7f091759e640 1 --2- 172.21.15.119:0/1134110145 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09100b6d60 0x7f0910147ee0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f090800c6b0 tx=0x7f090800cb70 comp rx=0 tx=0).stop 2024-01-22T10:12:40.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.767+0000 7f091759e640 1 -- 172.21.15.119:0/1134110145 shutdown_connections 2024-01-22T10:12:40.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.767+0000 7f091759e640 1 --2- 172.21.15.119:0/1134110145 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09100b6d60 0x7f0910147ee0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.767+0000 7f091759e640 1 --2- 172.21.15.119:0/1134110145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09100b4780 0x7f09101492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.767+0000 7f091759e640 1 --2- 172.21.15.119:0/1134110145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f091006a960 0x7f09101e2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.767+0000 7f091759e640 1 -- 172.21.15.119:0/1134110145 >> 172.21.15.119:0/1134110145 conn(0x7f091006b800 msgr2=0x7f0910143410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:40.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.768+0000 7f091759e640 1 -- 172.21.15.119:0/1134110145 shutdown_connections 2024-01-22T10:12:40.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.768+0000 7f091759e640 1 -- 172.21.15.119:0/1134110145 wait complete. 2024-01-22T10:12:40.760 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 371cc98f-aadb-4367-bf00-a05c1c9e0a30 7 2024-01-22T10:12:40.838 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:40.855+0000 7fd35464c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-22T10:12:40.842 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:40.860+0000 7f667da40040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-22T10:12:40.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.876+0000 7f16d3bde640 1 Processor -- start 2024-01-22T10:12:40.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.876+0000 7f16d3bde640 1 -- start start 2024-01-22T10:12:40.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.877+0000 7f16d3bde640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16cc071700 0x7f16cc06d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.877+0000 7f16d3bde640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f16cc0b8d90 0x7f16cc1456e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.877+0000 7f16d3bde640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc0bacf0 con 0x7f16cc06dfc0 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.877+0000 7f16d3bde640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16cc06bfe0 con 0x7f16cc0b8d90 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.877+0000 7f16d3bde640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16cc0bb590 con 0x7f16cc071700 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.877+0000 7f16d197a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16cc071700 0x7f16cc06d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.877+0000 7f16d197a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16cc071700 0x7f16cc06d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41002/0 (socket says 172.21.15.119:41002) 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.877+0000 7f16d197a640 1 -- 172.21.15.119:0/2120664303 learned_addr learned my addr 172.21.15.119:0/2120664303 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.877+0000 7f16d1179640 1 --2- 172.21.15.119:0/2120664303 >> v2:172.21.15.88:3300/0 conn(0x7f16cc0b8d90 0x7f16cc1456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.878+0000 7f16d197a640 1 -- 172.21.15.119:0/2120664303 >> v2:172.21.15.88:3300/0 conn(0x7f16cc0b8d90 msgr2=0x7f16cc1456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.878+0000 7f16d197a640 1 --2- 172.21.15.119:0/2120664303 >> v2:172.21.15.88:3300/0 conn(0x7f16cc0b8d90 0x7f16cc1456e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.878+0000 7f16d197a640 1 -- 172.21.15.119:0/2120664303 >> v1:172.21.15.88:6789/0 conn(0x7f16cc06dfc0 legacy=0x7f16cc06e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.878+0000 7f16d197a640 1 -- 172.21.15.119:0/2120664303 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0baf40 con 0x7f16cc071700 2024-01-22T10:12:40.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.878+0000 7f16d1179640 1 --2- 172.21.15.119:0/2120664303 >> v2:172.21.15.88:3300/0 conn(0x7f16cc0b8d90 0x7f16cc1456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:12:40.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.878+0000 7f16d197a640 1 --2- 172.21.15.119:0/2120664303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16cc071700 0x7f16cc06d050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f16cc06f240 tx=0x7f16bc02ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f276eb2270b66a51 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:40.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.878+0000 7f16d0978640 1 -- 172.21.15.119:0/2120664303 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc02f850 con 0x7f16cc071700 2024-01-22T10:12:40.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.878+0000 7f16d0978640 1 -- 172.21.15.119:0/2120664303 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc02f9b0 con 0x7f16cc071700 2024-01-22T10:12:40.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.878+0000 7f16d0978640 1 -- 172.21.15.119:0/2120664303 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc02fd40 con 0x7f16cc071700 2024-01-22T10:12:40.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.879+0000 7f16d3bde640 1 -- 172.21.15.119:0/2120664303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16cc071700 msgr2=0x7f16cc06d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.879+0000 7f16d3bde640 1 --2- 172.21.15.119:0/2120664303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16cc071700 0x7f16cc06d050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f16cc06f240 tx=0x7f16bc02ba30 comp rx=0 tx=0).stop 2024-01-22T10:12:40.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.879+0000 7f16d3bde640 1 -- 172.21.15.119:0/2120664303 shutdown_connections 2024-01-22T10:12:40.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.879+0000 7f16d3bde640 1 --2- 172.21.15.119:0/2120664303 >> v2:172.21.15.88:3300/0 conn(0x7f16cc0b8d90 0x7f16cc1456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.879+0000 7f16d3bde640 1 --2- 172.21.15.119:0/2120664303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16cc071700 0x7f16cc06d050 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.879+0000 7f16d3bde640 1 -- 172.21.15.119:0/2120664303 >> 172.21.15.119:0/2120664303 conn(0x7f16cc0bed00 msgr2=0x7f16cc0bf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.879+0000 7f16d3bde640 1 -- 172.21.15.119:0/2120664303 shutdown_connections 2024-01-22T10:12:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.879+0000 7f16d3bde640 1 -- 172.21.15.119:0/2120664303 wait complete. 2024-01-22T10:12:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.880+0000 7f16d3bde640 1 Processor -- start 2024-01-22T10:12:40.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.880+0000 7f16d3bde640 1 -- start start 2024-01-22T10:12:40.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d3bde640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16cc06dfc0 0x7f16cc1e4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d3bde640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16cc071700 0x7f16cc14bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d3bde640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc0b8d90 0x7f16cc0b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d3bde640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc14a530 con 0x7f16cc0b8d90 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d3bde640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc1e4370 con 0x7f16cc071700 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d3bde640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc14b6b0 con 0x7f16cc06dfc0 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d1179640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16cc071700 0x7f16cc14bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d197a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16cc06dfc0 0x7f16cc1e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d1179640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16cc071700 0x7f16cc14bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41006/0 (socket says 172.21.15.119:41006) 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d197a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16cc06dfc0 0x7f16cc1e4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:45028/0 (socket says 172.21.15.119:45028) 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d1179640 1 -- 172.21.15.119:0/3011177180 learned_addr learned my addr 172.21.15.119:0/3011177180 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d217b640 1 --2- 172.21.15.119:0/3011177180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc0b8d90 0x7f16cc0b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d197a640 1 -- 172.21.15.119:0/3011177180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16cc071700 msgr2=0x7f16cc14bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d197a640 1 --2- 172.21.15.119:0/3011177180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16cc071700 0x7f16cc14bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d197a640 1 -- 172.21.15.119:0/3011177180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc0b8d90 msgr2=0x7f16cc0b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d197a640 1 --2- 172.21.15.119:0/3011177180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc0b8d90 0x7f16cc0b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d197a640 1 -- 172.21.15.119:0/3011177180 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0094d0 con 0x7f16cc06dfc0 2024-01-22T10:12:40.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d1179640 1 --2- 172.21.15.119:0/3011177180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16cc071700 0x7f16cc14bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:12:40.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.881+0000 7f16d197a640 1 --2- 172.21.15.119:0/3011177180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16cc06dfc0 0x7f16cc1e4800 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f16bc033000 tx=0x7f16bc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:40.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.882+0000 7f16c27fc640 1 -- 172.21.15.119:0/3011177180 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc037d00 con 0x7f16cc06dfc0 2024-01-22T10:12:40.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.882+0000 7f16c27fc640 1 -- 172.21.15.119:0/3011177180 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc041400 con 0x7f16cc06dfc0 2024-01-22T10:12:40.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.882+0000 7f16d3bde640 1 -- 172.21.15.119:0/3011177180 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc14a250 con 0x7f16cc06dfc0 2024-01-22T10:12:40.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.882+0000 7f16c27fc640 1 -- 172.21.15.119:0/3011177180 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc037ea0 con 0x7f16cc06dfc0 2024-01-22T10:12:40.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.882+0000 7f16d3bde640 1 -- 172.21.15.119:0/3011177180 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc14ea40 con 0x7f16cc06dfc0 2024-01-22T10:12:40.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.882+0000 7f16c27fc640 1 -- 172.21.15.119:0/3011177180 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f16bc041b30 con 0x7f16cc06dfc0 2024-01-22T10:12:40.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.882+0000 7f16c27fc640 1 -- 172.21.15.119:0/3011177180 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f16bc03c070 con 0x7f16cc06dfc0 2024-01-22T10:12:40.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.883+0000 7f16d3bde640 1 -- 172.21.15.119:0/3011177180 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc04ea30 con 0x7f16cc06dfc0 2024-01-22T10:12:40.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.885+0000 7f16c27fc640 1 -- 172.21.15.119:0/3011177180 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f16bc041de0 con 0x7f16cc06dfc0 2024-01-22T10:12:40.887 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:40.905+0000 7f667da40040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-22T10:12:40.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.979+0000 7f16d3bde640 1 -- 172.21.15.119:0/3011177180 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "371cc98f-aadb-4367-bf00-a05c1c9e0a30", "id": 7} v 0) v1 -- 0x7f16cc0bdfb0 con 0x7f16cc06dfc0 2024-01-22T10:12:40.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.984+0000 7f16c27fc640 1 -- 172.21.15.119:0/3011177180 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "371cc98f-aadb-4367-bf00-a05c1c9e0a30", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f16bc04b460 con 0x7f16cc06dfc0 2024-01-22T10:12:40.967 INFO:teuthology.orchestra.run.smithi119.stdout:7 2024-01-22T10:12:40.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.985+0000 7f16d3bde640 1 -- 172.21.15.119:0/3011177180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16cc06dfc0 msgr2=0x7f16cc1e4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:40.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.985+0000 7f16d3bde640 1 --2- 172.21.15.119:0/3011177180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16cc06dfc0 0x7f16cc1e4800 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f16bc033000 tx=0x7f16bc004730 comp rx=0 tx=0).stop 2024-01-22T10:12:40.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.985+0000 7f16d3bde640 1 -- 172.21.15.119:0/3011177180 shutdown_connections 2024-01-22T10:12:40.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.985+0000 7f16d3bde640 1 --2- 172.21.15.119:0/3011177180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16cc0b8d90 0x7f16cc0b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.985+0000 7f16d3bde640 1 --2- 172.21.15.119:0/3011177180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16cc071700 0x7f16cc14bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.985+0000 7f16d3bde640 1 --2- 172.21.15.119:0/3011177180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16cc06dfc0 0x7f16cc1e4800 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:40.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.985+0000 7f16d3bde640 1 -- 172.21.15.119:0/3011177180 >> 172.21.15.119:0/3011177180 conn(0x7f16cc0bed00 msgr2=0x7f16cc0b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:40.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.985+0000 7f16d3bde640 1 -- 172.21.15.119:0/3011177180 shutdown_connections 2024-01-22T10:12:40.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-01-22T10:12:40.985+0000 7f16d3bde640 1 -- 172.21.15.119:0/3011177180 wait complete. 2024-01-22T10:12:40.977 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:40.994+0000 7fd35464c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-22T10:12:40.978 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-22T10:12:40.978 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-22T10:12:40.980 INFO:tasks.ceph.osd.0:Started 2024-01-22T10:12:40.980 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-22T10:12:40.980 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-22T10:12:40.982 INFO:tasks.ceph.osd.1:Started 2024-01-22T10:12:40.983 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-22T10:12:40.983 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-22T10:12:40.985 INFO:tasks.ceph.osd.2:Started 2024-01-22T10:12:40.985 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-22T10:12:40.985 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-22T10:12:40.986 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:41.002+0000 7f667da40040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-22T10:12:40.987 INFO:tasks.ceph.osd.3:Started 2024-01-22T10:12:40.987 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-22T10:12:40.987 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-22T10:12:40.990 INFO:tasks.ceph.osd.4:Started 2024-01-22T10:12:40.990 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-22T10:12:40.990 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-22T10:12:40.992 INFO:tasks.ceph.osd.5:Started 2024-01-22T10:12:40.992 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-22T10:12:40.992 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-22T10:12:40.994 INFO:tasks.ceph.osd.6:Started 2024-01-22T10:12:40.994 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-22T10:12:40.994 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-22T10:12:40.998 INFO:tasks.ceph.osd.7:Started 2024-01-22T10:12:40.999 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:12:41.032 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:41.049+0000 7fd35464c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-22T10:12:41.108 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:41.125+0000 7f667da40040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-22T10:12:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.140+0000 7f9855e87640 1 Processor -- start 2024-01-22T10:12:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.140+0000 7f9855e87640 1 -- start start 2024-01-22T10:12:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f9855e87640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98500b9d90 0x7f985006a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f9855e87640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f985014ece0 0x7f985014f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f9855e87640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985014f6b0 con 0x7f98500ba170 2024-01-22T10:12:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f9855e87640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985006ac30 con 0x7f985014ece0 2024-01-22T10:12:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f9855e87640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98500b8040 con 0x7f98500b9d90 2024-01-22T10:12:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f984ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f985014ece0 0x7f985014f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f984effd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f98500ba170 0x7f98500b7930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35464/0 (socket says 172.21.15.88:35464) 2024-01-22T10:12:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f984effd640 1 -- 172.21.15.88:0/1537377107 learned_addr learned my addr 172.21.15.88:0/1537377107 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:12:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f984f7fe640 1 --2- 172.21.15.88:0/1537377107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98500b9d90 0x7f985006a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f984ffff640 1 -- 172.21.15.88:0/1537377107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98500b9d90 msgr2=0x7f985006a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f984ffff640 1 --2- 172.21.15.88:0/1537377107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98500b9d90 0x7f985006a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f984ffff640 1 -- 172.21.15.88:0/1537377107 >> v1:172.21.15.88:6789/0 conn(0x7f98500ba170 legacy=0x7f98500b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f984e7fc640 1 -- 172.21.15.88:0/1537377107 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935095707 0 0) 0x7f985014f6b0 con 0x7f98500ba170 2024-01-22T10:12:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.141+0000 7f984ffff640 1 -- 172.21.15.88:0/1537377107 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985006ae10 con 0x7f985014ece0 2024-01-22T10:12:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.142+0000 7f984ffff640 1 --2- 172.21.15.88:0/1537377107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f985014ece0 0x7f985014f170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9848009d90 tx=0x7f984802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9317f0b245194d86 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.142+0000 7f984e7fc640 1 -- 172.21.15.88:0/1537377107 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984802cc50 con 0x7f985014ece0 2024-01-22T10:12:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.142+0000 7f984e7fc640 1 -- 172.21.15.88:0/1537377107 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984802cdb0 con 0x7f985014ece0 2024-01-22T10:12:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.142+0000 7f984e7fc640 1 -- 172.21.15.88:0/1537377107 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848034660 con 0x7f985014ece0 2024-01-22T10:12:41.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.143+0000 7f9855e87640 1 -- 172.21.15.88:0/1537377107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f985014ece0 msgr2=0x7f985014f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:41.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.143+0000 7f9855e87640 1 --2- 172.21.15.88:0/1537377107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f985014ece0 0x7f985014f170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9848009d90 tx=0x7f984802bea0 comp rx=0 tx=0).stop 2024-01-22T10:12:41.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.143+0000 7f9855e87640 1 -- 172.21.15.88:0/1537377107 shutdown_connections 2024-01-22T10:12:41.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.143+0000 7f9855e87640 1 --2- 172.21.15.88:0/1537377107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f985014ece0 0x7f985014f170 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:41.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.143+0000 7f9855e87640 1 --2- 172.21.15.88:0/1537377107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98500b9d90 0x7f985006a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:41.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.143+0000 7f9855e87640 1 -- 172.21.15.88:0/1537377107 >> 172.21.15.88:0/1537377107 conn(0x7f98500bdbf0 msgr2=0x7f98500bdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:41.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.143+0000 7f9855e87640 1 -- 172.21.15.88:0/1537377107 shutdown_connections 2024-01-22T10:12:41.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.143+0000 7f9855e87640 1 -- 172.21.15.88:0/1537377107 wait complete. 2024-01-22T10:12:41.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.144+0000 7f9855e87640 1 Processor -- start 2024-01-22T10:12:41.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.144+0000 7f9855e87640 1 -- start start 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f9855e87640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98500b9d90 0x7f98501489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f9855e87640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98500ba170 0x7f98500b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f9855e87640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f985014ece0 0x7f98501e4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f9855e87640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98500b91c0 con 0x7f985014ece0 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f9855e87640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9850147d60 con 0x7f98500ba170 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f9855e87640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9850148fc0 con 0x7f98500b9d90 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f984ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f985014ece0 0x7f98501e4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f984f7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98500b9d90 0x7f98501489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f984ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f985014ece0 0x7f98501e4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49826/0 (socket says 172.21.15.88:49826) 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f984ffff640 1 -- 172.21.15.88:0/2106178561 learned_addr learned my addr 172.21.15.88:0/2106178561 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f984effd640 1 --2- 172.21.15.88:0/2106178561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98500ba170 0x7f98500b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f984f7fe640 1 -- 172.21.15.88:0/2106178561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98500ba170 msgr2=0x7f98500b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:41.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f984f7fe640 1 --2- 172.21.15.88:0/2106178561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98500ba170 0x7f98500b8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f984f7fe640 1 -- 172.21.15.88:0/2106178561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f985014ece0 msgr2=0x7f98501e4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f984f7fe640 1 --2- 172.21.15.88:0/2106178561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f985014ece0 0x7f98501e4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f984f7fe640 1 -- 172.21.15.88:0/2106178561 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9848009a70 con 0x7f98500b9d90 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.145+0000 7f984ffff640 1 --2- 172.21.15.88:0/2106178561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f985014ece0 0x7f98501e4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.146+0000 7f984f7fe640 1 --2- 172.21.15.88:0/2106178561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98500b9d90 0x7f98501489b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f984400e8a0 tx=0x7f984400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.146+0000 7f9837fff640 1 -- 172.21.15.88:0/2106178561 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9844009e60 con 0x7f98500b9d90 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.146+0000 7f9837fff640 1 -- 172.21.15.88:0/2106178561 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984400c940 con 0x7f98500b9d90 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.146+0000 7f9855e87640 1 -- 172.21.15.88:0/2106178561 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9850146350 con 0x7f98500b9d90 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.146+0000 7f9837fff640 1 -- 172.21.15.88:0/2106178561 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984400ccd0 con 0x7f98500b9d90 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.146+0000 7f9855e87640 1 -- 172.21.15.88:0/2106178561 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98501466a0 con 0x7f98500b9d90 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.146+0000 7f9837fff640 1 -- 172.21.15.88:0/2106178561 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f9844005990 con 0x7f98500b9d90 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.146+0000 7f9837fff640 1 -- 172.21.15.88:0/2106178561 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f984400ce30 con 0x7f98500b9d90 2024-01-22T10:12:41.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.147+0000 7f9855e87640 1 -- 172.21.15.88:0/2106178561 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985004ea30 con 0x7f98500b9d90 2024-01-22T10:12:41.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.149+0000 7f9837fff640 1 -- 172.21.15.88:0/2106178561 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f9844021060 con 0x7f98500b9d90 2024-01-22T10:12:41.140 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:41.158+0000 7fd35464c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-22T10:12:41.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.209+0000 7f9855e87640 1 -- 172.21.15.88:0/2106178561 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9850072c80 con 0x7f98500b9d90 2024-01-22T10:12:41.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.210+0000 7f9837fff640 1 -- 172.21.15.88:0/2106178561 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f9844029020 con 0x7f98500b9d90 2024-01-22T10:12:41.192 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:41.193 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:12:40.981632+0000","last_up_change":"0.000000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:12:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.211+0000 7f9855e87640 1 -- 172.21.15.88:0/2106178561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98500b9d90 msgr2=0x7f98501489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.211+0000 7f9855e87640 1 --2- 172.21.15.88:0/2106178561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98500b9d90 0x7f98501489b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f984400e8a0 tx=0x7f984400ed60 comp rx=0 tx=0).stop 2024-01-22T10:12:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.211+0000 7f9855e87640 1 -- 172.21.15.88:0/2106178561 shutdown_connections 2024-01-22T10:12:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.211+0000 7f9855e87640 1 --2- 172.21.15.88:0/2106178561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f985014ece0 0x7f98501e4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.211+0000 7f9855e87640 1 --2- 172.21.15.88:0/2106178561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98500ba170 0x7f98500b8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.211+0000 7f9855e87640 1 --2- 172.21.15.88:0/2106178561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98500b9d90 0x7f98501489b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.211+0000 7f9855e87640 1 -- 172.21.15.88:0/2106178561 >> 172.21.15.88:0/2106178561 conn(0x7f98500bdbf0 msgr2=0x7f98500b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.211+0000 7f9855e87640 1 -- 172.21.15.88:0/2106178561 shutdown_connections 2024-01-22T10:12:41.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:41.211+0000 7f9855e87640 1 -- 172.21.15.88:0/2106178561 wait complete. 2024-01-22T10:12:41.208 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-22T10:12:41.208 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-22T10:12:41.236 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:41.253+0000 7fd35464c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-22T10:12:41.259 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:41.277+0000 7f667da40040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-22T10:12:41.301 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:41.318+0000 7f667da40040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-22T10:12:41.375 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:41.392+0000 7fd35464c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-22T10:12:41.418 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:41.435+0000 7fd35464c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-22T10:12:41.442 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:41.459+0000 7f667da40040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-22T10:12:41.556 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:41.573+0000 7fd35464c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-22T10:12:41.593 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-01-22T10:12:41.610+0000 7fcc407bb640 -1 Falling back to public interface 2024-01-22T10:12:41.594 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-01-22T10:12:41.612+0000 7fc5dec15640 -1 Falling back to public interface 2024-01-22T10:12:41.596 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-01-22T10:12:41.613+0000 7fd4b00a6640 -1 Falling back to public interface 2024-01-22T10:12:41.599 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-01-22T10:12:41.616+0000 7f73b959a640 -1 Falling back to public interface 2024-01-22T10:12:41.599 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-01-22T10:12:41.617+0000 7f2e00338640 -1 Falling back to public interface 2024-01-22T10:12:41.603 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-01-22T10:12:41.620+0000 7efd89c37640 -1 Falling back to public interface 2024-01-22T10:12:41.610 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-01-22T10:12:41.627+0000 7f24084c4640 -1 Falling back to public interface 2024-01-22T10:12:41.611 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-01-22T10:12:41.628+0000 7f332020d640 -1 Falling back to public interface 2024-01-22T10:12:42.013 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-22T10:12:42.102 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.119+0000 7f4d092ec640 1 Processor -- start 2024-01-22T10:12:42.102 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.119+0000 7f4d092ec640 1 -- start start 2024-01-22T10:12:42.104 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d092ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d0414b8a0 0x7f4d040b9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:42.104 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d092ec640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0406ed30 con 0x7f4d041540f0 2024-01-22T10:12:42.104 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d092ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0414f830 con 0x7f4d04071f40 2024-01-22T10:12:42.104 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d092ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0414fcc0 con 0x7f4d0414b8a0 2024-01-22T10:12:42.104 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d037fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4d041540f0 0x7f4d041564e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35466/0 (socket says 172.21.15.88:35466) 2024-01-22T10:12:42.104 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d037fe640 1 -- 172.21.15.88:0/634931673 learned_addr learned my addr 172.21.15.88:0/634931673 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:12:42.104 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d027fc640 1 --2- 172.21.15.88:0/634931673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d0414b8a0 0x7f4d040b9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:42.104 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d01ffb640 1 -- 172.21.15.88:0/634931673 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826914676 0 0) 0x7f4cfc001490 con 0x7f4d041540f0 2024-01-22T10:12:42.105 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d01ffb640 1 -- 172.21.15.88:0/634931673 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cec003520 con 0x7f4d041540f0 2024-01-22T10:12:42.105 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d01ffb640 1 -- 172.21.15.88:0/634931673 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437472733 0 0) 0x7f4d0414f830 con 0x7f4d04071f40 2024-01-22T10:12:42.105 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d01ffb640 1 -- 172.21.15.88:0/634931673 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cfc001490 con 0x7f4d04071f40 2024-01-22T10:12:42.105 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d027fc640 1 -- 172.21.15.88:0/634931673 >> v1:172.21.15.119:6789/0 conn(0x7f4d04071f40 legacy=0x7f4d0406e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:42.105 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d027fc640 1 -- 172.21.15.88:0/634931673 >> v1:172.21.15.88:6789/0 conn(0x7f4d041540f0 legacy=0x7f4d041564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:42.105 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.120+0000 7f4d027fc640 1 -- 172.21.15.88:0/634931673 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0414c020 con 0x7f4d0414b8a0 2024-01-22T10:12:42.105 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.121+0000 7f4d027fc640 1 --2- 172.21.15.88:0/634931673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d0414b8a0 0x7f4d040b9820 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40097d0 tx=0x7f4cf402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f652ac2a82035296 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:42.105 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.121+0000 7f4d01ffb640 1 -- 172.21.15.88:0/634931673 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4031800 con 0x7f4d0414b8a0 2024-01-22T10:12:42.105 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.121+0000 7f4d01ffb640 1 -- 172.21.15.88:0/634931673 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4031960 con 0x7f4d0414b8a0 2024-01-22T10:12:42.105 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.121+0000 7f4d01ffb640 1 -- 172.21.15.88:0/634931673 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4031cf0 con 0x7f4d0414b8a0 2024-01-22T10:12:42.108 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.122+0000 7f4d092ec640 1 -- 172.21.15.88:0/634931673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d0414b8a0 msgr2=0x7f4d040b9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:42.108 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.122+0000 7f4d092ec640 1 --2- 172.21.15.88:0/634931673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d0414b8a0 0x7f4d040b9820 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40097d0 tx=0x7f4cf402b8a0 comp rx=0 tx=0).stop 2024-01-22T10:12:42.108 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.122+0000 7f4d092ec640 1 -- 172.21.15.88:0/634931673 shutdown_connections 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.122+0000 7f4d092ec640 1 --2- 172.21.15.88:0/634931673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d0414b8a0 0x7f4d040b9820 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.122+0000 7f4d092ec640 1 -- 172.21.15.88:0/634931673 >> 172.21.15.88:0/634931673 conn(0x7f4d040ba910 msgr2=0x7f4d040bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.122+0000 7f4d092ec640 1 -- 172.21.15.88:0/634931673 shutdown_connections 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.122+0000 7f4d092ec640 1 -- 172.21.15.88:0/634931673 wait complete. 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.123+0000 7f4d092ec640 1 Processor -- start 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.123+0000 7f4d092ec640 1 -- start start 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d092ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d04071f40 0x7f4d041e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d092ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d0414b8a0 0x7f4d041e09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d092ec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d041540f0 0x7f4d04070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d092ec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040711f0 con 0x7f4d041540f0 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d092ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041503a0 con 0x7f4d0414b8a0 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d092ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041e3fb0 con 0x7f4d04071f40 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d037fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d041540f0 0x7f4d04070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d037fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d041540f0 0x7f4d04070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49840/0 (socket says 172.21.15.88:49840) 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d037fe640 1 -- 172.21.15.88:0/1702832684 learned_addr learned my addr 172.21.15.88:0/1702832684 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:12:42.109 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d027fc640 1 --2- 172.21.15.88:0/1702832684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d0414b8a0 0x7f4d041e09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d02ffd640 1 --2- 172.21.15.88:0/1702832684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d04071f40 0x7f4d041e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d037fe640 1 -- 172.21.15.88:0/1702832684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d04071f40 msgr2=0x7f4d041e4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d037fe640 1 --2- 172.21.15.88:0/1702832684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d04071f40 0x7f4d041e4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d037fe640 1 -- 172.21.15.88:0/1702832684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d0414b8a0 msgr2=0x7f4d041e09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d037fe640 1 --2- 172.21.15.88:0/1702832684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d0414b8a0 0x7f4d041e09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d037fe640 1 -- 172.21.15.88:0/1702832684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4009400 con 0x7f4d041540f0 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d037fe640 1 --2- 172.21.15.88:0/1702832684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d041540f0 0x7f4d04070cb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc001f30 tx=0x7f4cfc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4ceb7fe640 1 -- 172.21.15.88:0/1702832684 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc012400 con 0x7f4d041540f0 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4ceb7fe640 1 -- 172.21.15.88:0/1702832684 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc012580 con 0x7f4d041540f0 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.124+0000 7f4d092ec640 1 -- 172.21.15.88:0/1702832684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d041e4250 con 0x7f4d041540f0 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.125+0000 7f4ceb7fe640 1 -- 172.21.15.88:0/1702832684 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc012970 con 0x7f4d041540f0 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.125+0000 7f4d092ec640 1 -- 172.21.15.88:0/1702832684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0414c980 con 0x7f4d041540f0 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.125+0000 7f4ceb7fe640 1 -- 172.21.15.88:0/1702832684 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f4cfc01c440 con 0x7f4d041540f0 2024-01-22T10:12:42.110 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.125+0000 7f4ceb7fe640 1 -- 172.21.15.88:0/1702832684 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4cfc007880 con 0x7f4d041540f0 2024-01-22T10:12:42.111 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.125+0000 7f4d092ec640 1 -- 172.21.15.88:0/1702832684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d041e4770 con 0x7f4d041540f0 2024-01-22T10:12:42.111 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.128+0000 7f4ceb7fe640 1 -- 172.21.15.88:0/1702832684 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f4d041e4770 con 0x7f4d041540f0 2024-01-22T10:12:42.171 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.189+0000 7f4d092ec640 1 -- 172.21.15.88:0/1702832684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d0404eaa0 con 0x7f4d041540f0 2024-01-22T10:12:42.172 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.189+0000 7f4ceb7fe640 1 -- 172.21.15.88:0/1702832684 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f4cfc017070 con 0x7f4d041540f0 2024-01-22T10:12:42.172 INFO:teuthology.misc.health.smithi088.stdout: 2024-01-22T10:12:42.172 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":10,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:12:40.981632+0000","last_up_change":"0.000000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:12:42.173 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.190+0000 7f4d092ec640 1 -- 172.21.15.88:0/1702832684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d041540f0 msgr2=0x7f4d04070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:42.173 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.190+0000 7f4d092ec640 1 --2- 172.21.15.88:0/1702832684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d041540f0 0x7f4d04070cb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc001f30 tx=0x7f4cfc00a430 comp rx=0 tx=0).stop 2024-01-22T10:12:42.173 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.190+0000 7f4d092ec640 1 -- 172.21.15.88:0/1702832684 shutdown_connections 2024-01-22T10:12:42.173 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.190+0000 7f4d092ec640 1 --2- 172.21.15.88:0/1702832684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d041540f0 0x7f4d04070cb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:42.173 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.190+0000 7f4d092ec640 1 --2- 172.21.15.88:0/1702832684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d0414b8a0 0x7f4d041e09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:42.173 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.190+0000 7f4d092ec640 1 --2- 172.21.15.88:0/1702832684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d04071f40 0x7f4d041e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:42.174 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.190+0000 7f4d092ec640 1 -- 172.21.15.88:0/1702832684 >> 172.21.15.88:0/1702832684 conn(0x7f4d040ba910 msgr2=0x7f4d040b98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:42.174 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.190+0000 7f4d092ec640 1 -- 172.21.15.88:0/1702832684 shutdown_connections 2024-01-22T10:12:42.174 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:42.190+0000 7f4d092ec640 1 -- 172.21.15.88:0/1702832684 wait complete. 2024-01-22T10:12:42.182 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-22T10:12:42.241 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:42.259+0000 7f667da40040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-22T10:12:42.352 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:42.369+0000 7fd35464c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-22T10:12:42.512 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:42.529+0000 7f667da40040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-22T10:12:42.562 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:42.579+0000 7f667da40040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-22T10:12:42.622 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:42.639+0000 7fd35464c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-22T10:12:42.662 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:42.679+0000 7f667da40040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-22T10:12:42.673 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:42.690+0000 7fd35464c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-22T10:12:42.779 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-01-22T10:12:42.796+0000 7fd35464c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-22T10:12:43.693 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:43.710+0000 7f661edc2640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-22T10:12:43.693 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-01-22T10:12:43.710+0000 7f661edc2640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-22T10:12:45.041 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-01-22T10:12:45.058+0000 7fc5dec15640 -1 osd.4 0 log_to_monitors true 2024-01-22T10:12:45.077 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-01-22T10:12:45.094+0000 7efd89c37640 -1 osd.2 0 log_to_monitors true 2024-01-22T10:12:45.086 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-01-22T10:12:45.104+0000 7fd4b00a6640 -1 osd.5 0 log_to_monitors true 2024-01-22T10:12:45.106 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-01-22T10:12:45.124+0000 7f2e00338640 -1 osd.3 0 log_to_monitors true 2024-01-22T10:12:45.108 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-01-22T10:12:45.126+0000 7fcc407bb640 -1 osd.0 0 log_to_monitors true 2024-01-22T10:12:45.119 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-01-22T10:12:45.136+0000 7f73b959a640 -1 osd.1 0 log_to_monitors true 2024-01-22T10:12:45.126 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-01-22T10:12:45.144+0000 7f24084c4640 -1 osd.7 0 log_to_monitors true 2024-01-22T10:12:45.157 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-01-22T10:12:45.174+0000 7f332020d640 -1 osd.6 0 log_to_monitors true 2024-01-22T10:12:48.757 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-01-22T10:12:48.774+0000 7f73b4d07640 -1 osd.1 0 waiting for initial osdmap 2024-01-22T10:12:48.762 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-01-22T10:12:48.780+0000 7f2dfbaa5640 -1 osd.3 0 waiting for initial osdmap 2024-01-22T10:12:48.770 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-01-22T10:12:48.788+0000 7f73ad340640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T10:12:48.775 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-01-22T10:12:48.793+0000 7f2df40de640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T10:12:48.797 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-01-22T10:12:48.814+0000 7f2403c31640 -1 osd.7 0 waiting for initial osdmap 2024-01-22T10:12:48.803 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-01-22T10:12:48.821+0000 7f331b97a640 -1 osd.6 0 waiting for initial osdmap 2024-01-22T10:12:48.804 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-01-22T10:12:48.822+0000 7fc5d9d9e640 -1 osd.4 0 waiting for initial osdmap 2024-01-22T10:12:48.811 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-01-22T10:12:48.829+0000 7f23fc26a640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T10:12:48.813 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-01-22T10:12:48.830+0000 7efd853a4640 -1 osd.2 0 waiting for initial osdmap 2024-01-22T10:12:48.816 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-01-22T10:12:48.834+0000 7f3313fb3640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T10:12:48.826 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-01-22T10:12:48.844+0000 7fc5d23d7640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T10:12:48.829 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-01-22T10:12:48.847+0000 7efd7d9dd640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T10:12:48.830 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-01-22T10:12:48.848+0000 7fcc3d760640 -1 osd.0 0 waiting for initial osdmap 2024-01-22T10:12:48.846 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-01-22T10:12:48.864+0000 7fcc34561640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T10:12:48.851 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-01-22T10:12:48.868+0000 7fd4ab813640 -1 osd.5 0 waiting for initial osdmap 2024-01-22T10:12:48.863 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-01-22T10:12:48.881+0000 7fd4a3e4c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-22T10:12:48.989 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-22T10:12:49.077 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.094+0000 7f65e3c75640 1 Processor -- start 2024-01-22T10:12:49.077 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.094+0000 7f65e3c75640 1 -- start start 2024-01-22T10:12:49.079 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.095+0000 7f65e3c75640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc072430 0x7f65dc06bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:49.079 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.095+0000 7f65e3c75640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65dc145680 0x7f65dc145b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:49.079 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.095+0000 7f65e3c75640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65dc146050 con 0x7f65dc071920 2024-01-22T10:12:49.079 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.095+0000 7f65e3c75640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65dc06cdd0 con 0x7f65dc145680 2024-01-22T10:12:49.079 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.095+0000 7f65e3c75640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc0bae80 con 0x7f65dc072430 2024-01-22T10:12:49.079 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.095+0000 7f65e2212640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65dc145680 0x7f65dc145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:49.079 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.095+0000 7f65e1a11640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f65dc071920 0x7f65dc14b890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34766/0 (socket says 172.21.15.88:34766) 2024-01-22T10:12:49.079 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.095+0000 7f65e1a11640 1 -- 172.21.15.88:0/573515157 learned_addr learned my addr 172.21.15.88:0/573515157 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:12:49.079 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.095+0000 7f65e2212640 1 --2- 172.21.15.88:0/573515157 >> v2:172.21.15.88:3300/0 conn(0x7f65dc145680 0x7f65dc145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44124/0 (socket says 172.21.15.88:44124) 2024-01-22T10:12:49.080 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.095+0000 7f65e1210640 1 --2- 172.21.15.88:0/573515157 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc072430 0x7f65dc06bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:49.080 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.096+0000 7f65e2212640 1 -- 172.21.15.88:0/573515157 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc072430 msgr2=0x7f65dc06bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:49.080 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.096+0000 7f65e2212640 1 --2- 172.21.15.88:0/573515157 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc072430 0x7f65dc06bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:49.080 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.096+0000 7f65e2212640 1 -- 172.21.15.88:0/573515157 >> v1:172.21.15.88:6789/0 conn(0x7f65dc071920 legacy=0x7f65dc14b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:49.080 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.096+0000 7f65e2212640 1 -- 172.21.15.88:0/573515157 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc0bb0d0 con 0x7f65dc145680 2024-01-22T10:12:49.080 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.096+0000 7f65e0a0f640 1 -- 172.21.15.88:0/573515157 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246350105 0 0) 0x7f65dc146050 con 0x7f65dc071920 2024-01-22T10:12:49.080 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.096+0000 7f65e2212640 1 --2- 172.21.15.88:0/573515157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc145680 0x7f65dc145b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009d90 tx=0x7f65d402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cec44726360eb0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:49.080 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.096+0000 7f65e0a0f640 1 -- 172.21.15.88:0/573515157 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d402cbc0 con 0x7f65dc145680 2024-01-22T10:12:49.080 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.096+0000 7f65e0a0f640 1 -- 172.21.15.88:0/573515157 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d402cd20 con 0x7f65dc145680 2024-01-22T10:12:49.080 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.096+0000 7f65e0a0f640 1 -- 172.21.15.88:0/573515157 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4034660 con 0x7f65dc145680 2024-01-22T10:12:49.083 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.097+0000 7f65e3c75640 1 -- 172.21.15.88:0/573515157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc145680 msgr2=0x7f65dc145b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:49.083 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.097+0000 7f65e3c75640 1 --2- 172.21.15.88:0/573515157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc145680 0x7f65dc145b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009d90 tx=0x7f65d402be10 comp rx=0 tx=0).stop 2024-01-22T10:12:49.083 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.097+0000 7f65e3c75640 1 -- 172.21.15.88:0/573515157 shutdown_connections 2024-01-22T10:12:49.083 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.097+0000 7f65e3c75640 1 --2- 172.21.15.88:0/573515157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc145680 0x7f65dc145b10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:49.083 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.097+0000 7f65e3c75640 1 --2- 172.21.15.88:0/573515157 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc072430 0x7f65dc06bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:49.083 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.097+0000 7f65e3c75640 1 -- 172.21.15.88:0/573515157 >> 172.21.15.88:0/573515157 conn(0x7f65dc0befb0 msgr2=0x7f65dc0bf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:49.083 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.097+0000 7f65e3c75640 1 -- 172.21.15.88:0/573515157 shutdown_connections 2024-01-22T10:12:49.083 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.097+0000 7f65e3c75640 1 -- 172.21.15.88:0/573515157 wait complete. 2024-01-22T10:12:49.083 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.098+0000 7f65e3c75640 1 Processor -- start 2024-01-22T10:12:49.084 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.098+0000 7f65e3c75640 1 -- start start 2024-01-22T10:12:49.084 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e3c75640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc071920 0x7f65dc0b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:49.084 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e3c75640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc072430 0x7f65dc1483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:49.084 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e3c75640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65dc145680 0x7f65dc140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:49.084 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e3c75640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc0b0bb0 con 0x7f65dc072430 2024-01-22T10:12:49.084 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e3c75640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc0b7ce0 con 0x7f65dc145680 2024-01-22T10:12:49.084 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e3c75640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc0b8730 con 0x7f65dc071920 2024-01-22T10:12:49.084 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e1210640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc072430 0x7f65dc1483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:49.084 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e1210640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc072430 0x7f65dc1483b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44128/0 (socket says 172.21.15.88:44128) 2024-01-22T10:12:49.084 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e1210640 1 -- 172.21.15.88:0/452460754 learned_addr learned my addr 172.21.15.88:0/452460754 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:12:49.084 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e1a11640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc071920 0x7f65dc0b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:49.084 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e2212640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65dc145680 0x7f65dc140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:49.085 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e1210640 1 -- 172.21.15.88:0/452460754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc071920 msgr2=0x7f65dc0b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:49.085 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e1210640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc071920 0x7f65dc0b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:49.085 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e1210640 1 -- 172.21.15.88:0/452460754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65dc145680 msgr2=0x7f65dc140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:49.085 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e1210640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65dc145680 0x7f65dc140d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:49.085 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e1210640 1 -- 172.21.15.88:0/452460754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d4009a70 con 0x7f65dc072430 2024-01-22T10:12:49.085 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e1210640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc072430 0x7f65dc1483b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f65d800e9b0 tx=0x7f65d800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:49.085 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65d27fc640 1 -- 172.21.15.88:0/452460754 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8009670 con 0x7f65dc072430 2024-01-22T10:12:49.085 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65d27fc640 1 -- 172.21.15.88:0/452460754 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d800c9a0 con 0x7f65dc072430 2024-01-22T10:12:49.085 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e3c75640 1 -- 172.21.15.88:0/452460754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65dc0af310 con 0x7f65dc072430 2024-01-22T10:12:49.085 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65d27fc640 1 -- 172.21.15.88:0/452460754 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d800cd50 con 0x7f65dc072430 2024-01-22T10:12:49.085 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.099+0000 7f65e3c75640 1 -- 172.21.15.88:0/452460754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65dc0af8d0 con 0x7f65dc072430 2024-01-22T10:12:49.085 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.100+0000 7f65e3c75640 1 -- 172.21.15.88:0/452460754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65dc066d60 con 0x7f65dc072430 2024-01-22T10:12:49.086 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.101+0000 7f65d27fc640 1 -- 172.21.15.88:0/452460754 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 89460+0+0 (secure 0 0 0) 0x7f65d8013470 con 0x7f65dc072430 2024-01-22T10:12:49.086 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.101+0000 7f65d27fc640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f65c006b2d0 0x7f65c006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:49.086 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.101+0000 7f65e1a11640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f65c006b2d0 0x7f65c006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:49.086 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.101+0000 7f65d27fc640 1 -- 172.21.15.88:0/452460754 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f65d8088fb0 con 0x7f65dc072430 2024-01-22T10:12:49.086 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.101+0000 7f65e1a11640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f65c006b2d0 0x7f65c006d790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f65cc007fd0 tx=0x7f65cc007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:49.088 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.106+0000 7f65d27fc640 1 -- 172.21.15.88:0/452460754 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f65d80bc0d0 con 0x7f65dc072430 2024-01-22T10:12:49.257 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.274+0000 7f65e3c75640 1 -- 172.21.15.88:0/452460754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65dc04eaa0 con 0x7f65dc072430 2024-01-22T10:12:49.257 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.274+0000 7f65d27fc640 1 -- 172.21.15.88:0/452460754 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f65d8021020 con 0x7f65dc072430 2024-01-22T10:12:49.258 INFO:teuthology.misc.health.smithi088.stdout: 2024-01-22T10:12:49.258 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":12,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:12:46.754501+0000","last_up_change":"0.000000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:12:49.259 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.276+0000 7f65e3c75640 1 -- 172.21.15.88:0/452460754 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f65c006b2d0 msgr2=0x7f65c006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:49.260 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.276+0000 7f65e3c75640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f65c006b2d0 0x7f65c006d790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f65cc007fd0 tx=0x7f65cc007de0 comp rx=0 tx=0).stop 2024-01-22T10:12:49.260 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.276+0000 7f65e3c75640 1 -- 172.21.15.88:0/452460754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc072430 msgr2=0x7f65dc1483b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:49.260 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.276+0000 7f65e3c75640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc072430 0x7f65dc1483b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f65d800e9b0 tx=0x7f65d800ee70 comp rx=0 tx=0).stop 2024-01-22T10:12:49.260 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.276+0000 7f65e3c75640 1 -- 172.21.15.88:0/452460754 shutdown_connections 2024-01-22T10:12:49.260 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.276+0000 7f65e3c75640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f65c006b2d0 0x7f65c006d790 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:49.260 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.276+0000 7f65e3c75640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65dc145680 0x7f65dc140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:49.260 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.276+0000 7f65e3c75640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65dc072430 0x7f65dc1483b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:49.260 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.276+0000 7f65e3c75640 1 --2- 172.21.15.88:0/452460754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc071920 0x7f65dc0b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:49.260 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.276+0000 7f65e3c75640 1 -- 172.21.15.88:0/452460754 >> 172.21.15.88:0/452460754 conn(0x7f65dc0befb0 msgr2=0x7f65dc066550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:49.260 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.276+0000 7f65e3c75640 1 -- 172.21.15.88:0/452460754 shutdown_connections 2024-01-22T10:12:49.260 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:49.276+0000 7f65e3c75640 1 -- 172.21.15.88:0/452460754 wait complete. 2024-01-22T10:12:49.268 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-22T10:12:56.077 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-22T10:12:56.176 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.193+0000 7f8f4a49b640 1 Processor -- start 2024-01-22T10:12:56.176 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.193+0000 7f8f4a49b640 1 -- start start 2024-01-22T10:12:56.180 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f4a49b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f440b3270 0x7f8f441489e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.180 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f4a49b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8f440b8a90 0x7f8f44148f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.180 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f4a49b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f44148530 con 0x7f8f4406d120 2024-01-22T10:12:56.180 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f4a49b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f440b3790 con 0x7f8f440b8a90 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f4a49b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440b3a70 con 0x7f8f440b3270 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f43fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8f4406d120 0x7f8f44142330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34774/0 (socket says 172.21.15.88:34774) 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f43fff640 1 -- 172.21.15.88:0/817527858 learned_addr learned my addr 172.21.15.88:0/817527858 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552339392 0 0) 0x7f8f44148530 con 0x7f8f4406d120 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f48a38640 1 --2- 172.21.15.88:0/817527858 >> v2:172.21.15.119:3300/0 conn(0x7f8f440b8a90 0x7f8f44148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f2c005730 con 0x7f8f4406d120 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f437fe640 1 --2- 172.21.15.88:0/817527858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f440b3270 0x7f8f441489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3250075338 0 0) 0x7f8f2c005730 con 0x7f8f4406d120 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f440b3270 msgr2=0x7f8f441489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f42ffd640 1 --2- 172.21.15.88:0/817527858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f440b3270 0x7f8f441489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 >> v2:172.21.15.119:3300/0 conn(0x7f8f440b8a90 msgr2=0x7f8f44148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f42ffd640 1 --2- 172.21.15.88:0/817527858 >> v2:172.21.15.119:3300/0 conn(0x7f8f440b8a90 0x7f8f44148f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4406b5a0 con 0x7f8f4406d120 2024-01-22T10:12:56.181 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f8f34001670 con 0x7f8f4406d120 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.194+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 >> v1:172.21.15.88:6789/0 conn(0x7f8f4406d120 legacy=0x7f8f44142330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f42ffd640 1 --2- 172.21.15.88:0/817527858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f2c005bf0 0x7f8f2c006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f42ffd640 1 --2- 172.21.15.88:0/817527858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f440b3270 0x7f8f2c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f42ffd640 1 --2- 172.21.15.88:0/817527858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c006f10 0x7f8f2c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440b3790 con 0x7f8f2c006f10 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440b3a70 con 0x7f8f2c005bf0 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c00dc10 con 0x7f8f440b3270 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f48a38640 1 --2- 172.21.15.88:0/817527858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c006f10 0x7f8f2c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f43fff640 1 --2- 172.21.15.88:0/817527858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f2c005bf0 0x7f8f2c006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f437fe640 1 --2- 172.21.15.88:0/817527858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f440b3270 0x7f8f2c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f48a38640 1 -- 172.21.15.88:0/817527858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f440b3270 msgr2=0x7f8f2c0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f48a38640 1 --2- 172.21.15.88:0/817527858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f440b3270 0x7f8f2c0069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f48a38640 1 -- 172.21.15.88:0/817527858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f2c005bf0 msgr2=0x7f8f2c006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:56.182 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f48a38640 1 --2- 172.21.15.88:0/817527858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f2c005bf0 0x7f8f2c006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.195+0000 7f8f48a38640 1 -- 172.21.15.88:0/817527858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c005730 con 0x7f8f2c006f10 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.196+0000 7f8f48a38640 1 --2- 172.21.15.88:0/817527858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c006f10 0x7f8f2c007390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009fc0 tx=0x7f8f2c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ed142b13da2b85 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.196+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c02cc60 con 0x7f8f2c006f10 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.196+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c00f040 con 0x7f8f2c006f10 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.196+0000 7f8f42ffd640 1 -- 172.21.15.88:0/817527858 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c034440 con 0x7f8f2c006f10 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.196+0000 7f8f4a49b640 1 -- 172.21.15.88:0/817527858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c006f10 msgr2=0x7f8f2c007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.196+0000 7f8f4a49b640 1 --2- 172.21.15.88:0/817527858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c006f10 0x7f8f2c007390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009fc0 tx=0x7f8f2c007a00 comp rx=0 tx=0).stop 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.196+0000 7f8f48a38640 1 -- 172.21.15.88:0/817527858 reap_dead start 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.196+0000 7f8f4a49b640 1 -- 172.21.15.88:0/817527858 shutdown_connections 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.196+0000 7f8f4a49b640 1 -- 172.21.15.88:0/817527858 >> 172.21.15.88:0/817527858 conn(0x7f8f4406a6f0 msgr2=0x7f8f4406ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.196+0000 7f8f4a49b640 1 -- 172.21.15.88:0/817527858 shutdown_connections 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.196+0000 7f8f4a49b640 1 -- 172.21.15.88:0/817527858 wait complete. 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.197+0000 7f8f4a49b640 1 Processor -- start 2024-01-22T10:12:56.183 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.198+0000 7f8f4a49b640 1 -- start start 2024-01-22T10:12:56.186 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.198+0000 7f8f4a49b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f440bb040 0x7f8f441d0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.186 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.198+0000 7f8f4a49b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f441d0c50 0x7f8f441e11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.186 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.198+0000 7f8f4a49b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f441e1700 0x7f8f4413ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.186 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.198+0000 7f8f4a49b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f441ce500 con 0x7f8f440bb040 2024-01-22T10:12:56.186 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.198+0000 7f8f4a49b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f441e1b80 con 0x7f8f441e1700 2024-01-22T10:12:56.186 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.198+0000 7f8f4a49b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f441d11e0 con 0x7f8f441d0c50 2024-01-22T10:12:56.186 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.198+0000 7f8f43fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f440bb040 0x7f8f441d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.186 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.198+0000 7f8f43fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f440bb040 0x7f8f441d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44178/0 (socket says 172.21.15.88:44178) 2024-01-22T10:12:56.186 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.198+0000 7f8f43fff640 1 -- 172.21.15.88:0/1328415498 learned_addr learned my addr 172.21.15.88:0/1328415498 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:12:56.186 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f437fe640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f441d0c50 0x7f8f441e11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f43fff640 1 -- 172.21.15.88:0/1328415498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f441d0c50 msgr2=0x7f8f441e11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f43fff640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f441d0c50 0x7f8f441e11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f48a38640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f441e1700 0x7f8f4413ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f43fff640 1 -- 172.21.15.88:0/1328415498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f441e1700 msgr2=0x7f8f4413ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f43fff640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f441e1700 0x7f8f4413ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f43fff640 1 -- 172.21.15.88:0/1328415498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44147d30 con 0x7f8f440bb040 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f48a38640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f441e1700 0x7f8f4413ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f43fff640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f440bb040 0x7f8f441d0710 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8f340072f0 tx=0x7f8f340077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f40ff9640 1 -- 172.21.15.88:0/1328415498 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3400f960 con 0x7f8f440bb040 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f40ff9640 1 -- 172.21.15.88:0/1328415498 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3400fac0 con 0x7f8f440bb040 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f4a49b640 1 -- 172.21.15.88:0/1328415498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f441ce750 con 0x7f8f440bb040 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f40ff9640 1 -- 172.21.15.88:0/1328415498 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3400fe50 con 0x7f8f440bb040 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.199+0000 7f8f4a49b640 1 -- 172.21.15.88:0/1328415498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f441ced10 con 0x7f8f440bb040 2024-01-22T10:12:56.187 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.200+0000 7f8f4a49b640 1 -- 172.21.15.88:0/1328415498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4404eaa0 con 0x7f8f440bb040 2024-01-22T10:12:56.188 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.200+0000 7f8f40ff9640 1 -- 172.21.15.88:0/1328415498 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f8f3401d460 con 0x7f8f440bb040 2024-01-22T10:12:56.188 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.201+0000 7f8f40ff9640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f8f3006b330 0x7f8f3006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.188 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.201+0000 7f8f437fe640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f8f3006b330 0x7f8f3006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.188 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.201+0000 7f8f40ff9640 1 -- 172.21.15.88:0/1328415498 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8f34089a80 con 0x7f8f440bb040 2024-01-22T10:12:56.188 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.201+0000 7f8f437fe640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f8f3006b330 0x7f8f3006d7f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8f441474d0 tx=0x7f8f38008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:56.188 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.205+0000 7f8f40ff9640 1 -- 172.21.15.88:0/1328415498 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8f34054af0 con 0x7f8f440bb040 2024-01-22T10:12:56.358 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.376+0000 7f8f4a49b640 1 -- 172.21.15.88:0/1328415498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f4406b380 con 0x7f8f440bb040 2024-01-22T10:12:56.359 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.377+0000 7f8f40ff9640 1 -- 172.21.15.88:0/1328415498 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12827 (secure 0 0 0) 0x7f8f34058110 con 0x7f8f440bb040 2024-01-22T10:12:56.360 INFO:teuthology.misc.health.smithi088.stdout: 2024-01-22T10:12:56.360 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":16,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:12:53.027434+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:12:56.362 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.379+0000 7f8f4a49b640 1 -- 172.21.15.88:0/1328415498 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f8f3006b330 msgr2=0x7f8f3006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.362 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.379+0000 7f8f4a49b640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f8f3006b330 0x7f8f3006d7f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8f441474d0 tx=0x7f8f38008040 comp rx=0 tx=0).stop 2024-01-22T10:12:56.362 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.379+0000 7f8f4a49b640 1 -- 172.21.15.88:0/1328415498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f440bb040 msgr2=0x7f8f441d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.362 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.379+0000 7f8f4a49b640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f440bb040 0x7f8f441d0710 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8f340072f0 tx=0x7f8f340077b0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.362 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.379+0000 7f8f4a49b640 1 -- 172.21.15.88:0/1328415498 shutdown_connections 2024-01-22T10:12:56.362 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.379+0000 7f8f4a49b640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f8f3006b330 0x7f8f3006d7f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.362 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.379+0000 7f8f4a49b640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f441d0c50 0x7f8f441e11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.362 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.379+0000 7f8f4a49b640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f441e1700 0x7f8f4413ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.362 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.379+0000 7f8f4a49b640 1 --2- 172.21.15.88:0/1328415498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f440bb040 0x7f8f441d0710 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.362 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.379+0000 7f8f4a49b640 1 -- 172.21.15.88:0/1328415498 >> 172.21.15.88:0/1328415498 conn(0x7f8f4406a6f0 msgr2=0x7f8f44142100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:56.362 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.379+0000 7f8f4a49b640 1 -- 172.21.15.88:0/1328415498 shutdown_connections 2024-01-22T10:12:56.363 INFO:teuthology.misc.health.smithi088.stderr:2024-01-22T10:12:56.379+0000 7f8f4a49b640 1 -- 172.21.15.88:0/1328415498 wait complete. 2024-01-22T10:12:56.371 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-22T10:12:56.371 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-22T10:12:56.371 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T10:12:56.372 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T10:12:56.374 INFO:tasks.ceph.mds.a:Started 2024-01-22T10:12:56.374 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T10:12:56.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T10:12:56.376 INFO:tasks.ceph.mds.c:Started 2024-01-22T10:12:56.376 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T10:12:56.376 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T10:12:56.379 INFO:tasks.ceph.mds.b:Started 2024-01-22T10:12:56.379 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-22T10:12:56.379 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:12:56.449 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2024-01-22T10:12:56.450 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2024-01-22T10:12:56.450 INFO:tasks.ceph.mds.c.smithi088.stderr:2024-01-22T10:12:56.468+0000 7f10b5146640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-01-22T10:12:56.463 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2024-01-22T10:12:56.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.500+0000 7f1d6d0bb640 1 Processor -- start 2024-01-22T10:12:56.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.500+0000 7f1d6d0bb640 1 -- start start 2024-01-22T10:12:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d6d0bb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1d6814f3f0 0x7f1d6806a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d6d0bb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d680b8040 con 0x7f1d680b9d90 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d6d0bb640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6806ae10 con 0x7f1d680ba170 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d6d0bb640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6806ac30 con 0x7f1d6814f3f0 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d66d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1d680b9d90 0x7f1d680b7930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34798/0 (socket says 172.21.15.88:34798) 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d66d9d640 1 -- 172.21.15.88:0/2881526456 learned_addr learned my addr 172.21.15.88:0/2881526456 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688510197 0 0) 0x7f1d680b8040 con 0x7f1d680b9d90 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d50003520 con 0x7f1d680b9d90 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d6759e640 1 --2- 172.21.15.88:0/2881526456 >> v2:172.21.15.119:3300/0 conn(0x7f1d6814f3f0 0x7f1d6806a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1810136092 0 0) 0x7f1d50003520 con 0x7f1d680b9d90 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 >> v2:172.21.15.119:3300/0 conn(0x7f1d6814f3f0 msgr2=0x7f1d6806a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d65d9b640 1 --2- 172.21.15.88:0/2881526456 >> v2:172.21.15.119:3300/0 conn(0x7f1d6814f3f0 0x7f1d6806a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 >> v1:172.21.15.119:6789/0 conn(0x7f1d680ba170 legacy=0x7f1d6814ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d68070b20 con 0x7f1d680b9d90 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.501+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f1d60001670 con 0x7f1d680b9d90 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 >> v1:172.21.15.88:6789/0 conn(0x7f1d680b9d90 legacy=0x7f1d680b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d65d9b640 1 --2- 172.21.15.88:0/2881526456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d50003a50 0x7f1d50003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d65d9b640 1 --2- 172.21.15.88:0/2881526456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d500047c0 0x7f1d50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d65d9b640 1 --2- 172.21.15.88:0/2881526456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d500052a0 0x7f1d5000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6806ac30 con 0x7f1d500052a0 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5000c1a0 con 0x7f1d500047c0 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5000c360 con 0x7f1d50003a50 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d6759e640 1 --2- 172.21.15.88:0/2881526456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d500052a0 0x7f1d5000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d6659c640 1 --2- 172.21.15.88:0/2881526456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d500047c0 0x7f1d50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d66d9d640 1 --2- 172.21.15.88:0/2881526456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d50003a50 0x7f1d50003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d6759e640 1 -- 172.21.15.88:0/2881526456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d50003a50 msgr2=0x7f1d50003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d6759e640 1 --2- 172.21.15.88:0/2881526456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d50003a50 0x7f1d50003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d6759e640 1 -- 172.21.15.88:0/2881526456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d500047c0 msgr2=0x7f1d50004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d6759e640 1 --2- 172.21.15.88:0/2881526456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d500047c0 0x7f1d50004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.502+0000 7f1d6759e640 1 -- 172.21.15.88:0/2881526456 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d50003520 con 0x7f1d500052a0 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.503+0000 7f1d6759e640 1 -- 172.21.15.88:0/2881526456 reap_dead start 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.503+0000 7f1d6759e640 1 --2- 172.21.15.88:0/2881526456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d500052a0 0x7f1d5000b980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800ba30 tx=0x7f1d500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40f27ea2dd203b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.503+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58004020 con 0x7f1d500052a0 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.503+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d58004180 con 0x7f1d500052a0 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.503+0000 7f1d65d9b640 1 -- 172.21.15.88:0/2881526456 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58003610 con 0x7f1d500052a0 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.503+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2881526456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d500052a0 msgr2=0x7f1d5000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.503+0000 7f1d6d0bb640 1 --2- 172.21.15.88:0/2881526456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d500052a0 0x7f1d5000b980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800ba30 tx=0x7f1d500057f0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.503+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2881526456 shutdown_connections 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.503+0000 7f1d6d0bb640 1 --2- 172.21.15.88:0/2881526456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d500052a0 0x7f1d5000b980 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.503+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2881526456 >> 172.21.15.88:0/2881526456 conn(0x7f1d680bdbf0 msgr2=0x7f1d680bdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.504+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2881526456 shutdown_connections 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.504+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2881526456 wait complete. 2024-01-22T10:12:56.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.505+0000 7f1d6d0bb640 1 Processor -- start 2024-01-22T10:12:56.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.505+0000 7f1d6d0bb640 1 -- start start 2024-01-22T10:12:56.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6d0bb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d500052a0 0x7f1d68149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6d0bb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d6814c000 0x7f1d6814c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6d0bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d681e1080 0x7f1d681e14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6d0bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68149d70 con 0x7f1d681e1080 2024-01-22T10:12:56.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6d0bb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6814b7f0 con 0x7f1d6814c000 2024-01-22T10:12:56.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6d0bb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6814b200 con 0x7f1d500052a0 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d681e1080 0x7f1d681e14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d66d9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d500052a0 0x7f1d68149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d681e1080 0x7f1d681e14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44220/0 (socket says 172.21.15.88:44220) 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6759e640 1 -- 172.21.15.88:0/2479376517 learned_addr learned my addr 172.21.15.88:0/2479376517 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6659c640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d6814c000 0x7f1d6814c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6759e640 1 -- 172.21.15.88:0/2479376517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d500052a0 msgr2=0x7f1d68149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6759e640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d500052a0 0x7f1d68149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6759e640 1 -- 172.21.15.88:0/2479376517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d6814c000 msgr2=0x7f1d6814c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6759e640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d6814c000 0x7f1d6814c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6759e640 1 -- 172.21.15.88:0/2479376517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d681e1a20 con 0x7f1d681e1080 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.506+0000 7f1d6759e640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d681e1080 0x7f1d681e14e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d5802bfd0 tx=0x7f1d58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.507+0000 7f1d4f7fe640 1 -- 172.21.15.88:0/2479376517 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58004500 con 0x7f1d681e1080 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.507+0000 7f1d4f7fe640 1 -- 172.21.15.88:0/2479376517 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d58032480 con 0x7f1d681e1080 2024-01-22T10:12:56.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.507+0000 7f1d4f7fe640 1 -- 172.21.15.88:0/2479376517 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d580327f0 con 0x7f1d681e1080 2024-01-22T10:12:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.507+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2479376517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d68142a90 con 0x7f1d681e1080 2024-01-22T10:12:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.507+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2479376517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6814b480 con 0x7f1d681e1080 2024-01-22T10:12:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.508+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2479376517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6804ea30 con 0x7f1d681e1080 2024-01-22T10:12:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.508+0000 7f1d4f7fe640 1 -- 172.21.15.88:0/2479376517 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f1d58042020 con 0x7f1d681e1080 2024-01-22T10:12:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.508+0000 7f1d4f7fe640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1d5406b330 0x7f1d5406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.508+0000 7f1d4f7fe640 1 -- 172.21.15.88:0/2479376517 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1d580aba70 con 0x7f1d681e1080 2024-01-22T10:12:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.509+0000 7f1d66d9d640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1d5406b330 0x7f1d5406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.509+0000 7f1d66d9d640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1d5406b330 0x7f1d5406d7f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1d60007c60 tx=0x7f1d60000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:56.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.513+0000 7f1d4f7fe640 1 -- 172.21.15.88:0/2479376517 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1d5807a620 con 0x7f1d681e1080 2024-01-22T10:12:56.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.681+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2479376517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d680724c0 con 0x7f1d681e1080 2024-01-22T10:12:56.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.682+0000 7f1d4f7fe640 1 -- 172.21.15.88:0/2479376517 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12827 (secure 0 0 0) 0x7f1d5807a1b0 con 0x7f1d681e1080 2024-01-22T10:12:56.664 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:56.665 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:12:53.027434+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:12:56.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.684+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2479376517 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1d5406b330 msgr2=0x7f1d5406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.684+0000 7f1d6d0bb640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1d5406b330 0x7f1d5406d7f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1d60007c60 tx=0x7f1d60000ed0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.684+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2479376517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d681e1080 msgr2=0x7f1d681e14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.684+0000 7f1d6d0bb640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d681e1080 0x7f1d681e14e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d5802bfd0 tx=0x7f1d58004730 comp rx=0 tx=0).stop 2024-01-22T10:12:56.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.684+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2479376517 shutdown_connections 2024-01-22T10:12:56.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.684+0000 7f1d6d0bb640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1d5406b330 0x7f1d5406d7f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.684+0000 7f1d6d0bb640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d681e1080 0x7f1d681e14e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.684+0000 7f1d6d0bb640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d6814c000 0x7f1d6814c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.684+0000 7f1d6d0bb640 1 --2- 172.21.15.88:0/2479376517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d500052a0 0x7f1d68149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.684+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2479376517 >> 172.21.15.88:0/2479376517 conn(0x7f1d680bdbf0 msgr2=0x7f1d680b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:56.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.684+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2479376517 shutdown_connections 2024-01-22T10:12:56.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.684+0000 7f1d6d0bb640 1 -- 172.21.15.88:0/2479376517 wait complete. 2024-01-22T10:12:56.677 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:12:56.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:12:56.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.798+0000 7fd60f2ad640 1 Processor -- start 2024-01-22T10:12:56.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.798+0000 7fd60f2ad640 1 -- start start 2024-01-22T10:12:56.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.798+0000 7fd60f2ad640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd60806c840 0x7fd6080b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.798+0000 7fd60f2ad640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd60806fbc0 0x7fd60806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.798+0000 7fd60f2ad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd60806b800 0x7fd60814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.798+0000 7fd60f2ad640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6080b5480 con 0x7fd60806c840 2024-01-22T10:12:56.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.798+0000 7fd60f2ad640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60814b740 con 0x7fd60806fbc0 2024-01-22T10:12:56.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.798+0000 7fd60f2ad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60814ba20 con 0x7fd60806b800 2024-01-22T10:12:56.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.799+0000 7fd60d049640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd60806c840 0x7fd6080b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.799+0000 7fd60d049640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd60806c840 0x7fd6080b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44236/0 (socket says 172.21.15.88:44236) 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.799+0000 7fd60d049640 1 -- 172.21.15.88:0/2137763376 learned_addr learned my addr 172.21.15.88:0/2137763376 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.799+0000 7fd60c848640 1 --2- 172.21.15.88:0/2137763376 >> v2:172.21.15.119:3300/0 conn(0x7fd60806fbc0 0x7fd60806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.799+0000 7fd60d049640 1 -- 172.21.15.88:0/2137763376 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd60806b800 msgr2=0x7fd60814ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.799+0000 7fd60d84a640 1 --2- 172.21.15.88:0/2137763376 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd60806b800 0x7fd60814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.799+0000 7fd60d049640 1 --2- 172.21.15.88:0/2137763376 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd60806b800 0x7fd60814ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.799+0000 7fd60d049640 1 -- 172.21.15.88:0/2137763376 >> v2:172.21.15.119:3300/0 conn(0x7fd60806fbc0 msgr2=0x7fd60806d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.799+0000 7fd60d049640 1 --2- 172.21.15.88:0/2137763376 >> v2:172.21.15.119:3300/0 conn(0x7fd60806fbc0 0x7fd60806d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.799+0000 7fd60d049640 1 -- 172.21.15.88:0/2137763376 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60814bd00 con 0x7fd60806c840 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.799+0000 7fd60c848640 1 --2- 172.21.15.88:0/2137763376 >> v2:172.21.15.119:3300/0 conn(0x7fd60806fbc0 0x7fd60806d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.799+0000 7fd60d84a640 1 --2- 172.21.15.88:0/2137763376 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd60806b800 0x7fd60814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd60d049640 1 --2- 172.21.15.88:0/2137763376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60806c840 0x7fd6080b57c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd608071300 tx=0x7fd60002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3271a484bc47e02 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd5fffff640 1 -- 172.21.15.88:0/2137763376 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60002cb00 con 0x7fd60806c840 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd5fffff640 1 -- 172.21.15.88:0/2137763376 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60002cc60 con 0x7fd60806c840 2024-01-22T10:12:56.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd5fffff640 1 -- 172.21.15.88:0/2137763376 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6000343f0 con 0x7fd60806c840 2024-01-22T10:12:56.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd60f2ad640 1 -- 172.21.15.88:0/2137763376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60806c840 msgr2=0x7fd6080b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd60f2ad640 1 --2- 172.21.15.88:0/2137763376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60806c840 0x7fd6080b57c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd608071300 tx=0x7fd60002bf60 comp rx=0 tx=0).stop 2024-01-22T10:12:56.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd60f2ad640 1 -- 172.21.15.88:0/2137763376 shutdown_connections 2024-01-22T10:12:56.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd60f2ad640 1 --2- 172.21.15.88:0/2137763376 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd60806b800 0x7fd60814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd60f2ad640 1 --2- 172.21.15.88:0/2137763376 >> v2:172.21.15.119:3300/0 conn(0x7fd60806fbc0 0x7fd60806d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd60f2ad640 1 --2- 172.21.15.88:0/2137763376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60806c840 0x7fd6080b57c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd60f2ad640 1 -- 172.21.15.88:0/2137763376 >> 172.21.15.88:0/2137763376 conn(0x7fd6080bb740 msgr2=0x7fd6080bbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:56.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd60f2ad640 1 -- 172.21.15.88:0/2137763376 shutdown_connections 2024-01-22T10:12:56.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.800+0000 7fd60f2ad640 1 -- 172.21.15.88:0/2137763376 wait complete. 2024-01-22T10:12:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.801+0000 7fd60f2ad640 1 Processor -- start 2024-01-22T10:12:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.801+0000 7fd60f2ad640 1 -- start start 2024-01-22T10:12:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60f2ad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd60806b800 0x7fd6081e14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60f2ad640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60806c840 0x7fd6080b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60f2ad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd60806fbc0 0x7fd6080b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60f2ad640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080b7220 con 0x7fd60806c840 2024-01-22T10:12:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60f2ad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6081e24b0 con 0x7fd60806b800 2024-01-22T10:12:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60f2ad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd608148750 con 0x7fd60806fbc0 2024-01-22T10:12:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60c848640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60806c840 0x7fd6080b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60c848640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60806c840 0x7fd6080b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44250/0 (socket says 172.21.15.88:44250) 2024-01-22T10:12:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60c848640 1 -- 172.21.15.88:0/4172923097 learned_addr learned my addr 172.21.15.88:0/4172923097 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60d84a640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd60806fbc0 0x7fd6080b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60d049640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd60806b800 0x7fd6081e14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60c848640 1 -- 172.21.15.88:0/4172923097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd60806fbc0 msgr2=0x7fd6080b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60c848640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd60806fbc0 0x7fd6080b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60c848640 1 -- 172.21.15.88:0/4172923097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd60806b800 msgr2=0x7fd6081e14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60c848640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd60806b800 0x7fd6081e14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60c848640 1 -- 172.21.15.88:0/4172923097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd600009b30 con 0x7fd60806c840 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60d84a640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd60806fbc0 0x7fd6080b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60d049640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd60806b800 0x7fd6081e14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.802+0000 7fd60c848640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60806c840 0x7fd6080b7f40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c820 tx=0x7fd5f800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.803+0000 7fd5fdffb640 1 -- 172.21.15.88:0/4172923097 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8007a30 con 0x7fd60806c840 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.803+0000 7fd5fdffb640 1 -- 172.21.15.88:0/4172923097 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8007b90 con 0x7fd60806c840 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.803+0000 7fd60f2ad640 1 -- 172.21.15.88:0/4172923097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6080a44f0 con 0x7fd60806c840 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.803+0000 7fd5fdffb640 1 -- 172.21.15.88:0/4172923097 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800ce10 con 0x7fd60806c840 2024-01-22T10:12:56.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.803+0000 7fd60f2ad640 1 -- 172.21.15.88:0/4172923097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6080b7a20 con 0x7fd60806c840 2024-01-22T10:12:56.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.804+0000 7fd60f2ad640 1 -- 172.21.15.88:0/4172923097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6080a4a10 con 0x7fd60806c840 2024-01-22T10:12:56.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.804+0000 7fd5fdffb640 1 -- 172.21.15.88:0/4172923097 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fd5f80113f0 con 0x7fd60806c840 2024-01-22T10:12:56.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.804+0000 7fd5fdffb640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd5ec06b330 0x7fd5ec06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:56.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.804+0000 7fd5fdffb640 1 -- 172.21.15.88:0/4172923097 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd5f8089a30 con 0x7fd60806c840 2024-01-22T10:12:56.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.804+0000 7fd60d049640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd5ec06b330 0x7fd5ec06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:56.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.805+0000 7fd60d049640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd5ec06b330 0x7fd5ec06d7f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd600035000 tx=0x7fd600030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:56.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.809+0000 7fd5fdffb640 1 -- 172.21.15.88:0/4172923097 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd5f8054980 con 0x7fd60806c840 2024-01-22T10:12:56.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.976+0000 7fd60f2ad640 1 -- 172.21.15.88:0/4172923097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6080b50c0 con 0x7fd60806c840 2024-01-22T10:12:56.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.976+0000 7fd5fdffb640 1 -- 172.21.15.88:0/4172923097 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5f801f020 con 0x7fd60806c840 2024-01-22T10:12:56.959 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:12:56.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.978+0000 7fd60f2ad640 1 -- 172.21.15.88:0/4172923097 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd5ec06b330 msgr2=0x7fd5ec06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.978+0000 7fd60f2ad640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd5ec06b330 0x7fd5ec06d7f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd600035000 tx=0x7fd600030000 comp rx=0 tx=0).stop 2024-01-22T10:12:56.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.978+0000 7fd60f2ad640 1 -- 172.21.15.88:0/4172923097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60806c840 msgr2=0x7fd6080b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:56.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.978+0000 7fd60f2ad640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60806c840 0x7fd6080b7f40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c820 tx=0x7fd5f800cce0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.978+0000 7fd60f2ad640 1 -- 172.21.15.88:0/4172923097 shutdown_connections 2024-01-22T10:12:56.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.978+0000 7fd60f2ad640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd5ec06b330 0x7fd5ec06d7f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.978+0000 7fd60f2ad640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd60806fbc0 0x7fd6080b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.978+0000 7fd60f2ad640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60806c840 0x7fd6080b7f40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.978+0000 7fd60f2ad640 1 --2- 172.21.15.88:0/4172923097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd60806b800 0x7fd6081e14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:56.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.978+0000 7fd60f2ad640 1 -- 172.21.15.88:0/4172923097 >> 172.21.15.88:0/4172923097 conn(0x7fd6080bb740 msgr2=0x7fd60806bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:56.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.978+0000 7fd60f2ad640 1 -- 172.21.15.88:0/4172923097 shutdown_connections 2024-01-22T10:12:56.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:56.978+0000 7fd60f2ad640 1 -- 172.21.15.88:0/4172923097 wait complete. 2024-01-22T10:12:56.971 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:12:57.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.087+0000 7f944fc15640 1 Processor -- start 2024-01-22T10:12:57.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.087+0000 7f944fc15640 1 -- start start 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944fc15640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9448070030 0x7f9448149580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944fc15640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9448149ac0 0x7f9448153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944fc15640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944814cb00 con 0x7f94480bdd90 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944fc15640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9448070940 con 0x7f9448070030 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944fc15640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94480704c0 con 0x7f9448149ac0 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944d9b1640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f94480bdd90 0x7f944813fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34812/0 (socket says 172.21.15.88:34812) 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944d9b1640 1 -- 172.21.15.88:0/2379472277 learned_addr learned my addr 172.21.15.88:0/2379472277 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944d1b0640 1 --2- 172.21.15.88:0/2379472277 >> v2:172.21.15.119:3300/0 conn(0x7f9448070030 0x7f9448149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944e1b2640 1 --2- 172.21.15.88:0/2379472277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9448149ac0 0x7f9448153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944c9af640 1 -- 172.21.15.88:0/2379472277 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456013656 0 0) 0x7f944814cb00 con 0x7f94480bdd90 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944c9af640 1 -- 172.21.15.88:0/2379472277 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9434003520 con 0x7f94480bdd90 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944e1b2640 1 -- 172.21.15.88:0/2379472277 >> v2:172.21.15.119:3300/0 conn(0x7f9448070030 msgr2=0x7f9448149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944e1b2640 1 --2- 172.21.15.88:0/2379472277 >> v2:172.21.15.119:3300/0 conn(0x7f9448070030 0x7f9448149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:57.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944e1b2640 1 -- 172.21.15.88:0/2379472277 >> v1:172.21.15.88:6789/0 conn(0x7f94480bdd90 legacy=0x7f944813fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:57.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.088+0000 7f944e1b2640 1 -- 172.21.15.88:0/2379472277 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944814d680 con 0x7f9448149ac0 2024-01-22T10:12:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.089+0000 7f944e1b2640 1 --2- 172.21.15.88:0/2379472277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9448149ac0 0x7f9448153e90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9440009d90 tx=0x7f944002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15f1439b4d56759c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.089+0000 7f944c9af640 1 -- 172.21.15.88:0/2379472277 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944002cce0 con 0x7f9448149ac0 2024-01-22T10:12:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.089+0000 7f944c9af640 1 -- 172.21.15.88:0/2379472277 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944002ce40 con 0x7f9448149ac0 2024-01-22T10:12:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.089+0000 7f944c9af640 1 -- 172.21.15.88:0/2379472277 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440034660 con 0x7f9448149ac0 2024-01-22T10:12:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.090+0000 7f944fc15640 1 -- 172.21.15.88:0/2379472277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9448149ac0 msgr2=0x7f9448153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:57.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.090+0000 7f944fc15640 1 --2- 172.21.15.88:0/2379472277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9448149ac0 0x7f9448153e90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9440009d90 tx=0x7f944002bf30 comp rx=0 tx=0).stop 2024-01-22T10:12:57.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.090+0000 7f944fc15640 1 -- 172.21.15.88:0/2379472277 shutdown_connections 2024-01-22T10:12:57.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.090+0000 7f944fc15640 1 --2- 172.21.15.88:0/2379472277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9448149ac0 0x7f9448153e90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:57.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.090+0000 7f944fc15640 1 --2- 172.21.15.88:0/2379472277 >> v2:172.21.15.119:3300/0 conn(0x7f9448070030 0x7f9448149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:57.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.090+0000 7f944fc15640 1 -- 172.21.15.88:0/2379472277 >> 172.21.15.88:0/2379472277 conn(0x7f944806ad20 msgr2=0x7f94480bd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:57.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.090+0000 7f944fc15640 1 -- 172.21.15.88:0/2379472277 shutdown_connections 2024-01-22T10:12:57.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.090+0000 7f944fc15640 1 -- 172.21.15.88:0/2379472277 wait complete. 2024-01-22T10:12:57.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944fc15640 1 Processor -- start 2024-01-22T10:12:57.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944fc15640 1 -- start start 2024-01-22T10:12:57.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944fc15640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9448070030 0x7f94480bd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:57.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944fc15640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94480bdd90 0x7f94481e27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:57.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944fc15640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9448149ac0 0x7f944813ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:57.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944fc15640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944813f2c0 con 0x7f9448149ac0 2024-01-22T10:12:57.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944fc15640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9448141340 con 0x7f9448070030 2024-01-22T10:12:57.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944fc15640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944813f5d0 con 0x7f94480bdd90 2024-01-22T10:12:57.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944e1b2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9448149ac0 0x7f944813ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:57.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944e1b2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9448149ac0 0x7f944813ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44254/0 (socket says 172.21.15.88:44254) 2024-01-22T10:12:57.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944e1b2640 1 -- 172.21.15.88:0/2636029946 learned_addr learned my addr 172.21.15.88:0/2636029946 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:12:57.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944d9b1640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9448070030 0x7f94480bd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:57.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.091+0000 7f944d1b0640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94480bdd90 0x7f94481e27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:57.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f944e1b2640 1 -- 172.21.15.88:0/2636029946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94480bdd90 msgr2=0x7f94481e27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:57.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f944e1b2640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94480bdd90 0x7f94481e27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f944e1b2640 1 -- 172.21.15.88:0/2636029946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9448070030 msgr2=0x7f94480bd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f944e1b2640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9448070030 0x7f94480bd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f944e1b2640 1 -- 172.21.15.88:0/2636029946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9440009a70 con 0x7f9448149ac0 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f944d1b0640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94480bdd90 0x7f94481e27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f944d9b1640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9448070030 0x7f94480bd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f944e1b2640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9448149ac0 0x7f944813ed80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9440009d90 tx=0x7f9440004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f943e7fc640 1 -- 172.21.15.88:0/2636029946 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944003d600 con 0x7f9448149ac0 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f943e7fc640 1 -- 172.21.15.88:0/2636029946 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944003d780 con 0x7f9448149ac0 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f944fc15640 1 -- 172.21.15.88:0/2636029946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94480bcdf0 con 0x7f9448149ac0 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f943e7fc640 1 -- 172.21.15.88:0/2636029946 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944003db30 con 0x7f9448149ac0 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.092+0000 7f944fc15640 1 -- 172.21.15.88:0/2636029946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9448140e70 con 0x7f9448149ac0 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.093+0000 7f944fc15640 1 -- 172.21.15.88:0/2636029946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944804ea30 con 0x7f9448149ac0 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.093+0000 7f943e7fc640 1 -- 172.21.15.88:0/2636029946 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f944003b040 con 0x7f9448149ac0 2024-01-22T10:12:57.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.094+0000 7f943e7fc640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f942c06b330 0x7f942c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:57.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.094+0000 7f944d9b1640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f942c06b330 0x7f942c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:57.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.094+0000 7f943e7fc640 1 -- 172.21.15.88:0/2636029946 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f94400abca0 con 0x7f9448149ac0 2024-01-22T10:12:57.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.094+0000 7f944d9b1640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f942c06b330 0x7f942c06d7f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9444007fd0 tx=0x7f9444009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:57.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.098+0000 7f943e7fc640 1 -- 172.21.15.88:0/2636029946 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9440076d10 con 0x7f9448149ac0 2024-01-22T10:12:57.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.302+0000 7f944fc15640 1 -- 172.21.15.88:0/2636029946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94480bcf80 con 0x7f9448149ac0 2024-01-22T10:12:57.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.302+0000 7f943e7fc640 1 -- 172.21.15.88:0/2636029946 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f944004e090 con 0x7f9448149ac0 2024-01-22T10:12:57.285 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:57.285 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1505620357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1505620357},{"type":"v1","addr":"172.21.15.88:6837","nonce":1505620357}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-22T10:12:57.286 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 2 2024-01-22T10:12:57.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.304+0000 7f944fc15640 1 -- 172.21.15.88:0/2636029946 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f942c06b330 msgr2=0x7f942c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:57.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.304+0000 7f944fc15640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f942c06b330 0x7f942c06d7f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9444007fd0 tx=0x7f9444009040 comp rx=0 tx=0).stop 2024-01-22T10:12:57.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.304+0000 7f944fc15640 1 -- 172.21.15.88:0/2636029946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9448149ac0 msgr2=0x7f944813ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:57.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.304+0000 7f944fc15640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9448149ac0 0x7f944813ed80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9440009d90 tx=0x7f9440004a40 comp rx=0 tx=0).stop 2024-01-22T10:12:57.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.304+0000 7f944fc15640 1 -- 172.21.15.88:0/2636029946 shutdown_connections 2024-01-22T10:12:57.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.304+0000 7f944fc15640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f942c06b330 0x7f942c06d7f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:57.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.304+0000 7f944fc15640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94480bdd90 0x7f94481e27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:57.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.304+0000 7f944fc15640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9448149ac0 0x7f944813ed80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:57.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.304+0000 7f944fc15640 1 --2- 172.21.15.88:0/2636029946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9448070030 0x7f94480bd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:57.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.304+0000 7f944fc15640 1 -- 172.21.15.88:0/2636029946 >> 172.21.15.88:0/2636029946 conn(0x7f944806ad20 msgr2=0x7f944813c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:57.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.304+0000 7f944fc15640 1 -- 172.21.15.88:0/2636029946 shutdown_connections 2024-01-22T10:12:57.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:57.304+0000 7f944fc15640 1 -- 172.21.15.88:0/2636029946 wait complete. 2024-01-22T10:12:59.298 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:12:59.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.426+0000 7f5205f9e640 1 Processor -- start 2024-01-22T10:12:59.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.426+0000 7f5205f9e640 1 -- start start 2024-01-22T10:12:59.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.427+0000 7f5205f9e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52000b7b30 0x7f520009eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.427+0000 7f5205f9e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f520009f880 0x7f520014f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.427+0000 7f5205f9e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520009de50 con 0x7f5200145620 2024-01-22T10:12:59.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.427+0000 7f5205f9e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52000b7f90 con 0x7f520009f880 2024-01-22T10:12:59.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.427+0000 7f5205f9e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5200145a00 con 0x7f52000b7b30 2024-01-22T10:12:59.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.427+0000 7f520579d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f520009f880 0x7f520014f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.427+0000 7f5204f9c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5200145620 0x7f520014eb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53216/0 (socket says 172.21.15.88:53216) 2024-01-22T10:12:59.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.427+0000 7f5204f9c640 1 -- 172.21.15.88:0/874826058 learned_addr learned my addr 172.21.15.88:0/874826058 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:12:59.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.427+0000 7f51fffff640 1 --2- 172.21.15.88:0/874826058 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52000b7b30 0x7f520009eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.427+0000 7f520579d640 1 -- 172.21.15.88:0/874826058 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52000b7b30 msgr2=0x7f520009eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:59.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.427+0000 7f520579d640 1 --2- 172.21.15.88:0/874826058 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52000b7b30 0x7f520009eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.427+0000 7f520579d640 1 -- 172.21.15.88:0/874826058 >> v1:172.21.15.88:6789/0 conn(0x7f5200145620 legacy=0x7f520014eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.428+0000 7f520579d640 1 -- 172.21.15.88:0/874826058 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520009fd30 con 0x7f520009f880 2024-01-22T10:12:59.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.428+0000 7f51ff7fe640 1 -- 172.21.15.88:0/874826058 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336870329 0 0) 0x7f520009de50 con 0x7f5200145620 2024-01-22T10:12:59.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.428+0000 7f51fffff640 1 --2- 172.21.15.88:0/874826058 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52000b7b30 0x7f520009eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:12:59.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.428+0000 7f520579d640 1 --2- 172.21.15.88:0/874826058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f520009f880 0x7f520014f240 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009d90 tx=0x7f51f802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8ba6fe14d2e314 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:59.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.428+0000 7f51ff7fe640 1 -- 172.21.15.88:0/874826058 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f802cc50 con 0x7f520009f880 2024-01-22T10:12:59.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.428+0000 7f51ff7fe640 1 -- 172.21.15.88:0/874826058 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f802cdb0 con 0x7f520009f880 2024-01-22T10:12:59.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.428+0000 7f51ff7fe640 1 -- 172.21.15.88:0/874826058 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8034660 con 0x7f520009f880 2024-01-22T10:12:59.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.429+0000 7f5205f9e640 1 -- 172.21.15.88:0/874826058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f520009f880 msgr2=0x7f520014f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.429+0000 7f5205f9e640 1 --2- 172.21.15.88:0/874826058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f520009f880 0x7f520014f240 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009d90 tx=0x7f51f802bea0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.429+0000 7f5205f9e640 1 -- 172.21.15.88:0/874826058 shutdown_connections 2024-01-22T10:12:59.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.429+0000 7f5205f9e640 1 --2- 172.21.15.88:0/874826058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f520009f880 0x7f520014f240 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.429+0000 7f5205f9e640 1 --2- 172.21.15.88:0/874826058 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52000b7b30 0x7f520009eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.429+0000 7f5205f9e640 1 -- 172.21.15.88:0/874826058 >> 172.21.15.88:0/874826058 conn(0x7f52000b9c30 msgr2=0x7f52000ba040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:59.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.429+0000 7f5205f9e640 1 -- 172.21.15.88:0/874826058 shutdown_connections 2024-01-22T10:12:59.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.429+0000 7f5205f9e640 1 -- 172.21.15.88:0/874826058 wait complete. 2024-01-22T10:12:59.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.430+0000 7f5205f9e640 1 Processor -- start 2024-01-22T10:12:59.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.430+0000 7f5205f9e640 1 -- start start 2024-01-22T10:12:59.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.431+0000 7f5205f9e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f520009f880 0x7f52000b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.431+0000 7f5205f9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52000b7b30 0x7f52000704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.431+0000 7f5205f9e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5200145620 0x7f52000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.431+0000 7f5205f9e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52000b59c0 con 0x7f52000b7b30 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.431+0000 7f5205f9e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52000b5090 con 0x7f5200145620 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.431+0000 7f5205f9e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52000b5370 con 0x7f520009f880 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.431+0000 7f51fffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52000b7b30 0x7f52000704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.431+0000 7f51fffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52000b7b30 0x7f52000704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36198/0 (socket says 172.21.15.88:36198) 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.431+0000 7f51fffff640 1 -- 172.21.15.88:0/1426134239 learned_addr learned my addr 172.21.15.88:0/1426134239 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.431+0000 7f5204f9c640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f520009f880 0x7f52000b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.431+0000 7f520579d640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5200145620 0x7f52000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f51fffff640 1 -- 172.21.15.88:0/1426134239 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f520009f880 msgr2=0x7f52000b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f51fffff640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f520009f880 0x7f52000b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f51fffff640 1 -- 172.21.15.88:0/1426134239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5200145620 msgr2=0x7f52000709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f51fffff640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5200145620 0x7f52000709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f51fffff640 1 -- 172.21.15.88:0/1426134239 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8009a70 con 0x7f52000b7b30 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f5204f9c640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f520009f880 0x7f52000b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f520579d640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5200145620 0x7f52000709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:12:59.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f51fffff640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52000b7b30 0x7f52000704a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00c7f0 tx=0x7f51ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:59.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f51fd7fa640 1 -- 172.21.15.88:0/1426134239 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00cea0 con 0x7f52000b7b30 2024-01-22T10:12:59.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f51fd7fa640 1 -- 172.21.15.88:0/1426134239 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec004230 con 0x7f52000b7b30 2024-01-22T10:12:59.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f5205f9e640 1 -- 172.21.15.88:0/1426134239 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52000b5650 con 0x7f52000b7b30 2024-01-22T10:12:59.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f51fd7fa640 1 -- 172.21.15.88:0/1426134239 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec007830 con 0x7f52000b7b30 2024-01-22T10:12:59.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.432+0000 7f5205f9e640 1 -- 172.21.15.88:0/1426134239 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5200072020 con 0x7f52000b7b30 2024-01-22T10:12:59.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.433+0000 7f5205f9e640 1 -- 172.21.15.88:0/1426134239 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52000701c0 con 0x7f52000b7b30 2024-01-22T10:12:59.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.433+0000 7f51fd7fa640 1 -- 172.21.15.88:0/1426134239 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f51ec007990 con 0x7f52000b7b30 2024-01-22T10:12:59.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.434+0000 7f51fd7fa640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f51e406b330 0x7f51e406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.434+0000 7f51fd7fa640 1 -- 172.21.15.88:0/1426134239 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f51ec0897a0 con 0x7f52000b7b30 2024-01-22T10:12:59.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.434+0000 7f5204f9c640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f51e406b330 0x7f51e406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.434+0000 7f5204f9c640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f51e406b330 0x7f51e406d7f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51f4000f60 tx=0x7f51f4007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:59.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.438+0000 7f51fd7fa640 1 -- 172.21.15.88:0/1426134239 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f52000701c0 con 0x7f52000b7b30 2024-01-22T10:12:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.641+0000 7f5205f9e640 1 -- 172.21.15.88:0/1426134239 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52000701c0 con 0x7f52000b7b30 2024-01-22T10:12:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.642+0000 7f51fd7fa640 1 -- 172.21.15.88:0/1426134239 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2907 (secure 0 0 0) 0x7f51ec01eb70 con 0x7f52000b7b30 2024-01-22T10:12:59.625 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:59.625 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3660245466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3660245466},{"type":"v1","addr":"172.21.15.119:6833","nonce":3660245466}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/3438486113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3438486113},{"type":"v1","addr":"172.21.15.88:6836","nonce":3438486113}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1505620357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1505620357},{"type":"v1","addr":"172.21.15.88:6837","nonce":1505620357}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-22T10:12:59.625 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 3 2024-01-22T10:12:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.643+0000 7f5205f9e640 1 -- 172.21.15.88:0/1426134239 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f51e406b330 msgr2=0x7f51e406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.643+0000 7f5205f9e640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f51e406b330 0x7f51e406d7f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51f4000f60 tx=0x7f51f4007ca0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.643+0000 7f5205f9e640 1 -- 172.21.15.88:0/1426134239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52000b7b30 msgr2=0x7f52000704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.643+0000 7f5205f9e640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52000b7b30 0x7f52000704a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00c7f0 tx=0x7f51ec00ccb0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.644+0000 7f5205f9e640 1 -- 172.21.15.88:0/1426134239 shutdown_connections 2024-01-22T10:12:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.644+0000 7f5205f9e640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f51e406b330 0x7f51e406d7f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.644+0000 7f5205f9e640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5200145620 0x7f52000709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.644+0000 7f5205f9e640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52000b7b30 0x7f52000704a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.644+0000 7f5205f9e640 1 --2- 172.21.15.88:0/1426134239 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f520009f880 0x7f52000b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.644+0000 7f5205f9e640 1 -- 172.21.15.88:0/1426134239 >> 172.21.15.88:0/1426134239 conn(0x7f52000b9c30 msgr2=0x7f520006c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.644+0000 7f5205f9e640 1 -- 172.21.15.88:0/1426134239 shutdown_connections 2024-01-22T10:12:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.644+0000 7f5205f9e640 1 -- 172.21.15.88:0/1426134239 wait complete. 2024-01-22T10:12:59.637 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:12:59.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.752+0000 7f7fc4cec640 1 Processor -- start 2024-01-22T10:12:59.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.752+0000 7f7fc4cec640 1 -- start start 2024-01-22T10:12:59.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.752+0000 7f7fc4cec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc006b800 0x7f7fc006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.752+0000 7f7fc4cec640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc014b7a0 con 0x7f7fc00b9ce0 2024-01-22T10:12:59.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fc4cec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc014c520 con 0x7f7fc006bbe0 2024-01-22T10:12:59.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fc4cec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc014ba40 con 0x7f7fc006b800 2024-01-22T10:12:59.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbed9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7fc00b9ce0 0x7f7fc0155f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53232/0 (socket says 172.21.15.88:53232) 2024-01-22T10:12:59.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbed9d640 1 -- 172.21.15.88:0/1902714181 learned_addr learned my addr 172.21.15.88:0/1902714181 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:12:59.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbe59c640 1 --2- 172.21.15.88:0/1902714181 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc006b800 0x7f7fc006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304001187 0 0) 0x7f7fc014b7a0 con 0x7f7fc00b9ce0 2024-01-22T10:12:59.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fa8003520 con 0x7f7fc00b9ce0 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101538320 0 0) 0x7f7fc014c520 con 0x7f7fc006bbe0 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc014b7a0 con 0x7f7fc006bbe0 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4048978091 0 0) 0x7f7fa8003520 con 0x7f7fc00b9ce0 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc006b800 msgr2=0x7f7fc006d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 --2- 172.21.15.88:0/1902714181 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc006b800 0x7f7fc006d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 >> v1:172.21.15.119:6789/0 conn(0x7f7fc006bbe0 legacy=0x7f7fc00bafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc014bd20 con 0x7f7fc00b9ce0 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f7fb80019f0 con 0x7f7fc00b9ce0 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 >> v1:172.21.15.88:6789/0 conn(0x7f7fc00b9ce0 legacy=0x7f7fc0155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 --2- 172.21.15.88:0/1902714181 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc006b800 0x7f7fa8003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 --2- 172.21.15.88:0/1902714181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa8004170 0x7f7fa80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 --2- 172.21.15.88:0/1902714181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa8004d00 0x7f7fa8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc014ba40 con 0x7f7fa8004170 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa800bbc0 con 0x7f7fa8004d00 2024-01-22T10:12:59.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa800bd80 con 0x7f7fc006b800 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbdd9b640 1 --2- 172.21.15.88:0/1902714181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa8004170 0x7f7fa80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbe59c640 1 --2- 172.21.15.88:0/1902714181 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc006b800 0x7f7fa8003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.753+0000 7f7fbed9d640 1 --2- 172.21.15.88:0/1902714181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa8004d00 0x7f7fa8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.754+0000 7f7fbdd9b640 1 -- 172.21.15.88:0/1902714181 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc006b800 msgr2=0x7f7fa8003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.754+0000 7f7fbdd9b640 1 --2- 172.21.15.88:0/1902714181 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc006b800 0x7f7fa8003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.754+0000 7f7fbdd9b640 1 -- 172.21.15.88:0/1902714181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa8004d00 msgr2=0x7f7fa8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.754+0000 7f7fbdd9b640 1 --2- 172.21.15.88:0/1902714181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa8004d00 0x7f7fa8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.754+0000 7f7fbdd9b640 1 -- 172.21.15.88:0/1902714181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8003520 con 0x7f7fa8004170 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.754+0000 7f7fbdd9b640 1 --2- 172.21.15.88:0/1902714181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa8004170 0x7f7fa80047c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40018d0 tx=0x7f7fa80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdb3fd4870ae550 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.754+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb40052d0 con 0x7f7fa8004170 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.754+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb4005430 con 0x7f7fa8004170 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.754+0000 7f7fbd59a640 1 -- 172.21.15.88:0/1902714181 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4003810 con 0x7f7fa8004170 2024-01-22T10:12:59.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.755+0000 7f7fc4cec640 1 -- 172.21.15.88:0/1902714181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa8004170 msgr2=0x7f7fa80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.755+0000 7f7fc4cec640 1 --2- 172.21.15.88:0/1902714181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa8004170 0x7f7fa80047c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40018d0 tx=0x7f7fa80057f0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.755+0000 7f7fbed9d640 1 -- 172.21.15.88:0/1902714181 reap_dead start 2024-01-22T10:12:59.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.755+0000 7f7fc4cec640 1 -- 172.21.15.88:0/1902714181 shutdown_connections 2024-01-22T10:12:59.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.755+0000 7f7fc4cec640 1 -- 172.21.15.88:0/1902714181 >> 172.21.15.88:0/1902714181 conn(0x7f7fc00bb840 msgr2=0x7f7fc00bbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:59.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.755+0000 7f7fc4cec640 1 -- 172.21.15.88:0/1902714181 shutdown_connections 2024-01-22T10:12:59.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.755+0000 7f7fc4cec640 1 -- 172.21.15.88:0/1902714181 wait complete. 2024-01-22T10:12:59.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.756+0000 7f7fc4cec640 1 Processor -- start 2024-01-22T10:12:59.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.756+0000 7f7fc4cec640 1 -- start start 2024-01-22T10:12:59.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fc4cec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa8004170 0x7f7fc01e1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fc4cec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc0146930 0x7f7fc00b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fc4cec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fc0147d00 0x7f7fc0144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fc4cec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc01e1470 con 0x7f7fc0147d00 2024-01-22T10:12:59.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fc4cec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc0148250 con 0x7f7fa8004170 2024-01-22T10:12:59.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fc4cec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc0146dc0 con 0x7f7fc0146930 2024-01-22T10:12:59.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fbed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fc0147d00 0x7f7fc0144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fbed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fc0147d00 0x7f7fc0144690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36216/0 (socket says 172.21.15.88:36216) 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fbed9d640 1 -- 172.21.15.88:0/3248601183 learned_addr learned my addr 172.21.15.88:0/3248601183 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fbe59c640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa8004170 0x7f7fc01e1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fbdd9b640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc0146930 0x7f7fc00b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fbed9d640 1 -- 172.21.15.88:0/3248601183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc0146930 msgr2=0x7f7fc00b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fbed9d640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc0146930 0x7f7fc00b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fbed9d640 1 -- 172.21.15.88:0/3248601183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa8004170 msgr2=0x7f7fc01e1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fbed9d640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa8004170 0x7f7fc01e1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fbed9d640 1 -- 172.21.15.88:0/3248601183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc01e16e0 con 0x7f7fc0147d00 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7fbed9d640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fc0147d00 0x7f7fc0144690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0072630 tx=0x7f7fb80079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.757+0000 7f7faeffd640 1 -- 172.21.15.88:0/3248601183 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8001410 con 0x7f7fc0147d00 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.758+0000 7f7faeffd640 1 -- 172.21.15.88:0/3248601183 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb800aa10 con 0x7f7fc0147d00 2024-01-22T10:12:59.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.758+0000 7f7fc4cec640 1 -- 172.21.15.88:0/3248601183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc00b75d0 con 0x7f7fc0147d00 2024-01-22T10:12:59.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.758+0000 7f7faeffd640 1 -- 172.21.15.88:0/3248601183 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb800adc0 con 0x7f7fc0147d00 2024-01-22T10:12:59.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.758+0000 7f7fc4cec640 1 -- 172.21.15.88:0/3248601183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc01e2140 con 0x7f7fc0147d00 2024-01-22T10:12:59.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.759+0000 7f7fc4cec640 1 -- 172.21.15.88:0/3248601183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc0067c40 con 0x7f7fc0147d00 2024-01-22T10:12:59.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.759+0000 7f7faeffd640 1 -- 172.21.15.88:0/3248601183 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f7fb80133f0 con 0x7f7fc0147d00 2024-01-22T10:12:59.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.759+0000 7f7faeffd640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7fa006b330 0x7f7fa006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:12:59.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.759+0000 7f7faeffd640 1 -- 172.21.15.88:0/3248601183 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7fb8089ff0 con 0x7f7fc0147d00 2024-01-22T10:12:59.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.759+0000 7f7fbe59c640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7fa006b330 0x7f7fa006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:12:59.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.760+0000 7f7fbe59c640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7fa006b330 0x7f7fa006d7f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009ae0 tx=0x7f7fb0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:12:59.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.764+0000 7f7faeffd640 1 -- 172.21.15.88:0/3248601183 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7fb8055060 con 0x7f7fc0147d00 2024-01-22T10:12:59.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.934+0000 7f7fc4cec640 1 -- 172.21.15.88:0/3248601183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fc01e22d0 con 0x7f7fc0147d00 2024-01-22T10:12:59.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.935+0000 7f7faeffd640 1 -- 172.21.15.88:0/3248601183 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12827 (secure 0 0 0) 0x7f7fc01e22d0 con 0x7f7fc0147d00 2024-01-22T10:12:59.918 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:12:59.918 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:12:53.027434+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:12:59.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.937+0000 7f7fc4cec640 1 -- 172.21.15.88:0/3248601183 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7fa006b330 msgr2=0x7f7fa006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.937+0000 7f7fc4cec640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7fa006b330 0x7f7fa006d7f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009ae0 tx=0x7f7fb0009190 comp rx=0 tx=0).stop 2024-01-22T10:12:59.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.937+0000 7f7fc4cec640 1 -- 172.21.15.88:0/3248601183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fc0147d00 msgr2=0x7f7fc0144690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:12:59.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.937+0000 7f7fc4cec640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fc0147d00 0x7f7fc0144690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0072630 tx=0x7f7fb80079d0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.937+0000 7f7fc4cec640 1 -- 172.21.15.88:0/3248601183 shutdown_connections 2024-01-22T10:12:59.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.937+0000 7f7fc4cec640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7fa006b330 0x7f7fa006d7f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.937+0000 7f7fc4cec640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fc0146930 0x7f7fc00b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.937+0000 7f7fc4cec640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fc0147d00 0x7f7fc0144690 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.937+0000 7f7fc4cec640 1 --2- 172.21.15.88:0/3248601183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa8004170 0x7f7fc01e1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:12:59.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.937+0000 7f7fc4cec640 1 -- 172.21.15.88:0/3248601183 >> 172.21.15.88:0/3248601183 conn(0x7f7fc00bb840 msgr2=0x7f7fc00b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:12:59.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.937+0000 7f7fc4cec640 1 -- 172.21.15.88:0/3248601183 shutdown_connections 2024-01-22T10:12:59.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:12:59.937+0000 7f7fc4cec640 1 -- 172.21.15.88:0/3248601183 wait complete. 2024-01-22T10:12:59.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:12:59.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:13:00.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.052+0000 7f6af8501640 1 Processor -- start 2024-01-22T10:13:00.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.052+0000 7f6af8501640 1 -- start start 2024-01-22T10:13:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.053+0000 7f6af8501640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6af00b3b20 0x7f6af0149420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.053+0000 7f6af8501640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af014d090 con 0x7f6af006f850 2024-01-22T10:13:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.053+0000 7f6af8501640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af006ddb0 con 0x7f6af00b5740 2024-01-22T10:13:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.053+0000 7f6af8501640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af014ca40 con 0x7f6af00b3b20 2024-01-22T10:13:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.053+0000 7f6af629d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6af006f850 0x7f6af013fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53238/0 (socket says 172.21.15.88:53238) 2024-01-22T10:13:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.053+0000 7f6af629d640 1 -- 172.21.15.88:0/1279690139 learned_addr learned my addr 172.21.15.88:0/1279690139 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.053+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513919785 0 0) 0x7f6af014d090 con 0x7f6af006f850 2024-01-22T10:13:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.053+0000 7f6af5a9c640 1 --2- 172.21.15.88:0/1279690139 >> v2:172.21.15.119:3300/0 conn(0x7f6af00b3b20 0x7f6af0149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.053+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc003520 con 0x7f6af006f850 2024-01-22T10:13:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3519475717 0 0) 0x7f6adc003520 con 0x7f6af006f850 2024-01-22T10:13:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 >> v2:172.21.15.119:3300/0 conn(0x7f6af00b3b20 msgr2=0x7f6af0149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 --2- 172.21.15.88:0/1279690139 >> v2:172.21.15.119:3300/0 conn(0x7f6af00b3b20 0x7f6af0149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 >> v1:172.21.15.119:6789/0 conn(0x7f6af00b5740 legacy=0x7f6af0153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af014cd20 con 0x7f6af006f850 2024-01-22T10:13:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f6aec0019f0 con 0x7f6af006f850 2024-01-22T10:13:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af5a9c640 1 --2- 172.21.15.88:0/1279690139 >> v2:172.21.15.119:3300/0 conn(0x7f6af00b3b20 0x7f6af0149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 >> v1:172.21.15.88:6789/0 conn(0x7f6af006f850 legacy=0x7f6af013fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 --2- 172.21.15.88:0/1279690139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6adc003970 0x7f6adc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 --2- 172.21.15.88:0/1279690139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6adc0047c0 0x7f6adc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 --2- 172.21.15.88:0/1279690139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 0x7f6adc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af014ca40 con 0x7f6adc005180 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc00c0d0 con 0x7f6adc003970 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc00c290 con 0x7f6adc0047c0 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af6a9e640 1 --2- 172.21.15.88:0/1279690139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 0x7f6adc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af629d640 1 --2- 172.21.15.88:0/1279690139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6adc003970 0x7f6adc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af5a9c640 1 --2- 172.21.15.88:0/1279690139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6adc0047c0 0x7f6adc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af6a9e640 1 -- 172.21.15.88:0/1279690139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6adc0047c0 msgr2=0x7f6adc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af6a9e640 1 --2- 172.21.15.88:0/1279690139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6adc0047c0 0x7f6adc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af6a9e640 1 -- 172.21.15.88:0/1279690139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6adc003970 msgr2=0x7f6adc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af6a9e640 1 --2- 172.21.15.88:0/1279690139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6adc003970 0x7f6adc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af6a9e640 1 -- 172.21.15.88:0/1279690139 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc003520 con 0x7f6adc005180 2024-01-22T10:13:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.054+0000 7f6af5a9c640 1 --2- 172.21.15.88:0/1279690139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6adc0047c0 0x7f6adc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.055+0000 7f6af6a9e640 1 -- 172.21.15.88:0/1279690139 reap_dead start 2024-01-22T10:13:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.055+0000 7f6af6a9e640 1 --2- 172.21.15.88:0/1279690139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 0x7f6adc00b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8001750 tx=0x7f6adc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c12a2abc6a17894 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.055+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80052d0 con 0x7f6adc005180 2024-01-22T10:13:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.055+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae802e050 con 0x7f6adc005180 2024-01-22T10:13:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.055+0000 7f6af529b640 1 -- 172.21.15.88:0/1279690139 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80035f0 con 0x7f6adc005180 2024-01-22T10:13:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.055+0000 7f6af8501640 1 -- 172.21.15.88:0/1279690139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 msgr2=0x7f6adc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.055+0000 7f6af8501640 1 --2- 172.21.15.88:0/1279690139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 0x7f6adc00b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8001750 tx=0x7f6adc0057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.056+0000 7f6af8501640 1 -- 172.21.15.88:0/1279690139 shutdown_connections 2024-01-22T10:13:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.056+0000 7f6af8501640 1 --2- 172.21.15.88:0/1279690139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 0x7f6adc00b980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.056+0000 7f6af8501640 1 -- 172.21.15.88:0/1279690139 >> 172.21.15.88:0/1279690139 conn(0x7f6af00bec60 msgr2=0x7f6af00bf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.056+0000 7f6af8501640 1 -- 172.21.15.88:0/1279690139 shutdown_connections 2024-01-22T10:13:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.056+0000 7f6af8501640 1 -- 172.21.15.88:0/1279690139 wait complete. 2024-01-22T10:13:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.057+0000 7f6af8501640 1 Processor -- start 2024-01-22T10:13:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.057+0000 7f6af8501640 1 -- start start 2024-01-22T10:13:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.057+0000 7f6af8501640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 0x7f6af0148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.057+0000 7f6af8501640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6af00b8e30 0x7f6af01de900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.057+0000 7f6af8501640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6af00b76a0 0x7f6af01dee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.057+0000 7f6af8501640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af0148e60 con 0x7f6adc005180 2024-01-22T10:13:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.057+0000 7f6af8501640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00b8ad0 con 0x7f6af00b76a0 2024-01-22T10:13:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.057+0000 7f6af8501640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af0146c90 con 0x7f6af00b8e30 2024-01-22T10:13:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.057+0000 7f6af629d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 0x7f6af0148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.057+0000 7f6af629d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 0x7f6af0148920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36232/0 (socket says 172.21.15.88:36232) 2024-01-22T10:13:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.057+0000 7f6af629d640 1 -- 172.21.15.88:0/2743820992 learned_addr learned my addr 172.21.15.88:0/2743820992 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6af6a9e640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6af00b76a0 0x7f6af01dee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6af5a9c640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6af00b8e30 0x7f6af01de900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6af629d640 1 -- 172.21.15.88:0/2743820992 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6af00b8e30 msgr2=0x7f6af01de900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6af629d640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6af00b8e30 0x7f6af01de900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6af629d640 1 -- 172.21.15.88:0/2743820992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6af00b76a0 msgr2=0x7f6af01dee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6af629d640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6af00b76a0 0x7f6af01dee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6af629d640 1 -- 172.21.15.88:0/2743820992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af00b7b60 con 0x7f6adc005180 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6af5a9c640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6af00b8e30 0x7f6af01de900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6af629d640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 0x7f6af0148920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0079a0 tx=0x7f6aec00a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6ae6ffd640 1 -- 172.21.15.88:0/2743820992 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec0133f0 con 0x7f6adc005180 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6ae6ffd640 1 -- 172.21.15.88:0/2743820992 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec013550 con 0x7f6adc005180 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6af8501640 1 -- 172.21.15.88:0/2743820992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af00b6910 con 0x7f6adc005180 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6ae6ffd640 1 -- 172.21.15.88:0/2743820992 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec013900 con 0x7f6adc005180 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.058+0000 7f6af8501640 1 -- 172.21.15.88:0/2743820992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af00b85b0 con 0x7f6adc005180 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.059+0000 7f6af8501640 1 -- 172.21.15.88:0/2743820992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af00b8770 con 0x7f6adc005180 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.059+0000 7f6ae6ffd640 1 -- 172.21.15.88:0/2743820992 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f6aec013a60 con 0x7f6adc005180 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.060+0000 7f6ae6ffd640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6ad406b360 0x7f6ad406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.060+0000 7f6ae6ffd640 1 -- 172.21.15.88:0/2743820992 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6aec08a510 con 0x7f6adc005180 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.060+0000 7f6af5a9c640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6ad406b360 0x7f6ad406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.060+0000 7f6af5a9c640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6ad406b360 0x7f6ad406d820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6af01d91c0 tx=0x7f6ae0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:00.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.064+0000 7f6ae6ffd640 1 -- 172.21.15.88:0/2743820992 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6aec055580 con 0x7f6adc005180 2024-01-22T10:13:00.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.232+0000 7f6af8501640 1 -- 172.21.15.88:0/2743820992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6af004ea30 con 0x7f6adc005180 2024-01-22T10:13:00.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.232+0000 7f6ae6ffd640 1 -- 172.21.15.88:0/2743820992 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6aec017020 con 0x7f6adc005180 2024-01-22T10:13:00.215 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:13:00.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.235+0000 7f6af8501640 1 -- 172.21.15.88:0/2743820992 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6ad406b360 msgr2=0x7f6ad406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.235+0000 7f6af8501640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6ad406b360 0x7f6ad406d820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6af01d91c0 tx=0x7f6ae0008040 comp rx=0 tx=0).stop 2024-01-22T10:13:00.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.235+0000 7f6af8501640 1 -- 172.21.15.88:0/2743820992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 msgr2=0x7f6af0148920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.235+0000 7f6af8501640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 0x7f6af0148920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0079a0 tx=0x7f6aec00a6e0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.235+0000 7f6af8501640 1 -- 172.21.15.88:0/2743820992 shutdown_connections 2024-01-22T10:13:00.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.235+0000 7f6af8501640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6ad406b360 0x7f6ad406d820 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.235+0000 7f6af8501640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6af00b8e30 0x7f6af01de900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.235+0000 7f6af8501640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6af00b76a0 0x7f6af01dee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.235+0000 7f6af8501640 1 --2- 172.21.15.88:0/2743820992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6adc005180 0x7f6af0148920 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.235+0000 7f6af8501640 1 -- 172.21.15.88:0/2743820992 >> 172.21.15.88:0/2743820992 conn(0x7f6af00bec60 msgr2=0x7f6af00b94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:00.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.235+0000 7f6af8501640 1 -- 172.21.15.88:0/2743820992 shutdown_connections 2024-01-22T10:13:00.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.235+0000 7f6af8501640 1 -- 172.21.15.88:0/2743820992 wait complete. 2024-01-22T10:13:00.228 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T10:13:00.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.344+0000 7f0479f00640 1 Processor -- start 2024-01-22T10:13:00.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.344+0000 7f0479f00640 1 -- start start 2024-01-22T10:13:00.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.344+0000 7f0479f00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f04740bdee0 0x7f047414b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.344+0000 7f0479f00640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04740bb800 con 0x7f0474148c30 2024-01-22T10:13:00.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.344+0000 7f0479f00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047414fb00 con 0x7f0474149080 2024-01-22T10:13:00.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.344+0000 7f0479f00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04740bbb50 con 0x7f04740bdee0 2024-01-22T10:13:00.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f0472ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0474148c30 0x7f047414ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53246/0 (socket says 172.21.15.88:53246) 2024-01-22T10:13:00.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f0472ffd640 1 -- 172.21.15.88:0/2473641073 learned_addr learned my addr 172.21.15.88:0/2473641073 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:00.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04737fe640 1 --2- 172.21.15.88:0/2473641073 >> v2:172.21.15.119:3300/0 conn(0x7f04740bdee0 0x7f047414b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032098036 0 0) 0x7f04740bb800 con 0x7f0474148c30 2024-01-22T10:13:00.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f045c003520 con 0x7f0474148c30 2024-01-22T10:13:00.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1870303225 0 0) 0x7f045c003520 con 0x7f0474148c30 2024-01-22T10:13:00.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 >> v2:172.21.15.119:3300/0 conn(0x7f04740bdee0 msgr2=0x7f047414b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:00.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 --2- 172.21.15.88:0/2473641073 >> v2:172.21.15.119:3300/0 conn(0x7f04740bdee0 0x7f047414b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 >> v1:172.21.15.119:6789/0 conn(0x7f0474149080 legacy=0x7f047414f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04740bf820 con 0x7f0474148c30 2024-01-22T10:13:00.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f0468001670 con 0x7f0474148c30 2024-01-22T10:13:00.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 >> v1:172.21.15.88:6789/0 conn(0x7f0474148c30 legacy=0x7f047414ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 --2- 172.21.15.88:0/2473641073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f045c003a50 0x7f045c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 --2- 172.21.15.88:0/2473641073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f045c0047c0 0x7f045c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 --2- 172.21.15.88:0/2473641073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f045c005250 0x7f045c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04740bbb50 con 0x7f045c003a50 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c00c1a0 con 0x7f045c0047c0 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c00c360 con 0x7f045c005250 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f04737fe640 1 --2- 172.21.15.88:0/2473641073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f045c003a50 0x7f045c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f0472ffd640 1 --2- 172.21.15.88:0/2473641073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f045c0047c0 0x7f045c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.345+0000 7f0473fff640 1 --2- 172.21.15.88:0/2473641073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f045c005250 0x7f045c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.346+0000 7f04737fe640 1 -- 172.21.15.88:0/2473641073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f045c005250 msgr2=0x7f045c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.346+0000 7f04737fe640 1 --2- 172.21.15.88:0/2473641073 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f045c005250 0x7f045c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.346+0000 7f04737fe640 1 -- 172.21.15.88:0/2473641073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f045c0047c0 msgr2=0x7f045c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.346+0000 7f04737fe640 1 --2- 172.21.15.88:0/2473641073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f045c0047c0 0x7f045c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.346+0000 7f04737fe640 1 -- 172.21.15.88:0/2473641073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c003520 con 0x7f045c003a50 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.346+0000 7f0473fff640 1 -- 172.21.15.88:0/2473641073 reap_dead start 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.346+0000 7f04737fe640 1 --2- 172.21.15.88:0/2473641073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f045c003a50 0x7f045c003e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0464009ac0 tx=0x7f045c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad9869df2c61da4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.346+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046402c6b0 con 0x7f045c003a50 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.346+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046402c810 con 0x7f045c003a50 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.346+0000 7f04727fc640 1 -- 172.21.15.88:0/2473641073 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046402cba0 con 0x7f045c003a50 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.347+0000 7f0479f00640 1 -- 172.21.15.88:0/2473641073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f045c003a50 msgr2=0x7f045c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.347+0000 7f0479f00640 1 --2- 172.21.15.88:0/2473641073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f045c003a50 0x7f045c003e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0464009ac0 tx=0x7f045c0057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.347+0000 7f0479f00640 1 -- 172.21.15.88:0/2473641073 shutdown_connections 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.347+0000 7f0479f00640 1 --2- 172.21.15.88:0/2473641073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f045c003a50 0x7f045c003e70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.347+0000 7f0479f00640 1 -- 172.21.15.88:0/2473641073 >> 172.21.15.88:0/2473641073 conn(0x7f04740a2d80 msgr2=0x7f04740a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.347+0000 7f0479f00640 1 -- 172.21.15.88:0/2473641073 shutdown_connections 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.347+0000 7f0479f00640 1 -- 172.21.15.88:0/2473641073 wait complete. 2024-01-22T10:13:00.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.348+0000 7f0479f00640 1 Processor -- start 2024-01-22T10:13:00.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.348+0000 7f0479f00640 1 -- start start 2024-01-22T10:13:00.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0479f00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f045c003a50 0x7f04740b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0479f00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04740b91d0 0x7f04740b9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0479f00640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04741e1700 0x7f04741e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0479f00640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04740b4390 con 0x7f04741e1700 2024-01-22T10:13:00.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0479f00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04740b7120 con 0x7f045c003a50 2024-01-22T10:13:00.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0479f00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04741e20c0 con 0x7f04740b91d0 2024-01-22T10:13:00.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0473fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04741e1700 0x7f04741e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0473fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04741e1700 0x7f04741e1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36248/0 (socket says 172.21.15.88:36248) 2024-01-22T10:13:00.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0473fff640 1 -- 172.21.15.88:0/3012875509 learned_addr learned my addr 172.21.15.88:0/3012875509 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:00.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f04737fe640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f045c003a50 0x7f04740b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0472ffd640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04740b91d0 0x7f04740b9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0473fff640 1 -- 172.21.15.88:0/3012875509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04740b91d0 msgr2=0x7f04740b9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0473fff640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04740b91d0 0x7f04740b9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0473fff640 1 -- 172.21.15.88:0/3012875509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f045c003a50 msgr2=0x7f04740b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0473fff640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f045c003a50 0x7f04740b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0473fff640 1 -- 172.21.15.88:0/3012875509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04741e1180 con 0x7f04741e1700 2024-01-22T10:13:00.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0473fff640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04741e1700 0x7f04741e1b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f04740b7f00 tx=0x7f046c00fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:00.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f045bfff640 1 -- 172.21.15.88:0/3012875509 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c00fed0 con 0x7f04741e1700 2024-01-22T10:13:00.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f045bfff640 1 -- 172.21.15.88:0/3012875509 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c003b80 con 0x7f04741e1700 2024-01-22T10:13:00.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f045bfff640 1 -- 172.21.15.88:0/3012875509 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c0050d0 con 0x7f04741e1700 2024-01-22T10:13:00.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0479f00640 1 -- 172.21.15.88:0/3012875509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04740b7390 con 0x7f04741e1700 2024-01-22T10:13:00.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.349+0000 7f0479f00640 1 -- 172.21.15.88:0/3012875509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04740baa40 con 0x7f04741e1700 2024-01-22T10:13:00.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.350+0000 7f0479f00640 1 -- 172.21.15.88:0/3012875509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047404ea30 con 0x7f04741e1700 2024-01-22T10:13:00.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.351+0000 7f045bfff640 1 -- 172.21.15.88:0/3012875509 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f046c005230 con 0x7f04741e1700 2024-01-22T10:13:00.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.351+0000 7f045bfff640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f046006b330 0x7f046006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.351+0000 7f04737fe640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f046006b330 0x7f046006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.351+0000 7f045bfff640 1 -- 172.21.15.88:0/3012875509 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f046c089620 con 0x7f04741e1700 2024-01-22T10:13:00.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.352+0000 7f04737fe640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f046006b330 0x7f046006d7f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0464036000 tx=0x7f0464030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:00.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.355+0000 7f045bfff640 1 -- 172.21.15.88:0/3012875509 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f046c054690 con 0x7f04741e1700 2024-01-22T10:13:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.528+0000 7f0479f00640 1 -- 172.21.15.88:0/3012875509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f04740bff70 con 0x7f04741e1700 2024-01-22T10:13:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.528+0000 7f045bfff640 1 -- 172.21.15.88:0/3012875509 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f046c057cb0 con 0x7f04741e1700 2024-01-22T10:13:00.511 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:00.511 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2024-01-22T10:13:00.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:00.511 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2024-01-22T10:13:00.511 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2024-01-22T10:13:00.511 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:00.512 INFO:teuthology.orchestra.run.smithi088.stdout:] 2024-01-22T10:13:00.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.530+0000 7f0479f00640 1 -- 172.21.15.88:0/3012875509 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f046006b330 msgr2=0x7f046006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.530+0000 7f0479f00640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f046006b330 0x7f046006d7f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0464036000 tx=0x7f0464030000 comp rx=0 tx=0).stop 2024-01-22T10:13:00.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.530+0000 7f0479f00640 1 -- 172.21.15.88:0/3012875509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04741e1700 msgr2=0x7f04741e1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.530+0000 7f0479f00640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04741e1700 0x7f04741e1b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f04740b7f00 tx=0x7f046c00fc80 comp rx=0 tx=0).stop 2024-01-22T10:13:00.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.530+0000 7f0479f00640 1 -- 172.21.15.88:0/3012875509 shutdown_connections 2024-01-22T10:13:00.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.530+0000 7f0479f00640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f046006b330 0x7f046006d7f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.530+0000 7f0479f00640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04740b91d0 0x7f04740b9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.530+0000 7f0479f00640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04741e1700 0x7f04741e1b80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.530+0000 7f0479f00640 1 --2- 172.21.15.88:0/3012875509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f045c003a50 0x7f04740b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.530+0000 7f0479f00640 1 -- 172.21.15.88:0/3012875509 >> 172.21.15.88:0/3012875509 conn(0x7f04740a2d80 msgr2=0x7f04740c0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.530+0000 7f0479f00640 1 -- 172.21.15.88:0/3012875509 shutdown_connections 2024-01-22T10:13:00.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.530+0000 7f0479f00640 1 -- 172.21.15.88:0/3012875509 wait complete. 2024-01-22T10:13:00.523 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T10:13:00.523 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-22T10:13:00.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.643+0000 7f254533e640 1 Processor -- start 2024-01-22T10:13:00.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.643+0000 7f254533e640 1 -- start start 2024-01-22T10:13:00.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.643+0000 7f254533e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f25400bf1f0 0x7f25400bf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.643+0000 7f254533e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25400b4800 con 0x7f2540154090 2024-01-22T10:13:00.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.643+0000 7f254533e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25400bd1c0 con 0x7f25400bba60 2024-01-22T10:13:00.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.643+0000 7f254533e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254006ae80 con 0x7f25400bf1f0 2024-01-22T10:13:00.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2540154090 0x7f2540156480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53262/0 (socket says 172.21.15.88:53262) 2024-01-22T10:13:00.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253f7fe640 1 -- 172.21.15.88:0/2788627810 learned_addr learned my addr 172.21.15.88:0/2788627810 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:00.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940424388 0 0) 0x7f2538001490 con 0x7f2540154090 2024-01-22T10:13:00.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253e7fc640 1 --2- 172.21.15.88:0/2788627810 >> v2:172.21.15.119:3300/0 conn(0x7f25400bf1f0 0x7f25400bf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2528003520 con 0x7f2540154090 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224360629 0 0) 0x7f2528003520 con 0x7f2540154090 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 >> v2:172.21.15.119:3300/0 conn(0x7f25400bf1f0 msgr2=0x7f25400bf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 --2- 172.21.15.88:0/2788627810 >> v2:172.21.15.119:3300/0 conn(0x7f25400bf1f0 0x7f25400bf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 >> v1:172.21.15.119:6789/0 conn(0x7f25400bba60 legacy=0x7f2540148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25400bcf50 con 0x7f2540154090 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f2538001b80 con 0x7f2540154090 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 >> v1:172.21.15.88:6789/0 conn(0x7f2540154090 legacy=0x7f2540156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 --2- 172.21.15.88:0/2788627810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2528003970 0x7f2528003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 --2- 172.21.15.88:0/2788627810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25280047c0 0x7f2528004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 --2- 172.21.15.88:0/2788627810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 0x7f252800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252800bff0 con 0x7f2528005180 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252800c160 con 0x7f25280047c0 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252800c320 con 0x7f2528003970 2024-01-22T10:13:00.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253f7fe640 1 --2- 172.21.15.88:0/2788627810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 0x7f252800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253e7fc640 1 --2- 172.21.15.88:0/2788627810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25280047c0 0x7f2528004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253effd640 1 --2- 172.21.15.88:0/2788627810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2528003970 0x7f2528003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253f7fe640 1 -- 172.21.15.88:0/2788627810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2528003970 msgr2=0x7f2528003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253f7fe640 1 --2- 172.21.15.88:0/2788627810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2528003970 0x7f2528003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253f7fe640 1 -- 172.21.15.88:0/2788627810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25280047c0 msgr2=0x7f2528004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253f7fe640 1 --2- 172.21.15.88:0/2788627810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25280047c0 0x7f2528004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.644+0000 7f253f7fe640 1 -- 172.21.15.88:0/2788627810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528003520 con 0x7f2528005180 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.645+0000 7f253f7fe640 1 -- 172.21.15.88:0/2788627810 reap_dead start 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.645+0000 7f253f7fe640 1 --2- 172.21.15.88:0/2788627810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 0x7f252800b980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f253800a830 tx=0x7f25280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c98325425f8105 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.645+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2538034630 con 0x7f2528005180 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.645+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253802f070 con 0x7f2528005180 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.645+0000 7f253dffb640 1 -- 172.21.15.88:0/2788627810 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25380349f0 con 0x7f2528005180 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.646+0000 7f254533e640 1 -- 172.21.15.88:0/2788627810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 msgr2=0x7f252800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.646+0000 7f254533e640 1 --2- 172.21.15.88:0/2788627810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 0x7f252800b980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f253800a830 tx=0x7f25280057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.646+0000 7f254533e640 1 -- 172.21.15.88:0/2788627810 shutdown_connections 2024-01-22T10:13:00.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.646+0000 7f254533e640 1 --2- 172.21.15.88:0/2788627810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 0x7f252800b980 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.646+0000 7f254533e640 1 -- 172.21.15.88:0/2788627810 >> 172.21.15.88:0/2788627810 conn(0x7f25400c0e70 msgr2=0x7f25400c1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:00.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.646+0000 7f254533e640 1 -- 172.21.15.88:0/2788627810 shutdown_connections 2024-01-22T10:13:00.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.646+0000 7f254533e640 1 -- 172.21.15.88:0/2788627810 wait complete. 2024-01-22T10:13:00.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.647+0000 7f254533e640 1 Processor -- start 2024-01-22T10:13:00.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.647+0000 7f254533e640 1 -- start start 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f254533e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 0x7f2540142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f254533e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25400b8730 0x7f25400b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f254533e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25401499a0 0x7f25400b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f254533e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25400b8310 con 0x7f2528005180 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f254533e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2540143300 con 0x7f25400b8730 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f254533e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25400ba2c0 con 0x7f25401499a0 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f253effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 0x7f2540142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f253effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 0x7f2540142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36274/0 (socket says 172.21.15.88:36274) 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f253effd640 1 -- 172.21.15.88:0/3415065808 learned_addr learned my addr 172.21.15.88:0/3415065808 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f253e7fc640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25400b8730 0x7f25400b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f253f7fe640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25401499a0 0x7f25400b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f253effd640 1 -- 172.21.15.88:0/3415065808 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25401499a0 msgr2=0x7f25400b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f253effd640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25401499a0 0x7f25400b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f253effd640 1 -- 172.21.15.88:0/3415065808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25400b8730 msgr2=0x7f25400b9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f253effd640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25400b8730 0x7f25400b9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f253effd640 1 -- 172.21.15.88:0/3415065808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25400b8e30 con 0x7f2528005180 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f253f7fe640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25401499a0 0x7f25400b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f253effd640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 0x7f2540142dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f253000f5f0 tx=0x7f253000f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f25277fe640 1 -- 172.21.15.88:0/3415065808 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25300052e0 con 0x7f2528005180 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f25277fe640 1 -- 172.21.15.88:0/3415065808 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2530005440 con 0x7f2528005180 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f254533e640 1 -- 172.21.15.88:0/3415065808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25400b9110 con 0x7f2528005180 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f25277fe640 1 -- 172.21.15.88:0/3415065808 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2530003830 con 0x7f2528005180 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.648+0000 7f254533e640 1 -- 172.21.15.88:0/3415065808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2540146a50 con 0x7f2528005180 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.649+0000 7f254533e640 1 -- 172.21.15.88:0/3415065808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25400bb310 con 0x7f2528005180 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.650+0000 7f25277fe640 1 -- 172.21.15.88:0/3415065808 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f2530003990 con 0x7f2528005180 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.650+0000 7f25277fe640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f252c06b360 0x7f252c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:00.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.650+0000 7f253e7fc640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f252c06b360 0x7f252c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:00.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.650+0000 7f25277fe640 1 -- 172.21.15.88:0/3415065808 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f25300891e0 con 0x7f2528005180 2024-01-22T10:13:00.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.651+0000 7f253e7fc640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f252c06b360 0x7f252c06d820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f25400a5300 tx=0x7f2534009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:00.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.655+0000 7f25277fe640 1 -- 172.21.15.88:0/3415065808 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f25300541d0 con 0x7f2528005180 2024-01-22T10:13:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:00.826+0000 7f254533e640 1 -- 172.21.15.88:0/3415065808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f25400b8b80 con 0x7f2528005180 2024-01-22T10:13:01.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.492+0000 7f25277fe640 1 -- 172.21.15.88:0/3415065808 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f25300577f0 con 0x7f2528005180 2024-01-22T10:13:01.475 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2024-01-22T10:13:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.495+0000 7f254533e640 1 -- 172.21.15.88:0/3415065808 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f252c06b360 msgr2=0x7f252c06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.495+0000 7f254533e640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f252c06b360 0x7f252c06d820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f25400a5300 tx=0x7f2534009190 comp rx=0 tx=0).stop 2024-01-22T10:13:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.495+0000 7f254533e640 1 -- 172.21.15.88:0/3415065808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 msgr2=0x7f2540142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.495+0000 7f254533e640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 0x7f2540142dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f253000f5f0 tx=0x7f253000f9f0 comp rx=0 tx=0).stop 2024-01-22T10:13:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.495+0000 7f254533e640 1 -- 172.21.15.88:0/3415065808 shutdown_connections 2024-01-22T10:13:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.495+0000 7f254533e640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f252c06b360 0x7f252c06d820 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.495+0000 7f254533e640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25401499a0 0x7f25400b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.495+0000 7f254533e640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25400b8730 0x7f25400b9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.495+0000 7f254533e640 1 --2- 172.21.15.88:0/3415065808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2528005180 0x7f2540142dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.495+0000 7f254533e640 1 -- 172.21.15.88:0/3415065808 >> 172.21.15.88:0/3415065808 conn(0x7f25400c0e70 msgr2=0x7f25400a1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:01.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.495+0000 7f254533e640 1 -- 172.21.15.88:0/3415065808 shutdown_connections 2024-01-22T10:13:01.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.495+0000 7f254533e640 1 -- 172.21.15.88:0/3415065808 wait complete. 2024-01-22T10:13:01.493 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T10:13:01.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.618+0000 7f6ff956e640 1 Processor -- start 2024-01-22T10:13:01.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.618+0000 7f6ff956e640 1 -- start start 2024-01-22T10:13:01.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.619+0000 7f6ff956e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6ff40bbb00 0x7f6ff414ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:01.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.619+0000 7f6ff956e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ff40b45a0 0x7f6ff414b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:01.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.619+0000 7f6ff956e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff40bd1c0 con 0x7f6ff40bdde0 2024-01-22T10:13:01.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.619+0000 7f6ff956e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff40bc560 con 0x7f6ff40bbb00 2024-01-22T10:13:01.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.619+0000 7f6ff956e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40c0820 con 0x7f6ff40b45a0 2024-01-22T10:13:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.619+0000 7f6ff2ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6ff40bbb00 0x7f6ff414ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.619+0000 7f6ff27fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ff40b45a0 0x7f6ff414b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.619+0000 7f6ff37fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f6ff40bdde0 0x7f6ff414ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.88:38400/0 (socket says 172.21.15.88:38400) 2024-01-22T10:13:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.619+0000 7f6ff37fe640 1 -- 172.21.15.88:0/1899706291 learned_addr learned my addr 172.21.15.88:0/1899706291 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.619+0000 7f6ff27fc640 1 --2- 172.21.15.88:0/1899706291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ff40b45a0 0x7f6ff414b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:44760/0 (socket says 172.21.15.88:44760) 2024-01-22T10:13:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.619+0000 7f6ff27fc640 1 -- 172.21.15.88:0/1899706291 >> v2:172.21.15.119:3300/0 conn(0x7f6ff40bbb00 msgr2=0x7f6ff414ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.619+0000 7f6ff27fc640 1 --2- 172.21.15.88:0/1899706291 >> v2:172.21.15.119:3300/0 conn(0x7f6ff40bbb00 0x7f6ff414ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.620+0000 7f6ff27fc640 1 -- 172.21.15.88:0/1899706291 >> v1:172.21.15.119:6789/0 conn(0x7f6ff40bdde0 legacy=0x7f6ff414ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.620+0000 7f6ff27fc640 1 -- 172.21.15.88:0/1899706291 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff40c0b00 con 0x7f6ff40b45a0 2024-01-22T10:13:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.620+0000 7f6ff2ffd640 1 --2- 172.21.15.88:0/1899706291 >> v2:172.21.15.119:3300/0 conn(0x7f6ff40bbb00 0x7f6ff414ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.620+0000 7f6ff27fc640 1 --2- 172.21.15.88:0/1899706291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ff40b45a0 0x7f6ff414b3b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80097a0 tx=0x7f6fe802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cfe0d2f62318acf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.620+0000 7f6ff1ffb640 1 -- 172.21.15.88:0/1899706291 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8031830 con 0x7f6ff40b45a0 2024-01-22T10:13:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.620+0000 7f6ff1ffb640 1 -- 172.21.15.88:0/1899706291 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe8031990 con 0x7f6ff40b45a0 2024-01-22T10:13:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.621+0000 7f6ff1ffb640 1 -- 172.21.15.88:0/1899706291 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8031d20 con 0x7f6ff40b45a0 2024-01-22T10:13:01.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.621+0000 7f6ff956e640 1 -- 172.21.15.88:0/1899706291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ff40b45a0 msgr2=0x7f6ff414b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.621+0000 7f6ff956e640 1 --2- 172.21.15.88:0/1899706291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ff40b45a0 0x7f6ff414b3b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80097a0 tx=0x7f6fe802b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.621+0000 7f6ff956e640 1 -- 172.21.15.88:0/1899706291 shutdown_connections 2024-01-22T10:13:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.621+0000 7f6ff956e640 1 --2- 172.21.15.88:0/1899706291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ff40b45a0 0x7f6ff414b3b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.621+0000 7f6ff956e640 1 --2- 172.21.15.88:0/1899706291 >> v2:172.21.15.119:3300/0 conn(0x7f6ff40bbb00 0x7f6ff414ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.621+0000 7f6ff956e640 1 -- 172.21.15.88:0/1899706291 >> 172.21.15.88:0/1899706291 conn(0x7f6ff40a2c20 msgr2=0x7f6ff40a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.621+0000 7f6ff956e640 1 -- 172.21.15.88:0/1899706291 shutdown_connections 2024-01-22T10:13:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.621+0000 7f6ff956e640 1 -- 172.21.15.88:0/1899706291 wait complete. 2024-01-22T10:13:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.622+0000 7f6ff956e640 1 Processor -- start 2024-01-22T10:13:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.622+0000 7f6ff956e640 1 -- start start 2024-01-22T10:13:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff956e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ff40b45a0 0x7f6ff40b8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff956e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff40bbb00 0x7f6ff40ba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff956e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ff40bdde0 0x7f6ff40b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff956e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40b9420 con 0x7f6ff40b45a0 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff956e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40baef0 con 0x7f6ff40bbb00 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff956e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff4141af0 con 0x7f6ff40bdde0 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ff40b45a0 0x7f6ff40b8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ff40b45a0 0x7f6ff40b8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36290/0 (socket says 172.21.15.88:36290) 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff2ffd640 1 -- 172.21.15.88:0/1188319998 learned_addr learned my addr 172.21.15.88:0/1188319998 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff27fc640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff40bbb00 0x7f6ff40ba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff37fe640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ff40bdde0 0x7f6ff40b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff2ffd640 1 -- 172.21.15.88:0/1188319998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ff40bdde0 msgr2=0x7f6ff40b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff2ffd640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ff40bdde0 0x7f6ff40b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff2ffd640 1 -- 172.21.15.88:0/1188319998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff40bbb00 msgr2=0x7f6ff40ba6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff2ffd640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff40bbb00 0x7f6ff40ba6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.623+0000 7f6ff2ffd640 1 -- 172.21.15.88:0/1188319998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe4009a70 con 0x7f6ff40b45a0 2024-01-22T10:13:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.624+0000 7f6ff2ffd640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ff40b45a0 0x7f6ff40b8ee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009f60 tx=0x7f6fe4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.624+0000 7f6fdb7fe640 1 -- 172.21.15.88:0/1188319998 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4014680 con 0x7f6ff40b45a0 2024-01-22T10:13:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.624+0000 7f6fdb7fe640 1 -- 172.21.15.88:0/1188319998 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe400f040 con 0x7f6ff40b45a0 2024-01-22T10:13:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.624+0000 7f6ff956e640 1 -- 172.21.15.88:0/1188319998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe8009400 con 0x7f6ff40b45a0 2024-01-22T10:13:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.624+0000 7f6fdb7fe640 1 -- 172.21.15.88:0/1188319998 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4014a00 con 0x7f6ff40b45a0 2024-01-22T10:13:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.624+0000 7f6ff956e640 1 -- 172.21.15.88:0/1188319998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff40b4270 con 0x7f6ff40b45a0 2024-01-22T10:13:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.625+0000 7f6ff956e640 1 -- 172.21.15.88:0/1188319998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff4067c40 con 0x7f6ff40b45a0 2024-01-22T10:13:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.625+0000 7f6fdb7fe640 1 -- 172.21.15.88:0/1188319998 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f6fe4014b60 con 0x7f6ff40b45a0 2024-01-22T10:13:01.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.625+0000 7f6fdb7fe640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6fe006b330 0x7f6fe006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:01.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.626+0000 7f6fdb7fe640 1 -- 172.21.15.88:0/1188319998 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6fe408a880 con 0x7f6ff40b45a0 2024-01-22T10:13:01.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.626+0000 7f6ff27fc640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6fe006b330 0x7f6fe006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:01.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.626+0000 7f6ff27fc640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6fe006b330 0x7f6fe006d7f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8036000 tx=0x7f6fe803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:01.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.630+0000 7f6fdb7fe640 1 -- 172.21.15.88:0/1188319998 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6fe4055830 con 0x7f6ff40b45a0 2024-01-22T10:13:01.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:01.798+0000 7f6ff956e640 1 -- 172.21.15.88:0/1188319998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6ff40c1d50 con 0x7f6ff40b45a0 2024-01-22T10:13:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.494+0000 7f6fdb7fe640 1 -- 172.21.15.88:0/1188319998 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6fe4058e50 con 0x7f6ff40b45a0 2024-01-22T10:13:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2024-01-22T10:13:02.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.497+0000 7f6ff956e640 1 -- 172.21.15.88:0/1188319998 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6fe006b330 msgr2=0x7f6fe006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:02.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.497+0000 7f6ff956e640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6fe006b330 0x7f6fe006d7f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8036000 tx=0x7f6fe803c040 comp rx=0 tx=0).stop 2024-01-22T10:13:02.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.497+0000 7f6ff956e640 1 -- 172.21.15.88:0/1188319998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ff40b45a0 msgr2=0x7f6ff40b8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:02.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.497+0000 7f6ff956e640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ff40b45a0 0x7f6ff40b8ee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009f60 tx=0x7f6fe4009f90 comp rx=0 tx=0).stop 2024-01-22T10:13:02.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.497+0000 7f6ff956e640 1 -- 172.21.15.88:0/1188319998 shutdown_connections 2024-01-22T10:13:02.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.497+0000 7f6ff956e640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6fe006b330 0x7f6fe006d7f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:02.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.497+0000 7f6ff956e640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ff40bdde0 0x7f6ff40b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:02.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.497+0000 7f6ff956e640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff40bbb00 0x7f6ff40ba6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:02.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.497+0000 7f6ff956e640 1 --2- 172.21.15.88:0/1188319998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ff40b45a0 0x7f6ff40b8ee0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:02.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.497+0000 7f6ff956e640 1 -- 172.21.15.88:0/1188319998 >> 172.21.15.88:0/1188319998 conn(0x7f6ff40a2c20 msgr2=0x7f6ff40a1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:02.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.498+0000 7f6ff956e640 1 -- 172.21.15.88:0/1188319998 shutdown_connections 2024-01-22T10:13:02.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.498+0000 7f6ff956e640 1 -- 172.21.15.88:0/1188319998 wait complete. 2024-01-22T10:13:02.508 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T10:13:02.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.630+0000 7fddfbd5a640 1 Processor -- start 2024-01-22T10:13:02.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.630+0000 7fddfbd5a640 1 -- start start 2024-01-22T10:13:02.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddfbd5a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddf40bded0 0x7fddf406aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddfbd5a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddf40b4590 0x7fddf4148b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddfbd5a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fddf4149050 0x7fddf414ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddfbd5a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf41494c0 con 0x7fddf40b4590 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddfbd5a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf40c0830 con 0x7fddf4149050 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddfbd5a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40c0b10 con 0x7fddf40bded0 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddf92f5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddf40b4590 0x7fddf4148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddf92f5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddf40b4590 0x7fddf4148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36302/0 (socket says 172.21.15.88:36302) 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddf92f5640 1 -- 172.21.15.88:0/3602392663 learned_addr learned my addr 172.21.15.88:0/3602392663 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddf92f5640 1 -- 172.21.15.88:0/3602392663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddf40bded0 msgr2=0x7fddf406aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddf92f5640 1 --2- 172.21.15.88:0/3602392663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddf40bded0 0x7fddf406aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddf92f5640 1 -- 172.21.15.88:0/3602392663 >> v2:172.21.15.119:3300/0 conn(0x7fddf4149050 msgr2=0x7fddf414ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddfa2f7640 1 --2- 172.21.15.88:0/3602392663 >> v2:172.21.15.119:3300/0 conn(0x7fddf4149050 0x7fddf414ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:02.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddf92f5640 1 --2- 172.21.15.88:0/3602392663 >> v2:172.21.15.119:3300/0 conn(0x7fddf4149050 0x7fddf414ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddf92f5640 1 -- 172.21.15.88:0/3602392663 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf40bb890 con 0x7fddf40b4590 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.631+0000 7fddfa2f7640 1 --2- 172.21.15.88:0/3602392663 >> v2:172.21.15.119:3300/0 conn(0x7fddf4149050 0x7fddf414ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.632+0000 7fddf92f5640 1 --2- 172.21.15.88:0/3602392663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf40b4590 0x7fddf4148b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fddf40bc640 tx=0x7fdde402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f46cc656537bad server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.632+0000 7fddf8af4640 1 -- 172.21.15.88:0/3602392663 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4031870 con 0x7fddf40b4590 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.632+0000 7fddf8af4640 1 -- 172.21.15.88:0/3602392663 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde40319d0 con 0x7fddf40b4590 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.632+0000 7fddf8af4640 1 -- 172.21.15.88:0/3602392663 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4031d60 con 0x7fddf40b4590 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.633+0000 7fddfbd5a640 1 -- 172.21.15.88:0/3602392663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf40b4590 msgr2=0x7fddf4148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.633+0000 7fddfbd5a640 1 --2- 172.21.15.88:0/3602392663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf40b4590 0x7fddf4148b10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fddf40bc640 tx=0x7fdde402b910 comp rx=0 tx=0).stop 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.633+0000 7fddfbd5a640 1 -- 172.21.15.88:0/3602392663 shutdown_connections 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.633+0000 7fddfbd5a640 1 --2- 172.21.15.88:0/3602392663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf40b4590 0x7fddf4148b10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.633+0000 7fddfbd5a640 1 --2- 172.21.15.88:0/3602392663 >> v2:172.21.15.119:3300/0 conn(0x7fddf4149050 0x7fddf414ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.633+0000 7fddfbd5a640 1 --2- 172.21.15.88:0/3602392663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddf40bded0 0x7fddf406aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.633+0000 7fddfbd5a640 1 -- 172.21.15.88:0/3602392663 >> 172.21.15.88:0/3602392663 conn(0x7fddf40a2d70 msgr2=0x7fddf40a3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.633+0000 7fddfbd5a640 1 -- 172.21.15.88:0/3602392663 shutdown_connections 2024-01-22T10:13:02.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.633+0000 7fddfbd5a640 1 -- 172.21.15.88:0/3602392663 wait complete. 2024-01-22T10:13:02.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.634+0000 7fddfbd5a640 1 Processor -- start 2024-01-22T10:13:02.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.634+0000 7fddfbd5a640 1 -- start start 2024-01-22T10:13:02.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.634+0000 7fddfbd5a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf40b4590 0x7fddf40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:02.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.634+0000 7fddfbd5a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddf40bded0 0x7fddf414bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:02.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.634+0000 7fddfbd5a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf4149050 0x7fddf41499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:02.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.634+0000 7fddfbd5a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40a56f0 con 0x7fddf4149050 2024-01-22T10:13:02.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.634+0000 7fddfbd5a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf41e4840 con 0x7fddf40b4590 2024-01-22T10:13:02.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.634+0000 7fddfbd5a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf41e4aa0 con 0x7fddf40bded0 2024-01-22T10:13:02.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddfa2f7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf4149050 0x7fddf41499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:02.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddfa2f7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf4149050 0x7fddf41499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36310/0 (socket says 172.21.15.88:36310) 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddfa2f7640 1 -- 172.21.15.88:0/570171567 learned_addr learned my addr 172.21.15.88:0/570171567 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddf92f5640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddf40bded0 0x7fddf414bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddf9af6640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf40b4590 0x7fddf40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddfa2f7640 1 -- 172.21.15.88:0/570171567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddf40bded0 msgr2=0x7fddf414bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddfa2f7640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddf40bded0 0x7fddf414bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddfa2f7640 1 -- 172.21.15.88:0/570171567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf40b4590 msgr2=0x7fddf40a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddfa2f7640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf40b4590 0x7fddf40a51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddfa2f7640 1 -- 172.21.15.88:0/570171567 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde40094d0 con 0x7fddf4149050 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddfa2f7640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf4149050 0x7fddf41499e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fddec00c7c0 tx=0x7fddec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddea7fc640 1 -- 172.21.15.88:0/570171567 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec004230 con 0x7fddf4149050 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddea7fc640 1 -- 172.21.15.88:0/570171567 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec004390 con 0x7fddf4149050 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddfbd5a640 1 -- 172.21.15.88:0/570171567 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf41e4d80 con 0x7fddf4149050 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddea7fc640 1 -- 172.21.15.88:0/570171567 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec007860 con 0x7fddf4149050 2024-01-22T10:13:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.635+0000 7fddfbd5a640 1 -- 172.21.15.88:0/570171567 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf414c110 con 0x7fddf4149050 2024-01-22T10:13:02.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.636+0000 7fddfbd5a640 1 -- 172.21.15.88:0/570171567 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf40bce30 con 0x7fddf4149050 2024-01-22T10:13:02.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.637+0000 7fddea7fc640 1 -- 172.21.15.88:0/570171567 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fddec0079c0 con 0x7fddf4149050 2024-01-22T10:13:02.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.637+0000 7fddea7fc640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fddd806b330 0x7fddd806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:02.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.637+0000 7fddea7fc640 1 -- 172.21.15.88:0/570171567 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fddec089df0 con 0x7fddf4149050 2024-01-22T10:13:02.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.637+0000 7fddf9af6640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fddd806b330 0x7fddd806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:02.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.637+0000 7fddf9af6640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fddd806b330 0x7fddd806d7f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009f20 tx=0x7fddf00094f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:02.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.641+0000 7fddea7fc640 1 -- 172.21.15.88:0/570171567 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fddec054ba0 con 0x7fddf4149050 2024-01-22T10:13:02.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:02.849+0000 7fddfbd5a640 1 -- 172.21.15.88:0/570171567 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fddf404ea30 con 0x7fddf4149050 2024-01-22T10:13:02.851 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:13:02.853 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:13:02.856 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:13:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.515+0000 7fddea7fc640 1 -- 172.21.15.88:0/570171567 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fddec0150c0 con 0x7fddf4149050 2024-01-22T10:13:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 2 and data pool 3 2024-01-22T10:13:03.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.517+0000 7fddfbd5a640 1 -- 172.21.15.88:0/570171567 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fddd806b330 msgr2=0x7fddd806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.518+0000 7fddfbd5a640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fddd806b330 0x7fddd806d7f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009f20 tx=0x7fddf00094f0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.518+0000 7fddfbd5a640 1 -- 172.21.15.88:0/570171567 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf4149050 msgr2=0x7fddf41499e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.518+0000 7fddfbd5a640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf4149050 0x7fddf41499e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fddec00c7c0 tx=0x7fddec00cc80 comp rx=0 tx=0).stop 2024-01-22T10:13:03.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.518+0000 7fddfbd5a640 1 -- 172.21.15.88:0/570171567 shutdown_connections 2024-01-22T10:13:03.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.518+0000 7fddfbd5a640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fddd806b330 0x7fddd806d7f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.518+0000 7fddfbd5a640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddf40bded0 0x7fddf414bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.518+0000 7fddfbd5a640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddf4149050 0x7fddf41499e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.518+0000 7fddfbd5a640 1 --2- 172.21.15.88:0/570171567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf40b4590 0x7fddf40a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.518+0000 7fddfbd5a640 1 -- 172.21.15.88:0/570171567 >> 172.21.15.88:0/570171567 conn(0x7fddf40a2d70 msgr2=0x7fddf40a12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:03.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.518+0000 7fddfbd5a640 1 -- 172.21.15.88:0/570171567 shutdown_connections 2024-01-22T10:13:03.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.518+0000 7fddfbd5a640 1 -- 172.21.15.88:0/570171567 wait complete. 2024-01-22T10:13:03.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:03.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.630+0000 7fbfee533640 1 Processor -- start 2024-01-22T10:13:03.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.630+0000 7fbfee533640 1 -- start start 2024-01-22T10:13:03.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.630+0000 7fbfee533640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbfe8148c30 0x7fbfe8149080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.630+0000 7fbfee533640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbfe8154000 0x7fbfe81563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfee533640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe80bb800 con 0x7fbfe80bdee0 2024-01-22T10:13:03.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfee533640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe80bbb50 con 0x7fbfe8148c30 2024-01-22T10:13:03.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfee533640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe80bc520 con 0x7fbfe8154000 2024-01-22T10:13:03.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfe77fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbfe8148c30 0x7fbfe8149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfe7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbfe80bdee0 0x7fbfe814b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53278/0 (socket says 172.21.15.88:53278) 2024-01-22T10:13:03.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfe77fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbfe8148c30 0x7fbfe8149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36318/0 (socket says 172.21.15.88:36318) 2024-01-22T10:13:03.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfe7fff640 1 -- 172.21.15.88:0/2682784455 learned_addr learned my addr 172.21.15.88:0/2682784455 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:03.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfecad0640 1 --2- 172.21.15.88:0/2682784455 >> v2:172.21.15.119:3300/0 conn(0x7fbfe8154000 0x7fbfe81563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfe77fe640 1 -- 172.21.15.88:0/2682784455 >> v2:172.21.15.119:3300/0 conn(0x7fbfe8154000 msgr2=0x7fbfe81563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:03.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfe77fe640 1 --2- 172.21.15.88:0/2682784455 >> v2:172.21.15.119:3300/0 conn(0x7fbfe8154000 0x7fbfe81563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfe77fe640 1 -- 172.21.15.88:0/2682784455 >> v1:172.21.15.88:6789/0 conn(0x7fbfe80bdee0 legacy=0x7fbfe814b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfe77fe640 1 -- 172.21.15.88:0/2682784455 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe80bf820 con 0x7fbfe8148c30 2024-01-22T10:13:03.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.631+0000 7fbfe6ffd640 1 -- 172.21.15.88:0/2682784455 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226921263 0 0) 0x7fbfe80bb800 con 0x7fbfe80bdee0 2024-01-22T10:13:03.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.632+0000 7fbfe77fe640 1 --2- 172.21.15.88:0/2682784455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe8148c30 0x7fbfe8149080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80bd060 tx=0x7fbfdc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa75bcfea5db4e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:03.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.632+0000 7fbfe6ffd640 1 -- 172.21.15.88:0/2682784455 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc02e070 con 0x7fbfe8148c30 2024-01-22T10:13:03.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.632+0000 7fbfe6ffd640 1 -- 172.21.15.88:0/2682784455 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc0315a0 con 0x7fbfe8148c30 2024-01-22T10:13:03.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.632+0000 7fbfe6ffd640 1 -- 172.21.15.88:0/2682784455 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc031930 con 0x7fbfe8148c30 2024-01-22T10:13:03.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.632+0000 7fbfee533640 1 -- 172.21.15.88:0/2682784455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe8148c30 msgr2=0x7fbfe8149080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.632+0000 7fbfee533640 1 --2- 172.21.15.88:0/2682784455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe8148c30 0x7fbfe8149080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80bd060 tx=0x7fbfdc02b840 comp rx=0 tx=0).stop 2024-01-22T10:13:03.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.632+0000 7fbfee533640 1 -- 172.21.15.88:0/2682784455 shutdown_connections 2024-01-22T10:13:03.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.632+0000 7fbfee533640 1 --2- 172.21.15.88:0/2682784455 >> v2:172.21.15.119:3300/0 conn(0x7fbfe8154000 0x7fbfe81563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.632+0000 7fbfee533640 1 --2- 172.21.15.88:0/2682784455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe8148c30 0x7fbfe8149080 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.632+0000 7fbfee533640 1 -- 172.21.15.88:0/2682784455 >> 172.21.15.88:0/2682784455 conn(0x7fbfe80a2d80 msgr2=0x7fbfe80a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:03.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.632+0000 7fbfee533640 1 -- 172.21.15.88:0/2682784455 shutdown_connections 2024-01-22T10:13:03.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.632+0000 7fbfee533640 1 -- 172.21.15.88:0/2682784455 wait complete. 2024-01-22T10:13:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.633+0000 7fbfee533640 1 Processor -- start 2024-01-22T10:13:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfee533640 1 -- start start 2024-01-22T10:13:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfee533640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfe80bdee0 0x7fbfe81e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfee533640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe8148c30 0x7fbfe80ba220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfee533640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfe8154000 0x7fbfe809a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfee533640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe809b390 con 0x7fbfe8148c30 2024-01-22T10:13:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfee533640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8147c60 con 0x7fbfe8154000 2024-01-22T10:13:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfee533640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe80a2550 con 0x7fbfe80bdee0 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfe77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe8148c30 0x7fbfe80ba220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfe77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe8148c30 0x7fbfe80ba220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36320/0 (socket says 172.21.15.88:36320) 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfe77fe640 1 -- 172.21.15.88:0/2552162083 learned_addr learned my addr 172.21.15.88:0/2552162083 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfecad0640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfe8154000 0x7fbfe809a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfe7fff640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfe80bdee0 0x7fbfe81e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfe77fe640 1 -- 172.21.15.88:0/2552162083 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfe80bdee0 msgr2=0x7fbfe81e50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfe77fe640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfe80bdee0 0x7fbfe81e50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfe77fe640 1 -- 172.21.15.88:0/2552162083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfe8154000 msgr2=0x7fbfe809a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfe77fe640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfe8154000 0x7fbfe809a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.634+0000 7fbfe77fe640 1 -- 172.21.15.88:0/2552162083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc009400 con 0x7fbfe8148c30 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.635+0000 7fbfe77fe640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe8148c30 0x7fbfe80ba220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009890 tx=0x7fbfdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.635+0000 7fbfe4ff9640 1 -- 172.21.15.88:0/2552162083 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc032840 con 0x7fbfe8148c30 2024-01-22T10:13:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.635+0000 7fbfe4ff9640 1 -- 172.21.15.88:0/2552162083 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc0329a0 con 0x7fbfe8148c30 2024-01-22T10:13:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.635+0000 7fbfe4ff9640 1 -- 172.21.15.88:0/2552162083 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc032d50 con 0x7fbfe8148c30 2024-01-22T10:13:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.635+0000 7fbfee533640 1 -- 172.21.15.88:0/2552162083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe81e4630 con 0x7fbfe8148c30 2024-01-22T10:13:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.635+0000 7fbfee533640 1 -- 172.21.15.88:0/2552162083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe81e4bb0 con 0x7fbfe8148c30 2024-01-22T10:13:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.636+0000 7fbfee533640 1 -- 172.21.15.88:0/2552162083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe80b9710 con 0x7fbfe8148c30 2024-01-22T10:13:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.636+0000 7fbfe4ff9640 1 -- 172.21.15.88:0/2552162083 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fbfdc03b3f0 con 0x7fbfe8148c30 2024-01-22T10:13:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.636+0000 7fbfe4ff9640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbfd406b330 0x7fbfd406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.637+0000 7fbfe4ff9640 1 -- 172.21.15.88:0/2552162083 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfdc0abb70 con 0x7fbfe8148c30 2024-01-22T10:13:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.637+0000 7fbfe7fff640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbfd406b330 0x7fbfd406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.637+0000 7fbfe7fff640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbfd406b330 0x7fbfd406d7f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8007fd0 tx=0x7fbfd8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:03.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.641+0000 7fbfe4ff9640 1 -- 172.21.15.88:0/2552162083 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fbfdc076890 con 0x7fbfe8148c30 2024-01-22T10:13:03.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.812+0000 7fbfee533640 1 -- 172.21.15.88:0/2552162083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfe804ea30 con 0x7fbfe8148c30 2024-01-22T10:13:03.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.813+0000 7fbfe4ff9640 1 -- 172.21.15.88:0/2552162083 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16495 (secure 0 0 0) 0x7fbfdc079eb0 con 0x7fbfe8148c30 2024-01-22T10:13:03.797 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:03.797 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:02.850819+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:03.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.815+0000 7fbfee533640 1 -- 172.21.15.88:0/2552162083 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbfd406b330 msgr2=0x7fbfd406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.815+0000 7fbfee533640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbfd406b330 0x7fbfd406d7f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8007fd0 tx=0x7fbfd8009040 comp rx=0 tx=0).stop 2024-01-22T10:13:03.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.815+0000 7fbfee533640 1 -- 172.21.15.88:0/2552162083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe8148c30 msgr2=0x7fbfe80ba220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.815+0000 7fbfee533640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe8148c30 0x7fbfe80ba220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009890 tx=0x7fbfdc0046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.815+0000 7fbfee533640 1 -- 172.21.15.88:0/2552162083 shutdown_connections 2024-01-22T10:13:03.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.815+0000 7fbfee533640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbfd406b330 0x7fbfd406d7f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.815+0000 7fbfee533640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfe8154000 0x7fbfe809a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.815+0000 7fbfee533640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe8148c30 0x7fbfe80ba220 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.815+0000 7fbfee533640 1 --2- 172.21.15.88:0/2552162083 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfe80bdee0 0x7fbfe81e50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.815+0000 7fbfee533640 1 -- 172.21.15.88:0/2552162083 >> 172.21.15.88:0/2552162083 conn(0x7fbfe80a2d80 msgr2=0x7fbfe814a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:03.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.815+0000 7fbfee533640 1 -- 172.21.15.88:0/2552162083 shutdown_connections 2024-01-22T10:13:03.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.815+0000 7fbfee533640 1 -- 172.21.15.88:0/2552162083 wait complete. 2024-01-22T10:13:03.809 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:03.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.925+0000 7f12f1189640 1 Processor -- start 2024-01-22T10:13:03.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.925+0000 7f12f1189640 1 -- start start 2024-01-22T10:13:03.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12f1189640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f12ec0bdee0 0x7f12ec0bbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12f1189640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0bcfd0 con 0x7f12ec0b45a0 2024-01-22T10:13:03.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12f1189640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0bd240 con 0x7f12ec148c30 2024-01-22T10:13:03.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12f1189640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ec0c0670 con 0x7f12ec0bdee0 2024-01-22T10:13:03.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12ea59c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f12ec0b45a0 0x7f12ec06aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53280/0 (socket says 172.21.15.88:53280) 2024-01-22T10:13:03.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12ea59c640 1 -- 172.21.15.88:0/4176511990 learned_addr learned my addr 172.21.15.88:0/4176511990 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808501864 0 0) 0x7f12ec0bcfd0 con 0x7f12ec0b45a0 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d4003520 con 0x7f12ec0b45a0 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12ead9d640 1 --2- 172.21.15.88:0/4176511990 >> v2:172.21.15.119:3300/0 conn(0x7f12ec0bdee0 0x7f12ec0bbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1902532159 0 0) 0x7f12d4003520 con 0x7f12ec0b45a0 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 >> v2:172.21.15.119:3300/0 conn(0x7f12ec0bdee0 msgr2=0x7f12ec0bbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 --2- 172.21.15.88:0/4176511990 >> v2:172.21.15.119:3300/0 conn(0x7f12ec0bdee0 0x7f12ec0bbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 >> v1:172.21.15.119:6789/0 conn(0x7f12ec148c30 legacy=0x7f12ec1560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec0c0950 con 0x7f12ec0b45a0 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f12e00017f0 con 0x7f12ec0b45a0 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 >> v1:172.21.15.88:6789/0 conn(0x7f12ec0b45a0 legacy=0x7f12ec06aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 --2- 172.21.15.88:0/4176511990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12d4003aa0 0x7f12d4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 --2- 172.21.15.88:0/4176511990 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12d40047c0 0x7f12d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 --2- 172.21.15.88:0/4176511990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12d40052a0 0x7f12d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0c0670 con 0x7f12d4003aa0 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d400c150 con 0x7f12d40052a0 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d400c310 con 0x7f12d40047c0 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.926+0000 7f12ead9d640 1 --2- 172.21.15.88:0/4176511990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12d4003aa0 0x7f12d4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12ea59c640 1 --2- 172.21.15.88:0/4176511990 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12d40047c0 0x7f12d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12eb59e640 1 --2- 172.21.15.88:0/4176511990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12d40052a0 0x7f12d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12ead9d640 1 -- 172.21.15.88:0/4176511990 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12d40047c0 msgr2=0x7f12d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12ead9d640 1 --2- 172.21.15.88:0/4176511990 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12d40047c0 0x7f12d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12ead9d640 1 -- 172.21.15.88:0/4176511990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12d40052a0 msgr2=0x7f12d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12ead9d640 1 --2- 172.21.15.88:0/4176511990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12d40052a0 0x7f12d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12eb59e640 1 -- 172.21.15.88:0/4176511990 reap_dead start 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12ead9d640 1 -- 172.21.15.88:0/4176511990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d4003520 con 0x7f12d4003aa0 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12ea59c640 1 --2- 172.21.15.88:0/4176511990 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12d40047c0 0x7f12d4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12ead9d640 1 --2- 172.21.15.88:0/4176511990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12d4003aa0 0x7f12d4003ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009a90 tx=0x7f12d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b39d38a35fa562 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc02c680 con 0x7f12d4003aa0 2024-01-22T10:13:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc02c7e0 con 0x7f12d4003aa0 2024-01-22T10:13:03.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.927+0000 7f12e9d9b640 1 -- 172.21.15.88:0/4176511990 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc02cb70 con 0x7f12d4003aa0 2024-01-22T10:13:03.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.928+0000 7f12f1189640 1 -- 172.21.15.88:0/4176511990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12d4003aa0 msgr2=0x7f12d4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.928+0000 7f12f1189640 1 --2- 172.21.15.88:0/4176511990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12d4003aa0 0x7f12d4003ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009a90 tx=0x7f12d40057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.928+0000 7f12f1189640 1 -- 172.21.15.88:0/4176511990 shutdown_connections 2024-01-22T10:13:03.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.928+0000 7f12f1189640 1 --2- 172.21.15.88:0/4176511990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12d4003aa0 0x7f12d4003ec0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.928+0000 7f12f1189640 1 -- 172.21.15.88:0/4176511990 >> 172.21.15.88:0/4176511990 conn(0x7f12ec0a2b70 msgr2=0x7f12ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:03.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.928+0000 7f12f1189640 1 -- 172.21.15.88:0/4176511990 shutdown_connections 2024-01-22T10:13:03.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.928+0000 7f12f1189640 1 -- 172.21.15.88:0/4176511990 wait complete. 2024-01-22T10:13:03.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.929+0000 7f12f1189640 1 Processor -- start 2024-01-22T10:13:03.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.929+0000 7f12f1189640 1 -- start start 2024-01-22T10:13:03.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12f1189640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12d4003aa0 0x7f12ec140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12f1189640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12ec1449a0 0x7f12ec141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12f1189640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12ec141dd0 0x7f12ec1e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12f1189640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec144e20 con 0x7f12ec1449a0 2024-01-22T10:13:03.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12f1189640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec1403e0 con 0x7f12d4003aa0 2024-01-22T10:13:03.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12f1189640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec141470 con 0x7f12ec141dd0 2024-01-22T10:13:03.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12ea59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12ec1449a0 0x7f12ec141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12ea59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12ec1449a0 0x7f12ec141890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36328/0 (socket says 172.21.15.88:36328) 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12ea59c640 1 -- 172.21.15.88:0/1263908859 learned_addr learned my addr 172.21.15.88:0/1263908859 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12ead9d640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12d4003aa0 0x7f12ec140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12eb59e640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12ec141dd0 0x7f12ec1e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12ea59c640 1 -- 172.21.15.88:0/1263908859 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12ec141dd0 msgr2=0x7f12ec1e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12ea59c640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12ec141dd0 0x7f12ec1e48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12ea59c640 1 -- 172.21.15.88:0/1263908859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12d4003aa0 msgr2=0x7f12ec140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12ea59c640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12d4003aa0 0x7f12ec140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12ea59c640 1 -- 172.21.15.88:0/1263908859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec14bac0 con 0x7f12ec1449a0 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12ead9d640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12d4003aa0 0x7f12ec140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.930+0000 7f12ea59c640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12ec1449a0 0x7f12ec141890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f12e0000c00 tx=0x7f12e000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.931+0000 7f12d37fe640 1 -- 172.21.15.88:0/1263908859 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e00070d0 con 0x7f12ec1449a0 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.931+0000 7f12d37fe640 1 -- 172.21.15.88:0/1263908859 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0007230 con 0x7f12ec1449a0 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.931+0000 7f12f1189640 1 -- 172.21.15.88:0/1263908859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec13fbe0 con 0x7f12ec1449a0 2024-01-22T10:13:03.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.931+0000 7f12d37fe640 1 -- 172.21.15.88:0/1263908859 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e00075e0 con 0x7f12ec1449a0 2024-01-22T10:13:03.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.931+0000 7f12f1189640 1 -- 172.21.15.88:0/1263908859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec0bb450 con 0x7f12ec1449a0 2024-01-22T10:13:03.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.932+0000 7f12f1189640 1 -- 172.21.15.88:0/1263908859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec140100 con 0x7f12ec1449a0 2024-01-22T10:13:03.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.932+0000 7f12d37fe640 1 -- 172.21.15.88:0/1263908859 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f12e00057a0 con 0x7f12ec1449a0 2024-01-22T10:13:03.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.932+0000 7f12d37fe640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f12d806b330 0x7f12d806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:03.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.932+0000 7f12d37fe640 1 -- 172.21.15.88:0/1263908859 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12e0089bb0 con 0x7f12ec1449a0 2024-01-22T10:13:03.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.932+0000 7f12ead9d640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f12d806b330 0x7f12d806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:03.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.933+0000 7f12ead9d640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f12d806b330 0x7f12d806d7f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f12dc036000 tx=0x7f12dc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:03.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:03.937+0000 7f12d37fe640 1 -- 172.21.15.88:0/1263908859 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f12ec140100 con 0x7f12ec1449a0 2024-01-22T10:13:04.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.106+0000 7f12f1189640 1 -- 172.21.15.88:0/1263908859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12ec04ea30 con 0x7f12ec1449a0 2024-01-22T10:13:04.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.107+0000 7f12d37fe640 1 -- 172.21.15.88:0/1263908859 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16495 (secure 0 0 0) 0x7f12e00547b0 con 0x7f12ec1449a0 2024-01-22T10:13:04.090 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:04.090 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:02.850819+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.109+0000 7f12f1189640 1 -- 172.21.15.88:0/1263908859 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f12d806b330 msgr2=0x7f12d806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.109+0000 7f12f1189640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f12d806b330 0x7f12d806d7f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f12dc036000 tx=0x7f12dc030000 comp rx=0 tx=0).stop 2024-01-22T10:13:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.109+0000 7f12f1189640 1 -- 172.21.15.88:0/1263908859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12ec1449a0 msgr2=0x7f12ec141890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.109+0000 7f12f1189640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12ec1449a0 0x7f12ec141890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f12e0000c00 tx=0x7f12e000ec10 comp rx=0 tx=0).stop 2024-01-22T10:13:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.109+0000 7f12f1189640 1 -- 172.21.15.88:0/1263908859 shutdown_connections 2024-01-22T10:13:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.109+0000 7f12f1189640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f12d806b330 0x7f12d806d7f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.109+0000 7f12f1189640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12ec141dd0 0x7f12ec1e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.109+0000 7f12f1189640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12ec1449a0 0x7f12ec141890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.109+0000 7f12f1189640 1 --2- 172.21.15.88:0/1263908859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12d4003aa0 0x7f12ec140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.109+0000 7f12f1189640 1 -- 172.21.15.88:0/1263908859 >> 172.21.15.88:0/1263908859 conn(0x7f12ec0a2b70 msgr2=0x7f12ec0a5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.109+0000 7f12f1189640 1 -- 172.21.15.88:0/1263908859 shutdown_connections 2024-01-22T10:13:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.109+0000 7f12f1189640 1 -- 172.21.15.88:0/1263908859 wait complete. 2024-01-22T10:13:04.102 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T10:13:04.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.221+0000 7f665a9dc640 1 Processor -- start 2024-01-22T10:13:04.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.221+0000 7f665a9dc640 1 -- start start 2024-01-22T10:13:04.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f665a9dc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f665406a960 0x7f66540b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f665a9dc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66540b8fb0 0x7f66541432a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f665a9dc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f66540ba130 0x7f66541437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f665a9dc640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66540b7370 con 0x7f665406a960 2024-01-22T10:13:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f665a9dc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6654143d20 con 0x7f66540ba130 2024-01-22T10:13:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f665a9dc640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66540b6d60 con 0x7f66540b8fb0 2024-01-22T10:13:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f6653fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f665406a960 0x7f66540b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f6653fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f665406a960 0x7f66540b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36342/0 (socket says 172.21.15.88:36342) 2024-01-22T10:13:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f6653fff640 1 -- 172.21.15.88:0/1584771893 learned_addr learned my addr 172.21.15.88:0/1584771893 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f6653fff640 1 -- 172.21.15.88:0/1584771893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66540b8fb0 msgr2=0x7f66541432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f6653fff640 1 --2- 172.21.15.88:0/1584771893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66540b8fb0 0x7f66541432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f6653fff640 1 -- 172.21.15.88:0/1584771893 >> v2:172.21.15.119:3300/0 conn(0x7f66540ba130 msgr2=0x7f66541437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f6653fff640 1 --2- 172.21.15.88:0/1584771893 >> v2:172.21.15.119:3300/0 conn(0x7f66540ba130 0x7f66541437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.222+0000 7f6653fff640 1 -- 172.21.15.88:0/1584771893 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665406b660 con 0x7f665406a960 2024-01-22T10:13:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.223+0000 7f6653fff640 1 --2- 172.21.15.88:0/1584771893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f665406a960 0x7f66540b8a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f665406cb50 tx=0x7f664402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0c7750b0ac7515 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:04.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.223+0000 7f6652ffd640 1 -- 172.21.15.88:0/1584771893 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644030840 con 0x7f665406a960 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.223+0000 7f6652ffd640 1 -- 172.21.15.88:0/1584771893 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66440309a0 con 0x7f665406a960 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.223+0000 7f6652ffd640 1 -- 172.21.15.88:0/1584771893 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644030d30 con 0x7f665406a960 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.224+0000 7f665a9dc640 1 -- 172.21.15.88:0/1584771893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f665406a960 msgr2=0x7f66540b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.224+0000 7f665a9dc640 1 --2- 172.21.15.88:0/1584771893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f665406a960 0x7f66540b8a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f665406cb50 tx=0x7f664402b980 comp rx=0 tx=0).stop 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.224+0000 7f665a9dc640 1 -- 172.21.15.88:0/1584771893 shutdown_connections 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.224+0000 7f665a9dc640 1 --2- 172.21.15.88:0/1584771893 >> v2:172.21.15.119:3300/0 conn(0x7f66540ba130 0x7f66541437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.224+0000 7f665a9dc640 1 --2- 172.21.15.88:0/1584771893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66540b8fb0 0x7f66541432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.224+0000 7f665a9dc640 1 --2- 172.21.15.88:0/1584771893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f665406a960 0x7f66540b8a70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.224+0000 7f665a9dc640 1 -- 172.21.15.88:0/1584771893 >> 172.21.15.88:0/1584771893 conn(0x7f665406b800 msgr2=0x7f665406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.224+0000 7f665a9dc640 1 -- 172.21.15.88:0/1584771893 shutdown_connections 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.224+0000 7f665a9dc640 1 -- 172.21.15.88:0/1584771893 wait complete. 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.225+0000 7f665a9dc640 1 Processor -- start 2024-01-22T10:13:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.225+0000 7f665a9dc640 1 -- start start 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f665a9dc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f665406a960 0x7f66541d5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f665a9dc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66540ba130 0x7f6654148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f665a9dc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6654148bb0 0x7f665413c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f665a9dc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66541d6490 con 0x7f66540ba130 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f665a9dc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66541cfd70 con 0x7f6654148bb0 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f665a9dc640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6654149d50 con 0x7f665406a960 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f66537fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66540ba130 0x7f6654148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f6653fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f665406a960 0x7f66541d5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f66537fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66540ba130 0x7f6654148670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36352/0 (socket says 172.21.15.88:36352) 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f66537fe640 1 -- 172.21.15.88:0/3182179689 learned_addr learned my addr 172.21.15.88:0/3182179689 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f6658f79640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6654148bb0 0x7f665413c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f66537fe640 1 -- 172.21.15.88:0/3182179689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f665406a960 msgr2=0x7f66541d5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f66537fe640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f665406a960 0x7f66541d5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f66537fe640 1 -- 172.21.15.88:0/3182179689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6654148bb0 msgr2=0x7f665413c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f66537fe640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6654148bb0 0x7f665413c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f66537fe640 1 -- 172.21.15.88:0/3182179689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66440094d0 con 0x7f66540ba130 2024-01-22T10:13:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f66537fe640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66540ba130 0x7f6654148670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f664800b4a0 tx=0x7f664800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f6650ff9640 1 -- 172.21.15.88:0/3182179689 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648010610 con 0x7f66540ba130 2024-01-22T10:13:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f6650ff9640 1 -- 172.21.15.88:0/3182179689 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6648010770 con 0x7f66540ba130 2024-01-22T10:13:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f665a9dc640 1 -- 172.21.15.88:0/3182179689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6654145b10 con 0x7f66540ba130 2024-01-22T10:13:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f6650ff9640 1 -- 172.21.15.88:0/3182179689 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648010b20 con 0x7f66540ba130 2024-01-22T10:13:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.226+0000 7f665a9dc640 1 -- 172.21.15.88:0/3182179689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665414a620 con 0x7f66540ba130 2024-01-22T10:13:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.228+0000 7f665a9dc640 1 -- 172.21.15.88:0/3182179689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66540b7770 con 0x7f66540ba130 2024-01-22T10:13:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.228+0000 7f6650ff9640 1 -- 172.21.15.88:0/3182179689 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f6648010c80 con 0x7f66540ba130 2024-01-22T10:13:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.228+0000 7f6650ff9640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f664006b360 0x7f664006d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.228+0000 7f6653fff640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f664006b360 0x7f664006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.228+0000 7f6650ff9640 1 -- 172.21.15.88:0/3182179689 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66480896b0 con 0x7f66540ba130 2024-01-22T10:13:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.229+0000 7f6653fff640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f664006b360 0x7f664006d820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6644036000 tx=0x7f6644008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.233+0000 7f6650ff9640 1 -- 172.21.15.88:0/3182179689 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f66540b7770 con 0x7f66540ba130 2024-01-22T10:13:04.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.433+0000 7f665a9dc640 1 -- 172.21.15.88:0/3182179689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f66540b7770 con 0x7f66540ba130 2024-01-22T10:13:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.518+0000 7f6650ff9640 1 -- 172.21.15.88:0/3182179689 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f66540b7770 con 0x7f66540ba130 2024-01-22T10:13:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.520+0000 7f665a9dc640 1 -- 172.21.15.88:0/3182179689 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f664006b360 msgr2=0x7f664006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.520+0000 7f665a9dc640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f664006b360 0x7f664006d820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6644036000 tx=0x7f6644008030 comp rx=0 tx=0).stop 2024-01-22T10:13:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.520+0000 7f665a9dc640 1 -- 172.21.15.88:0/3182179689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66540ba130 msgr2=0x7f6654148670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.520+0000 7f665a9dc640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66540ba130 0x7f6654148670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f664800b4a0 tx=0x7f664800b960 comp rx=0 tx=0).stop 2024-01-22T10:13:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.520+0000 7f665a9dc640 1 -- 172.21.15.88:0/3182179689 shutdown_connections 2024-01-22T10:13:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.520+0000 7f665a9dc640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f664006b360 0x7f664006d820 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.520+0000 7f665a9dc640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6654148bb0 0x7f665413c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.520+0000 7f665a9dc640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66540ba130 0x7f6654148670 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.520+0000 7f665a9dc640 1 --2- 172.21.15.88:0/3182179689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f665406a960 0x7f66541d5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.520+0000 7f665a9dc640 1 -- 172.21.15.88:0/3182179689 >> 172.21.15.88:0/3182179689 conn(0x7f665406b800 msgr2=0x7f66540738e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.520+0000 7f665a9dc640 1 -- 172.21.15.88:0/3182179689 shutdown_connections 2024-01-22T10:13:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.520+0000 7f665a9dc640 1 -- 172.21.15.88:0/3182179689 wait complete. 2024-01-22T10:13:04.514 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T10:13:04.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T10:13:04.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.633+0000 7f6688d7d640 1 Processor -- start 2024-01-22T10:13:04.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.633+0000 7f6688d7d640 1 -- start start 2024-01-22T10:13:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.634+0000 7f6688d7d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66840b5520 0x7f6684143040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.634+0000 7f6688d7d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f668414d2b0 0x7f6684143580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.634+0000 7f6688d7d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66840b78a0 con 0x7f66840727d0 2024-01-22T10:13:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.634+0000 7f6688d7d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66840b6cd0 con 0x7f668414d2b0 2024-01-22T10:13:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.634+0000 7f6688d7d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66840b6f70 con 0x7f66840b5520 2024-01-22T10:13:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.634+0000 7f6682d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f668414d2b0 0x7f6684143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.634+0000 7f668259c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f66840727d0 0x7f668414cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53282/0 (socket says 172.21.15.88:53282) 2024-01-22T10:13:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.634+0000 7f668259c640 1 -- 172.21.15.88:0/1516866593 learned_addr learned my addr 172.21.15.88:0/1516866593 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.635+0000 7f6681d9b640 1 --2- 172.21.15.88:0/1516866593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66840b5520 0x7f6684143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:04.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.635+0000 7f6682d9d640 1 -- 172.21.15.88:0/1516866593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66840b5520 msgr2=0x7f6684143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.635+0000 7f6682d9d640 1 --2- 172.21.15.88:0/1516866593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66840b5520 0x7f6684143040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.635+0000 7f6682d9d640 1 -- 172.21.15.88:0/1516866593 >> v1:172.21.15.88:6789/0 conn(0x7f66840727d0 legacy=0x7f668414cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.635+0000 7f668159a640 1 -- 172.21.15.88:0/1516866593 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368262489 0 0) 0x7f66840b78a0 con 0x7f66840727d0 2024-01-22T10:13:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.635+0000 7f6682d9d640 1 -- 172.21.15.88:0/1516866593 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840b7250 con 0x7f668414d2b0 2024-01-22T10:13:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.635+0000 7f6682d9d640 1 --2- 172.21.15.88:0/1516866593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668414d2b0 0x7f6684143580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f667c0097a0 tx=0x7f667c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42dbf15760149353 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.635+0000 7f668159a640 1 -- 172.21.15.88:0/1516866593 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c030610 con 0x7f668414d2b0 2024-01-22T10:13:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.636+0000 7f668159a640 1 -- 172.21.15.88:0/1516866593 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c030770 con 0x7f668414d2b0 2024-01-22T10:13:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.636+0000 7f668159a640 1 -- 172.21.15.88:0/1516866593 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c030b00 con 0x7f668414d2b0 2024-01-22T10:13:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.636+0000 7f6688d7d640 1 -- 172.21.15.88:0/1516866593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668414d2b0 msgr2=0x7f6684143580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:04.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.636+0000 7f6688d7d640 1 --2- 172.21.15.88:0/1516866593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668414d2b0 0x7f6684143580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f667c0097a0 tx=0x7f667c02b960 comp rx=0 tx=0).stop 2024-01-22T10:13:04.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.636+0000 7f6688d7d640 1 -- 172.21.15.88:0/1516866593 shutdown_connections 2024-01-22T10:13:04.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.636+0000 7f6688d7d640 1 --2- 172.21.15.88:0/1516866593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668414d2b0 0x7f6684143580 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.636+0000 7f6688d7d640 1 --2- 172.21.15.88:0/1516866593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66840b5520 0x7f6684143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.636+0000 7f6688d7d640 1 -- 172.21.15.88:0/1516866593 >> 172.21.15.88:0/1516866593 conn(0x7f668406be30 msgr2=0x7f66840bdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:04.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.636+0000 7f6688d7d640 1 -- 172.21.15.88:0/1516866593 shutdown_connections 2024-01-22T10:13:04.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.636+0000 7f6688d7d640 1 -- 172.21.15.88:0/1516866593 wait complete. 2024-01-22T10:13:04.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.637+0000 7f6688d7d640 1 Processor -- start 2024-01-22T10:13:04.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.637+0000 7f6688d7d640 1 -- start start 2024-01-22T10:13:04.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6688d7d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66840727d0 0x7f6684147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6688d7d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66840b5520 0x7f6684145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6688d7d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668414d2b0 0x7f668413cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6688d7d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66841460b0 con 0x7f668414d2b0 2024-01-22T10:13:04.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6688d7d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668413e300 con 0x7f66840b5520 2024-01-22T10:13:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6688d7d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66841454b0 con 0x7f66840727d0 2024-01-22T10:13:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6682d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668414d2b0 0x7f668413cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6682d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668414d2b0 0x7f668413cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36366/0 (socket says 172.21.15.88:36366) 2024-01-22T10:13:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6682d9d640 1 -- 172.21.15.88:0/423087350 learned_addr learned my addr 172.21.15.88:0/423087350 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f668259c640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66840727d0 0x7f6684147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6681d9b640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66840b5520 0x7f6684145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6682d9d640 1 -- 172.21.15.88:0/423087350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66840727d0 msgr2=0x7f6684147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6682d9d640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66840727d0 0x7f6684147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6682d9d640 1 -- 172.21.15.88:0/423087350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66840b5520 msgr2=0x7f6684145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6682d9d640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66840b5520 0x7f6684145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.638+0000 7f6682d9d640 1 -- 172.21.15.88:0/423087350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c009400 con 0x7f668414d2b0 2024-01-22T10:13:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.639+0000 7f6682d9d640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668414d2b0 0x7f668413cb10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f667c0098c0 tx=0x7f667c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.639+0000 7f6672ffd640 1 -- 172.21.15.88:0/423087350 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c03e070 con 0x7f668414d2b0 2024-01-22T10:13:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.639+0000 7f6672ffd640 1 -- 172.21.15.88:0/423087350 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c006e10 con 0x7f668414d2b0 2024-01-22T10:13:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.639+0000 7f6688d7d640 1 -- 172.21.15.88:0/423087350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66841446f0 con 0x7f668414d2b0 2024-01-22T10:13:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.639+0000 7f6672ffd640 1 -- 172.21.15.88:0/423087350 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c039bd0 con 0x7f668414d2b0 2024-01-22T10:13:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.639+0000 7f6688d7d640 1 -- 172.21.15.88:0/423087350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6684144f90 con 0x7f668414d2b0 2024-01-22T10:13:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.640+0000 7f6688d7d640 1 -- 172.21.15.88:0/423087350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66841448e0 con 0x7f668414d2b0 2024-01-22T10:13:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.640+0000 7f6672ffd640 1 -- 172.21.15.88:0/423087350 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f667c039d30 con 0x7f668414d2b0 2024-01-22T10:13:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.640+0000 7f6672ffd640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f666406b330 0x7f666406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:04.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.640+0000 7f6672ffd640 1 -- 172.21.15.88:0/423087350 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f667c0abf50 con 0x7f668414d2b0 2024-01-22T10:13:04.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.640+0000 7f668259c640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f666406b330 0x7f666406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:04.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.641+0000 7f668259c640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f666406b330 0x7f666406d7f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f66740012e0 tx=0x7f6674007ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:04.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.645+0000 7f6672ffd640 1 -- 172.21.15.88:0/423087350 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f667c076c70 con 0x7f668414d2b0 2024-01-22T10:13:04.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:04.852+0000 7f6688d7d640 1 -- 172.21.15.88:0/423087350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6684144ae0 con 0x7f668414d2b0 2024-01-22T10:13:05.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.525+0000 7f6672ffd640 1 -- 172.21.15.88:0/423087350 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f667c0340c0 con 0x7f668414d2b0 2024-01-22T10:13:05.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.527+0000 7f6688d7d640 1 -- 172.21.15.88:0/423087350 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f666406b330 msgr2=0x7f666406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:05.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.527+0000 7f6688d7d640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f666406b330 0x7f666406d7f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f66740012e0 tx=0x7f6674007ed0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.527+0000 7f6688d7d640 1 -- 172.21.15.88:0/423087350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668414d2b0 msgr2=0x7f668413cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.527+0000 7f6688d7d640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668414d2b0 0x7f668413cb10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f667c0098c0 tx=0x7f667c0046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.528+0000 7f6688d7d640 1 -- 172.21.15.88:0/423087350 shutdown_connections 2024-01-22T10:13:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.528+0000 7f6688d7d640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f666406b330 0x7f666406d7f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.528+0000 7f6688d7d640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f668414d2b0 0x7f668413cb10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.528+0000 7f6688d7d640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66840b5520 0x7f6684145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.528+0000 7f6688d7d640 1 --2- 172.21.15.88:0/423087350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66840727d0 0x7f6684147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.528+0000 7f6688d7d640 1 -- 172.21.15.88:0/423087350 >> 172.21.15.88:0/423087350 conn(0x7f668406be30 msgr2=0x7f66840ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.528+0000 7f6688d7d640 1 -- 172.21.15.88:0/423087350 shutdown_connections 2024-01-22T10:13:05.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.528+0000 7f6688d7d640 1 -- 172.21.15.88:0/423087350 wait complete. 2024-01-22T10:13:05.521 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T10:13:05.521 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:13:05.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.638+0000 7f550440e640 1 Processor -- start 2024-01-22T10:13:05.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.638+0000 7f550440e640 1 -- start start 2024-01-22T10:13:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.639+0000 7f550440e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54fc0ba170 0x7f54fc06a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.639+0000 7f550440e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54fc0b8040 con 0x7f54fc14ece0 2024-01-22T10:13:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.639+0000 7f550440e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54fc06ae10 con 0x7f54fc0b9d90 2024-01-22T10:13:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.639+0000 7f550440e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54fc06ac30 con 0x7f54fc0ba170 2024-01-22T10:13:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.639+0000 7f55019a9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54fc0ba170 0x7f54fc06a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.639+0000 7f55019a9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54fc0ba170 0x7f54fc06a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36382/0 (socket says 172.21.15.88:36382) 2024-01-22T10:13:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.639+0000 7f55029ab640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f54fc14ece0 0x7f54fc14f130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53296/0 (socket says 172.21.15.88:53296) 2024-01-22T10:13:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.639+0000 7f55019a9640 1 -- 172.21.15.88:0/284655041 learned_addr learned my addr 172.21.15.88:0/284655041 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.640+0000 7f55019a9640 1 -- 172.21.15.88:0/284655041 >> v1:172.21.15.119:6789/0 conn(0x7f54fc0b9d90 legacy=0x7f54fc0b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.640+0000 7f55019a9640 1 -- 172.21.15.88:0/284655041 >> v1:172.21.15.88:6789/0 conn(0x7f54fc14ece0 legacy=0x7f54fc14f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.640+0000 7f55019a9640 1 -- 172.21.15.88:0/284655041 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc070b20 con 0x7f54fc0ba170 2024-01-22T10:13:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.640+0000 7f55011a8640 1 -- 172.21.15.88:0/284655041 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808759880 0 0) 0x7f54fc0b8040 con 0x7f54fc14ece0 2024-01-22T10:13:05.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.640+0000 7f55019a9640 1 --2- 172.21.15.88:0/284655041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54fc0ba170 0x7f54fc06a6f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009870 tx=0x7f54ec02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd97660fe713077 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:05.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.641+0000 7f55011a8640 1 -- 172.21.15.88:0/284655041 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec02f840 con 0x7f54fc0ba170 2024-01-22T10:13:05.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.641+0000 7f55011a8640 1 -- 172.21.15.88:0/284655041 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec02f9a0 con 0x7f54fc0ba170 2024-01-22T10:13:05.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.641+0000 7f55011a8640 1 -- 172.21.15.88:0/284655041 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec02fd30 con 0x7f54fc0ba170 2024-01-22T10:13:05.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.641+0000 7f550440e640 1 -- 172.21.15.88:0/284655041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54fc0ba170 msgr2=0x7f54fc06a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:05.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.641+0000 7f550440e640 1 --2- 172.21.15.88:0/284655041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54fc0ba170 0x7f54fc06a6f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009870 tx=0x7f54ec02ba20 comp rx=0 tx=0).stop 2024-01-22T10:13:05.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.641+0000 7f550440e640 1 -- 172.21.15.88:0/284655041 shutdown_connections 2024-01-22T10:13:05.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.641+0000 7f550440e640 1 --2- 172.21.15.88:0/284655041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54fc0ba170 0x7f54fc06a6f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.641+0000 7f550440e640 1 -- 172.21.15.88:0/284655041 >> 172.21.15.88:0/284655041 conn(0x7f54fc0bdbf0 msgr2=0x7f54fc0bdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:05.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.641+0000 7f550440e640 1 -- 172.21.15.88:0/284655041 shutdown_connections 2024-01-22T10:13:05.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.641+0000 7f550440e640 1 -- 172.21.15.88:0/284655041 wait complete. 2024-01-22T10:13:05.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.642+0000 7f550440e640 1 Processor -- start 2024-01-22T10:13:05.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.642+0000 7f550440e640 1 -- start start 2024-01-22T10:13:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f550440e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54fc0b9d90 0x7f54fc1d63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f550440e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54fc0ba170 0x7f54fc1d71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f550440e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54fc14ece0 0x7f54fc1400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f550440e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc1d79d0 con 0x7f54fc0ba170 2024-01-22T10:13:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f550440e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc1d68f0 con 0x7f54fc14ece0 2024-01-22T10:13:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f550440e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc1d5f20 con 0x7f54fc0b9d90 2024-01-22T10:13:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f55019a9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54fc0ba170 0x7f54fc1d71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f55019a9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54fc0ba170 0x7f54fc1d71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36388/0 (socket says 172.21.15.88:36388) 2024-01-22T10:13:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f55019a9640 1 -- 172.21.15.88:0/1315149788 learned_addr learned my addr 172.21.15.88:0/1315149788 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f55029ab640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54fc14ece0 0x7f54fc1400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f55021aa640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54fc0b9d90 0x7f54fc1d63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f55019a9640 1 -- 172.21.15.88:0/1315149788 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54fc0b9d90 msgr2=0x7f54fc1d63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f55019a9640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54fc0b9d90 0x7f54fc1d63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f55019a9640 1 -- 172.21.15.88:0/1315149788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54fc14ece0 msgr2=0x7f54fc1400c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f55019a9640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54fc14ece0 0x7f54fc1400c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f55019a9640 1 -- 172.21.15.88:0/1315149788 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec0094d0 con 0x7f54fc0ba170 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f55029ab640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54fc14ece0 0x7f54fc1400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.643+0000 7f55019a9640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54fc0ba170 0x7f54fc1d71b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0097c0 tx=0x7f54ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.644+0000 7f54f2ffd640 1 -- 172.21.15.88:0/1315149788 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec02f7d0 con 0x7f54fc0ba170 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.644+0000 7f54f2ffd640 1 -- 172.21.15.88:0/1315149788 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec042480 con 0x7f54fc0ba170 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.644+0000 7f550440e640 1 -- 172.21.15.88:0/1315149788 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc1d5910 con 0x7f54fc0ba170 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.644+0000 7f54f2ffd640 1 -- 172.21.15.88:0/1315149788 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec042830 con 0x7f54fc0ba170 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.644+0000 7f550440e640 1 -- 172.21.15.88:0/1315149788 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc1d5bb0 con 0x7f54fc0ba170 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.645+0000 7f550440e640 1 -- 172.21.15.88:0/1315149788 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc1d5d70 con 0x7f54fc0ba170 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.645+0000 7f54f2ffd640 1 -- 172.21.15.88:0/1315149788 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f54ec02d3d0 con 0x7f54fc0ba170 2024-01-22T10:13:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.645+0000 7f54f2ffd640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f54e006b330 0x7f54e006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:05.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.645+0000 7f54f2ffd640 1 -- 172.21.15.88:0/1315149788 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54ec03c070 con 0x7f54fc0ba170 2024-01-22T10:13:05.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.645+0000 7f55021aa640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f54e006b330 0x7f54e006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:05.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.646+0000 7f55021aa640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f54e006b330 0x7f54e006d7f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f54f40012e0 tx=0x7f54f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:05.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.650+0000 7f54f2ffd640 1 -- 172.21.15.88:0/1315149788 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f54ec0771e0 con 0x7f54fc0ba170 2024-01-22T10:13:05.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.854+0000 7f550440e640 1 -- 172.21.15.88:0/1315149788 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54fc1d5770 con 0x7f54fc0ba170 2024-01-22T10:13:05.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.855+0000 7f54f2ffd640 1 -- 172.21.15.88:0/1315149788 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4145 (secure 0 0 0) 0x7f54fc1d5770 con 0x7f54fc0ba170 2024-01-22T10:13:05.838 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:05.838 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3660245466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3660245466},{"type":"v1","addr":"172.21.15.119:6833","nonce":3660245466}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/3438486113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3438486113},{"type":"v1","addr":"172.21.15.88:6836","nonce":3438486113}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T10:13:02.851192+0000","modified":"2024-01-22T10:13:04.853526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/1505620357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1505620357},{"type":"v1","addr":"172.21.15.88:6837","nonce":1505620357}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-22T10:13:05.838 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 6 2024-01-22T10:13:05.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.856+0000 7f550440e640 1 -- 172.21.15.88:0/1315149788 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f54e006b330 msgr2=0x7f54e006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:05.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.856+0000 7f550440e640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f54e006b330 0x7f54e006d7f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f54f40012e0 tx=0x7f54f4009040 comp rx=0 tx=0).stop 2024-01-22T10:13:05.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.856+0000 7f550440e640 1 -- 172.21.15.88:0/1315149788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54fc0ba170 msgr2=0x7f54fc1d71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:05.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.856+0000 7f550440e640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54fc0ba170 0x7f54fc1d71b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0097c0 tx=0x7f54ec004730 comp rx=0 tx=0).stop 2024-01-22T10:13:05.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.856+0000 7f550440e640 1 -- 172.21.15.88:0/1315149788 shutdown_connections 2024-01-22T10:13:05.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.856+0000 7f550440e640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f54e006b330 0x7f54e006d7f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.856+0000 7f550440e640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54fc14ece0 0x7f54fc1400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.856+0000 7f550440e640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54fc0ba170 0x7f54fc1d71b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.856+0000 7f550440e640 1 --2- 172.21.15.88:0/1315149788 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54fc0b9d90 0x7f54fc1d63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.856+0000 7f550440e640 1 -- 172.21.15.88:0/1315149788 >> 172.21.15.88:0/1315149788 conn(0x7f54fc0bdbf0 msgr2=0x7f54fc14f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:05.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.857+0000 7f550440e640 1 -- 172.21.15.88:0/1315149788 shutdown_connections 2024-01-22T10:13:05.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.857+0000 7f550440e640 1 -- 172.21.15.88:0/1315149788 wait complete. 2024-01-22T10:13:05.849 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:05.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.966+0000 7f42290b4640 1 Processor -- start 2024-01-22T10:13:05.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.966+0000 7f42290b4640 1 -- start start 2024-01-22T10:13:05.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f42290b4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42240bbb00 0x7f422414ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f42290b4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42240b45a0 0x7f422414b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f42290b4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42240bd1c0 con 0x7f42240bdde0 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f42290b4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42240bc560 con 0x7f42240b45a0 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f42290b4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42240c0820 con 0x7f42240bbb00 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f422259c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42240b45a0 0x7f422414b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f422259c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f42240b45a0 0x7f422414b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36398/0 (socket says 172.21.15.88:36398) 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f422259c640 1 -- 172.21.15.88:0/1944404179 learned_addr learned my addr 172.21.15.88:0/1944404179 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f4222d9d640 1 --2- 172.21.15.88:0/1944404179 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42240bbb00 0x7f422414ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f422259c640 1 -- 172.21.15.88:0/1944404179 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42240bbb00 msgr2=0x7f422414ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f422259c640 1 --2- 172.21.15.88:0/1944404179 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42240bbb00 0x7f422414ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f422259c640 1 -- 172.21.15.88:0/1944404179 >> v1:172.21.15.119:6789/0 conn(0x7f42240bdde0 legacy=0x7f422414ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.967+0000 7f422259c640 1 -- 172.21.15.88:0/1944404179 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42240c0b00 con 0x7f42240b45a0 2024-01-22T10:13:05.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.968+0000 7f422259c640 1 --2- 172.21.15.88:0/1944404179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42240b45a0 0x7f422414b3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4218009870 tx=0x7f421802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45891ac04253496c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.968+0000 7f4221d9b640 1 -- 172.21.15.88:0/1944404179 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218031640 con 0x7f42240b45a0 2024-01-22T10:13:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.968+0000 7f4221d9b640 1 -- 172.21.15.88:0/1944404179 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42180317a0 con 0x7f42240b45a0 2024-01-22T10:13:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.968+0000 7f4221d9b640 1 -- 172.21.15.88:0/1944404179 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218031b30 con 0x7f42240b45a0 2024-01-22T10:13:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.969+0000 7f42290b4640 1 -- 172.21.15.88:0/1944404179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42240b45a0 msgr2=0x7f422414b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.969+0000 7f42290b4640 1 --2- 172.21.15.88:0/1944404179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42240b45a0 0x7f422414b3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4218009870 tx=0x7f421802b8f0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.969+0000 7f42290b4640 1 -- 172.21.15.88:0/1944404179 shutdown_connections 2024-01-22T10:13:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.969+0000 7f42290b4640 1 --2- 172.21.15.88:0/1944404179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42240b45a0 0x7f422414b3b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.969+0000 7f42290b4640 1 --2- 172.21.15.88:0/1944404179 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42240bbb00 0x7f422414ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.969+0000 7f42290b4640 1 -- 172.21.15.88:0/1944404179 >> 172.21.15.88:0/1944404179 conn(0x7f42240a2c20 msgr2=0x7f42240a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.969+0000 7f42290b4640 1 -- 172.21.15.88:0/1944404179 shutdown_connections 2024-01-22T10:13:05.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.969+0000 7f42290b4640 1 -- 172.21.15.88:0/1944404179 wait complete. 2024-01-22T10:13:05.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.970+0000 7f42290b4640 1 Processor -- start 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.970+0000 7f42290b4640 1 -- start start 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f42290b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42240b45a0 0x7f42240b6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f42290b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42240bbb00 0x7f42241438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f42290b4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42240bdde0 0x7f42241e12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f42290b4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b6d90 con 0x7f42240bbb00 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f42290b4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4224144360 con 0x7f42240b45a0 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f42290b4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b6f60 con 0x7f42240bdde0 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f422259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42240bbb00 0x7f42241438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f422259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42240bbb00 0x7f42241438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36406/0 (socket says 172.21.15.88:36406) 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f422259c640 1 -- 172.21.15.88:0/2424801789 learned_addr learned my addr 172.21.15.88:0/2424801789 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f422359e640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42240bdde0 0x7f42241e12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f4222d9d640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42240b45a0 0x7f42240b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:05.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f422259c640 1 -- 172.21.15.88:0/2424801789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42240bdde0 msgr2=0x7f42241e12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f422259c640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42240bdde0 0x7f42241e12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f422259c640 1 -- 172.21.15.88:0/2424801789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42240b45a0 msgr2=0x7f42240b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f422259c640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42240b45a0 0x7f42240b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f422259c640 1 -- 172.21.15.88:0/2424801789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180094d0 con 0x7f42240bbb00 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f422259c640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42240bbb00 0x7f42241438c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4218000c00 tx=0x7f42180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f420b7fe640 1 -- 172.21.15.88:0/2424801789 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421803ac60 con 0x7f42240bbb00 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f420b7fe640 1 -- 172.21.15.88:0/2424801789 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421803ade0 con 0x7f42240bbb00 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f42290b4640 1 -- 172.21.15.88:0/2424801789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4224143140 con 0x7f42240bbb00 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f420b7fe640 1 -- 172.21.15.88:0/2424801789 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218044630 con 0x7f42240bbb00 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.971+0000 7f42290b4640 1 -- 172.21.15.88:0/2424801789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42240bad80 con 0x7f42240bbb00 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.972+0000 7f42290b4640 1 -- 172.21.15.88:0/2424801789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422404ea30 con 0x7f42240bbb00 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.973+0000 7f420b7fe640 1 -- 172.21.15.88:0/2424801789 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f421802f050 con 0x7f42240bbb00 2024-01-22T10:13:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.973+0000 7f420b7fe640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f421006b330 0x7f421006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:05.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.973+0000 7f4222d9d640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f421006b330 0x7f421006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:05.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.973+0000 7f420b7fe640 1 -- 172.21.15.88:0/2424801789 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42180abb70 con 0x7f42240bbb00 2024-01-22T10:13:05.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.974+0000 7f4222d9d640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f421006b330 0x7f421006d7f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f421c00aac0 tx=0x7f421c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:05.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:05.977+0000 7f420b7fe640 1 -- 172.21.15.88:0/2424801789 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4218076980 con 0x7f42240bbb00 2024-01-22T10:13:06.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.148+0000 7f42290b4640 1 -- 172.21.15.88:0/2424801789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42240a0690 con 0x7f42240bbb00 2024-01-22T10:13:06.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.149+0000 7f420b7fe640 1 -- 172.21.15.88:0/2424801789 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f4218079fa0 con 0x7f42240bbb00 2024-01-22T10:13:06.132 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:06.132 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:06.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.152+0000 7f42290b4640 1 -- 172.21.15.88:0/2424801789 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f421006b330 msgr2=0x7f421006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.152+0000 7f42290b4640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f421006b330 0x7f421006d7f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f421c00aac0 tx=0x7f421c008040 comp rx=0 tx=0).stop 2024-01-22T10:13:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.152+0000 7f42290b4640 1 -- 172.21.15.88:0/2424801789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42240bbb00 msgr2=0x7f42241438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.152+0000 7f42290b4640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42240bbb00 0x7f42241438c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4218000c00 tx=0x7f42180046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.152+0000 7f42290b4640 1 -- 172.21.15.88:0/2424801789 shutdown_connections 2024-01-22T10:13:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.152+0000 7f42290b4640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f421006b330 0x7f421006d7f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.152+0000 7f42290b4640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42240bdde0 0x7f42241e12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.152+0000 7f42290b4640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42240bbb00 0x7f42241438c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.152+0000 7f42290b4640 1 --2- 172.21.15.88:0/2424801789 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42240b45a0 0x7f42240b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.152+0000 7f42290b4640 1 -- 172.21.15.88:0/2424801789 >> 172.21.15.88:0/2424801789 conn(0x7f42240a2c20 msgr2=0x7f4224149200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.152+0000 7f42290b4640 1 -- 172.21.15.88:0/2424801789 shutdown_connections 2024-01-22T10:13:06.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.152+0000 7f42290b4640 1 -- 172.21.15.88:0/2424801789 wait complete. 2024-01-22T10:13:06.145 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T10:13:06.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T10:13:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.262+0000 7f262ee3d640 1 Processor -- start 2024-01-22T10:13:06.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.262+0000 7f262ee3d640 1 -- start start 2024-01-22T10:13:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.262+0000 7f262ee3d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f26280bdee0 0x7f262814b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.262+0000 7f262ee3d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2628148c30 0x7f2628149050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.262+0000 7f262ee3d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26280bb800 con 0x7f262814ece0 2024-01-22T10:13:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.262+0000 7f262ee3d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280bbb50 con 0x7f26280bdee0 2024-01-22T10:13:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.262+0000 7f262ee3d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280bc520 con 0x7f2628148c30 2024-01-22T10:13:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.263+0000 7f2627fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2628148c30 0x7f2628149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.263+0000 7f262cbd9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f26280bdee0 0x7f262814b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.263+0000 7f262cbd9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f26280bdee0 0x7f262814b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:53564/0 (socket says 172.21.15.88:53564) 2024-01-22T10:13:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.263+0000 7f262cbd9640 1 -- 172.21.15.88:0/3418958902 learned_addr learned my addr 172.21.15.88:0/3418958902 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.263+0000 7f2627fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2628148c30 0x7f2628149050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:44870/0 (socket says 172.21.15.88:44870) 2024-01-22T10:13:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.263+0000 7f262cbd9640 1 -- 172.21.15.88:0/3418958902 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2628148c30 msgr2=0x7f2628149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.263+0000 7f262cbd9640 1 --2- 172.21.15.88:0/3418958902 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2628148c30 0x7f2628149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.263+0000 7f262cbd9640 1 -- 172.21.15.88:0/3418958902 >> v1:172.21.15.119:6789/0 conn(0x7f262814ece0 legacy=0x7f262814f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.263+0000 7f262cbd9640 1 -- 172.21.15.88:0/3418958902 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280bf820 con 0x7f26280bdee0 2024-01-22T10:13:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.264+0000 7f262cbd9640 1 --2- 172.21.15.88:0/3418958902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26280bdee0 0x7f262814b7e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f261c009870 tx=0x7f261c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6a592b445f23257 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.264+0000 7f26277fe640 1 -- 172.21.15.88:0/3418958902 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c031640 con 0x7f26280bdee0 2024-01-22T10:13:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.264+0000 7f26277fe640 1 -- 172.21.15.88:0/3418958902 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c0317a0 con 0x7f26280bdee0 2024-01-22T10:13:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.264+0000 7f26277fe640 1 -- 172.21.15.88:0/3418958902 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c031b30 con 0x7f26280bdee0 2024-01-22T10:13:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.265+0000 7f262ee3d640 1 -- 172.21.15.88:0/3418958902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26280bdee0 msgr2=0x7f262814b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.265+0000 7f262ee3d640 1 --2- 172.21.15.88:0/3418958902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26280bdee0 0x7f262814b7e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f261c009870 tx=0x7f261c02b8f0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.265+0000 7f262ee3d640 1 -- 172.21.15.88:0/3418958902 shutdown_connections 2024-01-22T10:13:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.265+0000 7f262ee3d640 1 --2- 172.21.15.88:0/3418958902 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2628148c30 0x7f2628149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.265+0000 7f262ee3d640 1 --2- 172.21.15.88:0/3418958902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26280bdee0 0x7f262814b7e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.265+0000 7f262ee3d640 1 -- 172.21.15.88:0/3418958902 >> 172.21.15.88:0/3418958902 conn(0x7f26280a2d80 msgr2=0x7f26280a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.265+0000 7f262ee3d640 1 -- 172.21.15.88:0/3418958902 shutdown_connections 2024-01-22T10:13:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.265+0000 7f262ee3d640 1 -- 172.21.15.88:0/3418958902 wait complete. 2024-01-22T10:13:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.266+0000 7f262ee3d640 1 Processor -- start 2024-01-22T10:13:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.266+0000 7f262ee3d640 1 -- start start 2024-01-22T10:13:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.266+0000 7f262ee3d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26280bdee0 0x7f26280a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.266+0000 7f262ee3d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2628148c30 0x7f26280b9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.266+0000 7f262ee3d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f262814ece0 0x7f26280b9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262ee3d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280a1b70 con 0x7f262814ece0 2024-01-22T10:13:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262ee3d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2628147b00 con 0x7f2628148c30 2024-01-22T10:13:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262ee3d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26281d7150 con 0x7f26280bdee0 2024-01-22T10:13:06.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262d3da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f262814ece0 0x7f26280b9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262d3da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f262814ece0 0x7f26280b9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36408/0 (socket says 172.21.15.88:36408) 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262d3da640 1 -- 172.21.15.88:0/1679644675 learned_addr learned my addr 172.21.15.88:0/1679644675 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f2627fff640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2628148c30 0x7f26280b9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262cbd9640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26280bdee0 0x7f26280a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262d3da640 1 -- 172.21.15.88:0/1679644675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26280bdee0 msgr2=0x7f26280a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262d3da640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26280bdee0 0x7f26280a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262d3da640 1 -- 172.21.15.88:0/1679644675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2628148c30 msgr2=0x7f26280b9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262d3da640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2628148c30 0x7f26280b9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262d3da640 1 -- 172.21.15.88:0/1679644675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0094d0 con 0x7f262814ece0 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262d3da640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f262814ece0 0x7f26280b9cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f262000c6b0 tx=0x7f262000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f26257fa640 1 -- 172.21.15.88:0/1679644675 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620003b70 con 0x7f262814ece0 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f26257fa640 1 -- 172.21.15.88:0/1679644675 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2620003cf0 con 0x7f262814ece0 2024-01-22T10:13:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f26257fa640 1 -- 172.21.15.88:0/1679644675 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620003ea0 con 0x7f262814ece0 2024-01-22T10:13:06.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262ee3d640 1 -- 172.21.15.88:0/1679644675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26281d7d60 con 0x7f262814ece0 2024-01-22T10:13:06.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.267+0000 7f262ee3d640 1 -- 172.21.15.88:0/1679644675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26280a6850 con 0x7f262814ece0 2024-01-22T10:13:06.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.268+0000 7f262ee3d640 1 -- 172.21.15.88:0/1679644675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26280a6a70 con 0x7f262814ece0 2024-01-22T10:13:06.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.269+0000 7f26257fa640 1 -- 172.21.15.88:0/1679644675 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f2620005310 con 0x7f262814ece0 2024-01-22T10:13:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.269+0000 7f26257fa640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f260c06b330 0x7f260c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.269+0000 7f26257fa640 1 -- 172.21.15.88:0/1679644675 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26200897a0 con 0x7f262814ece0 2024-01-22T10:13:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.269+0000 7f262cbd9640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f260c06b330 0x7f260c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.269+0000 7f262cbd9640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f260c06b330 0x7f260c06d7f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f261c036000 tx=0x7f261c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:06.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.273+0000 7f26257fa640 1 -- 172.21.15.88:0/1679644675 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2620054570 con 0x7f262814ece0 2024-01-22T10:13:06.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.438+0000 7f262ee3d640 1 -- 172.21.15.88:0/1679644675 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26280bd5a0 con 0x7f260c06b330 2024-01-22T10:13:06.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.444+0000 7f26257fa640 1 -- 172.21.15.88:0/1679644675 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249805 (secure 0 0 0) 0x7f261c044400 con 0x7f260c06b330 2024-01-22T10:13:06.431 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:06.432 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-01-22T10:13:06.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.448+0000 7f262ee3d640 1 -- 172.21.15.88:0/1679644675 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f260c06b330 msgr2=0x7f260c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.448+0000 7f262ee3d640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f260c06b330 0x7f260c06d7f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f261c036000 tx=0x7f261c03c040 comp rx=0 tx=0).stop 2024-01-22T10:13:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.448+0000 7f262ee3d640 1 -- 172.21.15.88:0/1679644675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f262814ece0 msgr2=0x7f26280b9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.448+0000 7f262ee3d640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f262814ece0 0x7f26280b9cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f262000c6b0 tx=0x7f262000cb70 comp rx=0 tx=0).stop 2024-01-22T10:13:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.448+0000 7f262ee3d640 1 -- 172.21.15.88:0/1679644675 shutdown_connections 2024-01-22T10:13:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.448+0000 7f262ee3d640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f260c06b330 0x7f260c06d7f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.448+0000 7f262ee3d640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f262814ece0 0x7f26280b9cc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.448+0000 7f262ee3d640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2628148c30 0x7f26280b9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.448+0000 7f262ee3d640 1 --2- 172.21.15.88:0/1679644675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26280bdee0 0x7f26280a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.448+0000 7f262ee3d640 1 -- 172.21.15.88:0/1679644675 >> 172.21.15.88:0/1679644675 conn(0x7f26280a2d80 msgr2=0x7f26280c1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.448+0000 7f262ee3d640 1 -- 172.21.15.88:0/1679644675 shutdown_connections 2024-01-22T10:13:06.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.448+0000 7f262ee3d640 1 -- 172.21.15.88:0/1679644675 wait complete. 2024-01-22T10:13:06.441 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-01-22T10:13:04.705488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219816,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754904,"statfs":{"total":773094113280,"available":772869021696,"internally_reserved":0,"allocated":2433024,"data_stored":1546680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000734"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-01-22T10:12:53.362086+0000","last_change":"2024-01-22T10:12:52.033359+0000","last_active":"2024-01-22T10:12:53.362086+0000","last_peered":"2024-01-22T10:12:53.362086+0000","last_clean":"2024-01-22T10:12:53.362086+0000","last_became_active":"2024-01-22T10:12:52.033101+0000","last_became_peered":"2024-01-22T10:12:52.033101+0000","last_unstale":"2024-01-22T10:12:53.362086+0000","last_undegraded":"2024-01-22T10:12:53.362086+0000","last_fullsized":"2024-01-22T10:12:53.362086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_clean_scrub_stamp":"2024-01-22T10:12:51.022957+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:45:37.023233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:02.493096+0000","last_change":"2024-01-22T10:13:02.493096+0000","last_active":"2024-01-22T10:13:02.493096+0000","last_peered":"2024-01-22T10:13:02.493096+0000","last_clean":"2024-01-22T10:13:02.493096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:02.493096+0000","last_undegraded":"2024-01-22T10:13:02.493096+0000","last_fullsized":"2024-01-22T10:13:02.493096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:01.488926+0000","last_change":"2024-01-22T10:13:01.488926+0000","last_active":"2024-01-22T10:13:01.488926+0000","last_peered":"2024-01-22T10:13:01.488926+0000","last_clean":"2024-01-22T10:13:01.488926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:01.488926+0000","last_undegraded":"2024-01-22T10:13:01.488926+0000","last_fullsized":"2024-01-22T10:13:01.488926+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T10:13:06.446 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T10:13:06.461 INFO:tasks.ceph.mds.c.smithi088.stderr:2024-01-22T10:13:06.478+0000 7f10af13a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T10:13:06.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.577+0000 7fc47cfb6640 1 Processor -- start 2024-01-22T10:13:06.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.577+0000 7fc47cfb6640 1 -- start start 2024-01-22T10:13:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.578+0000 7fc47cfb6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc478070550 0x7fc478070930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.578+0000 7fc47cfb6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc47814d300 0x7fc4781459f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.578+0000 7fc47cfb6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc478071fa0 con 0x7fc478145580 2024-01-22T10:13:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.578+0000 7fc47cfb6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47814c420 con 0x7fc478070550 2024-01-22T10:13:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.578+0000 7fc47cfb6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47814ba80 con 0x7fc47814d300 2024-01-22T10:13:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.578+0000 7fc47659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc478070550 0x7fc478070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.578+0000 7fc47659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc478070550 0x7fc478070930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36424/0 (socket says 172.21.15.88:36424) 2024-01-22T10:13:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.578+0000 7fc47659c640 1 -- 172.21.15.88:0/1576793740 learned_addr learned my addr 172.21.15.88:0/1576793740 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.578+0000 7fc476d9d640 1 --2- 172.21.15.88:0/1576793740 >> v2:172.21.15.119:3300/0 conn(0x7fc47814d300 0x7fc4781459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.579+0000 7fc47659c640 1 -- 172.21.15.88:0/1576793740 >> v2:172.21.15.119:3300/0 conn(0x7fc47814d300 msgr2=0x7fc4781459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.579+0000 7fc47659c640 1 --2- 172.21.15.88:0/1576793740 >> v2:172.21.15.119:3300/0 conn(0x7fc47814d300 0x7fc4781459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.579+0000 7fc47659c640 1 -- 172.21.15.88:0/1576793740 >> v1:172.21.15.119:6789/0 conn(0x7fc478145580 legacy=0x7fc47814cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.579+0000 7fc47659c640 1 -- 172.21.15.88:0/1576793740 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47814bd60 con 0x7fc478070550 2024-01-22T10:13:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.579+0000 7fc47659c640 1 --2- 172.21.15.88:0/1576793740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc478070550 0x7fc478070930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc47814c7b0 tx=0x7fc46802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41e1664f62bf4bc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.579+0000 7fc47559a640 1 -- 172.21.15.88:0/1576793740 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468030860 con 0x7fc478070550 2024-01-22T10:13:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.579+0000 7fc47559a640 1 -- 172.21.15.88:0/1576793740 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4680309c0 con 0x7fc478070550 2024-01-22T10:13:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.579+0000 7fc47559a640 1 -- 172.21.15.88:0/1576793740 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468030d50 con 0x7fc478070550 2024-01-22T10:13:06.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.580+0000 7fc47cfb6640 1 -- 172.21.15.88:0/1576793740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc478070550 msgr2=0x7fc478070930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.580+0000 7fc47cfb6640 1 --2- 172.21.15.88:0/1576793740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc478070550 0x7fc478070930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc47814c7b0 tx=0x7fc46802b9a0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.580+0000 7fc47cfb6640 1 -- 172.21.15.88:0/1576793740 shutdown_connections 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.580+0000 7fc47cfb6640 1 --2- 172.21.15.88:0/1576793740 >> v2:172.21.15.119:3300/0 conn(0x7fc47814d300 0x7fc4781459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.580+0000 7fc47cfb6640 1 --2- 172.21.15.88:0/1576793740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc478070550 0x7fc478070930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.580+0000 7fc47cfb6640 1 -- 172.21.15.88:0/1576793740 >> 172.21.15.88:0/1576793740 conn(0x7fc47806a6f0 msgr2=0x7fc47806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.580+0000 7fc47cfb6640 1 -- 172.21.15.88:0/1576793740 shutdown_connections 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.580+0000 7fc47cfb6640 1 -- 172.21.15.88:0/1576793740 wait complete. 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.581+0000 7fc47cfb6640 1 Processor -- start 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.581+0000 7fc47cfb6640 1 -- start start 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc47cfb6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc478070550 0x7fc4780af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc47cfb6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc478145580 0x7fc4780af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc47cfb6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47814d300 0x7fc4781e1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc47cfb6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780b06d0 con 0x7fc47814d300 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc47cfb6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780ad560 con 0x7fc478145580 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc47cfb6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4781e4b20 con 0x7fc478070550 2024-01-22T10:13:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc476d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47814d300 0x7fc4781e1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc476d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47814d300 0x7fc4781e1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36440/0 (socket says 172.21.15.88:36440) 2024-01-22T10:13:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc476d9d640 1 -- 172.21.15.88:0/412759530 learned_addr learned my addr 172.21.15.88:0/412759530 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc475d9b640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc478145580 0x7fc4780af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc47659c640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc478070550 0x7fc4780af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc476d9d640 1 -- 172.21.15.88:0/412759530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc478070550 msgr2=0x7fc4780af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc476d9d640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc478070550 0x7fc4780af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc476d9d640 1 -- 172.21.15.88:0/412759530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc478145580 msgr2=0x7fc4780af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc476d9d640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc478145580 0x7fc4780af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc476d9d640 1 -- 172.21.15.88:0/412759530 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4680094d0 con 0x7fc47814d300 2024-01-22T10:13:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.582+0000 7fc476d9d640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47814d300 0x7fc4781e1340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc47000efc0 tx=0x7fc47000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.583+0000 7fc466ffd640 1 -- 172.21.15.88:0/412759530 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470009ba0 con 0x7fc47814d300 2024-01-22T10:13:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.583+0000 7fc466ffd640 1 -- 172.21.15.88:0/412759530 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47000f040 con 0x7fc47814d300 2024-01-22T10:13:06.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.583+0000 7fc47cfb6640 1 -- 172.21.15.88:0/412759530 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4781e4e00 con 0x7fc47814d300 2024-01-22T10:13:06.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.583+0000 7fc466ffd640 1 -- 172.21.15.88:0/412759530 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700146c0 con 0x7fc47814d300 2024-01-22T10:13:06.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.583+0000 7fc47cfb6640 1 -- 172.21.15.88:0/412759530 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4781e53c0 con 0x7fc47814d300 2024-01-22T10:13:06.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.584+0000 7fc47cfb6640 1 -- 172.21.15.88:0/412759530 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4781e55e0 con 0x7fc47814d300 2024-01-22T10:13:06.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.584+0000 7fc466ffd640 1 -- 172.21.15.88:0/412759530 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fc470014820 con 0x7fc47814d300 2024-01-22T10:13:06.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.584+0000 7fc466ffd640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc45806b330 0x7fc45806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.584+0000 7fc47659c640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc45806b330 0x7fc45806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.584+0000 7fc466ffd640 1 -- 172.21.15.88:0/412759530 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc47008a580 con 0x7fc47814d300 2024-01-22T10:13:06.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.585+0000 7fc47659c640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc45806b330 0x7fc45806d7f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc468036000 tx=0x7fc468008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:06.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.588+0000 7fc466ffd640 1 -- 172.21.15.88:0/412759530 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc4700552a0 con 0x7fc47814d300 2024-01-22T10:13:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.754+0000 7fc47cfb6640 1 -- 172.21.15.88:0/412759530 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc47804ea30 con 0x7fc45806b330 2024-01-22T10:13:06.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.760+0000 7fc466ffd640 1 -- 172.21.15.88:0/412759530 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264647 (secure 0 0 0) 0x7fc47804ea30 con 0x7fc45806b330 2024-01-22T10:13:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:06.748 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-01-22T10:13:06.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.763+0000 7fc47cfb6640 1 -- 172.21.15.88:0/412759530 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc45806b330 msgr2=0x7fc45806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.763+0000 7fc47cfb6640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc45806b330 0x7fc45806d7f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc468036000 tx=0x7fc468008030 comp rx=0 tx=0).stop 2024-01-22T10:13:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.763+0000 7fc47cfb6640 1 -- 172.21.15.88:0/412759530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47814d300 msgr2=0x7fc4781e1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.763+0000 7fc47cfb6640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47814d300 0x7fc4781e1340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc47000efc0 tx=0x7fc47000c490 comp rx=0 tx=0).stop 2024-01-22T10:13:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.763+0000 7fc47cfb6640 1 -- 172.21.15.88:0/412759530 shutdown_connections 2024-01-22T10:13:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.763+0000 7fc47cfb6640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc45806b330 0x7fc45806d7f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.763+0000 7fc47cfb6640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc47814d300 0x7fc4781e1340 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.763+0000 7fc47cfb6640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc478145580 0x7fc4780af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.763+0000 7fc47cfb6640 1 --2- 172.21.15.88:0/412759530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc478070550 0x7fc4780af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.763+0000 7fc47cfb6640 1 -- 172.21.15.88:0/412759530 >> 172.21.15.88:0/412759530 conn(0x7fc47806a6f0 msgr2=0x7fc4780bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:06.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.763+0000 7fc47cfb6640 1 -- 172.21.15.88:0/412759530 shutdown_connections 2024-01-22T10:13:06.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.763+0000 7fc47cfb6640 1 -- 172.21.15.88:0/412759530 wait complete. 2024-01-22T10:13:06.756 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-22T10:13:06.705836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.212262"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483437+0000","last_change":"2024-01-22T10:13:03.492920+0000","last_active":"2024-01-22T10:13:04.483437+0000","last_peered":"2024-01-22T10:13:04.483437+0000","last_clean":"2024-01-22T10:13:04.483437+0000","last_became_active":"2024-01-22T10:13:03.492631+0000","last_became_peered":"2024-01-22T10:13:03.492631+0000","last_unstale":"2024-01-22T10:13:04.483437+0000","last_undegraded":"2024-01-22T10:13:04.483437+0000","last_fullsized":"2024-01-22T10:13:04.483437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:32:21.868617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484560+0000","last_change":"2024-01-22T10:13:03.495752+0000","last_active":"2024-01-22T10:13:04.484560+0000","last_peered":"2024-01-22T10:13:04.484560+0000","last_clean":"2024-01-22T10:13:04.484560+0000","last_became_active":"2024-01-22T10:13:03.495494+0000","last_became_peered":"2024-01-22T10:13:03.495494+0000","last_unstale":"2024-01-22T10:13:04.484560+0000","last_undegraded":"2024-01-22T10:13:04.484560+0000","last_fullsized":"2024-01-22T10:13:04.484560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652381+0000","last_change":"2024-01-22T10:13:03.493655+0000","last_active":"2024-01-22T10:13:04.652381+0000","last_peered":"2024-01-22T10:13:04.652381+0000","last_clean":"2024-01-22T10:13:04.652381+0000","last_became_active":"2024-01-22T10:13:03.493392+0000","last_became_peered":"2024-01-22T10:13:03.493392+0000","last_unstale":"2024-01-22T10:13:04.652381+0000","last_undegraded":"2024-01-22T10:13:04.652381+0000","last_fullsized":"2024-01-22T10:13:04.652381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:14:37.672922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509717+0000","last_change":"2024-01-22T10:13:03.499002+0000","last_active":"2024-01-22T10:13:04.509717+0000","last_peered":"2024-01-22T10:13:04.509717+0000","last_clean":"2024-01-22T10:13:04.509717+0000","last_became_active":"2024-01-22T10:13:03.498671+0000","last_became_peered":"2024-01-22T10:13:03.498671+0000","last_unstale":"2024-01-22T10:13:04.509717+0000","last_undegraded":"2024-01-22T10:13:04.509717+0000","last_fullsized":"2024-01-22T10:13:04.509717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:23.433091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483030+0000","last_change":"2024-01-22T10:13:03.491947+0000","last_active":"2024-01-22T10:13:04.483030+0000","last_peered":"2024-01-22T10:13:04.483030+0000","last_clean":"2024-01-22T10:13:04.483030+0000","last_became_active":"2024-01-22T10:13:03.491661+0000","last_became_peered":"2024-01-22T10:13:03.491661+0000","last_unstale":"2024-01-22T10:13:04.483030+0000","last_undegraded":"2024-01-22T10:13:04.483030+0000","last_fullsized":"2024-01-22T10:13:04.483030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:01:27.029405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509675+0000","last_change":"2024-01-22T10:13:03.499247+0000","last_active":"2024-01-22T10:13:04.509675+0000","last_peered":"2024-01-22T10:13:04.509675+0000","last_clean":"2024-01-22T10:13:04.509675+0000","last_became_active":"2024-01-22T10:13:03.498924+0000","last_became_peered":"2024-01-22T10:13:03.498924+0000","last_unstale":"2024-01-22T10:13:04.509675+0000","last_undegraded":"2024-01-22T10:13:04.509675+0000","last_fullsized":"2024-01-22T10:13:04.509675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:28:38.011831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482686+0000","last_change":"2024-01-22T10:13:03.493236+0000","last_active":"2024-01-22T10:13:04.482686+0000","last_peered":"2024-01-22T10:13:04.482686+0000","last_clean":"2024-01-22T10:13:04.482686+0000","last_became_active":"2024-01-22T10:13:03.492833+0000","last_became_peered":"2024-01-22T10:13:03.492833+0000","last_unstale":"2024-01-22T10:13:04.482686+0000","last_undegraded":"2024-01-22T10:13:04.482686+0000","last_fullsized":"2024-01-22T10:13:04.482686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:18:49.293366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483516+0000","last_change":"2024-01-22T10:13:03.492762+0000","last_active":"2024-01-22T10:13:04.483516+0000","last_peered":"2024-01-22T10:13:04.483516+0000","last_clean":"2024-01-22T10:13:04.483516+0000","last_became_active":"2024-01-22T10:13:03.492488+0000","last_became_peered":"2024-01-22T10:13:03.492488+0000","last_unstale":"2024-01-22T10:13:04.483516+0000","last_undegraded":"2024-01-22T10:13:04.483516+0000","last_fullsized":"2024-01-22T10:13:04.483516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:43:22.787729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483554+0000","last_change":"2024-01-22T10:13:03.497140+0000","last_active":"2024-01-22T10:13:04.483554+0000","last_peered":"2024-01-22T10:13:04.483554+0000","last_clean":"2024-01-22T10:13:04.483554+0000","last_became_active":"2024-01-22T10:13:03.496752+0000","last_became_peered":"2024-01-22T10:13:03.496752+0000","last_unstale":"2024-01-22T10:13:04.483554+0000","last_undegraded":"2024-01-22T10:13:04.483554+0000","last_fullsized":"2024-01-22T10:13:04.483554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:23:47.110078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652900+0000","last_change":"2024-01-22T10:13:03.495067+0000","last_active":"2024-01-22T10:13:04.652900+0000","last_peered":"2024-01-22T10:13:04.652900+0000","last_clean":"2024-01-22T10:13:04.652900+0000","last_became_active":"2024-01-22T10:13:03.494818+0000","last_became_peered":"2024-01-22T10:13:03.494818+0000","last_unstale":"2024-01-22T10:13:04.652900+0000","last_undegraded":"2024-01-22T10:13:04.652900+0000","last_fullsized":"2024-01-22T10:13:04.652900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:08:01.408684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652679+0000","last_change":"2024-01-22T10:13:03.495113+0000","last_active":"2024-01-22T10:13:04.652679+0000","last_peered":"2024-01-22T10:13:04.652679+0000","last_clean":"2024-01-22T10:13:04.652679+0000","last_became_active":"2024-01-22T10:13:03.494856+0000","last_became_peered":"2024-01-22T10:13:03.494856+0000","last_unstale":"2024-01-22T10:13:04.652679+0000","last_undegraded":"2024-01-22T10:13:04.652679+0000","last_fullsized":"2024-01-22T10:13:04.652679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:33:39.926559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653345+0000","last_change":"2024-01-22T10:13:03.501906+0000","last_active":"2024-01-22T10:13:04.653345+0000","last_peered":"2024-01-22T10:13:04.653345+0000","last_clean":"2024-01-22T10:13:04.653345+0000","last_became_active":"2024-01-22T10:13:03.501078+0000","last_became_peered":"2024-01-22T10:13:03.501078+0000","last_unstale":"2024-01-22T10:13:04.653345+0000","last_undegraded":"2024-01-22T10:13:04.653345+0000","last_fullsized":"2024-01-22T10:13:04.653345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:26:13.650219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483870+0000","last_change":"2024-01-22T10:13:03.494825+0000","last_active":"2024-01-22T10:13:04.483870+0000","last_peered":"2024-01-22T10:13:04.483870+0000","last_clean":"2024-01-22T10:13:04.483870+0000","last_became_active":"2024-01-22T10:13:03.494556+0000","last_became_peered":"2024-01-22T10:13:03.494556+0000","last_unstale":"2024-01-22T10:13:04.483870+0000","last_undegraded":"2024-01-22T10:13:04.483870+0000","last_fullsized":"2024-01-22T10:13:04.483870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:28:38.011831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652251+0000","last_change":"2024-01-22T10:13:03.492859+0000","last_active":"2024-01-22T10:13:04.652251+0000","last_peered":"2024-01-22T10:13:04.652251+0000","last_clean":"2024-01-22T10:13:04.652251+0000","last_became_active":"2024-01-22T10:13:03.492628+0000","last_became_peered":"2024-01-22T10:13:03.492628+0000","last_unstale":"2024-01-22T10:13:04.652251+0000","last_undegraded":"2024-01-22T10:13:04.652251+0000","last_fullsized":"2024-01-22T10:13:04.652251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:20:16.627504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484299+0000","last_change":"2024-01-22T10:13:03.503667+0000","last_active":"2024-01-22T10:13:04.484299+0000","last_peered":"2024-01-22T10:13:04.484299+0000","last_clean":"2024-01-22T10:13:04.484299+0000","last_became_active":"2024-01-22T10:13:03.503409+0000","last_became_peered":"2024-01-22T10:13:03.503409+0000","last_unstale":"2024-01-22T10:13:04.484299+0000","last_undegraded":"2024-01-22T10:13:04.484299+0000","last_fullsized":"2024-01-22T10:13:04.484299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:33:39.926559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509589+0000","last_change":"2024-01-22T10:13:03.500155+0000","last_active":"2024-01-22T10:13:04.509589+0000","last_peered":"2024-01-22T10:13:04.509589+0000","last_clean":"2024-01-22T10:13:04.509589+0000","last_became_active":"2024-01-22T10:13:03.499892+0000","last_became_peered":"2024-01-22T10:13:03.499892+0000","last_unstale":"2024-01-22T10:13:04.509589+0000","last_undegraded":"2024-01-22T10:13:04.509589+0000","last_fullsized":"2024-01-22T10:13:04.509589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.510149+0000","last_change":"2024-01-22T10:13:03.501001+0000","last_active":"2024-01-22T10:13:04.510149+0000","last_peered":"2024-01-22T10:13:04.510149+0000","last_clean":"2024-01-22T10:13:04.510149+0000","last_became_active":"2024-01-22T10:13:03.500767+0000","last_became_peered":"2024-01-22T10:13:03.500767+0000","last_unstale":"2024-01-22T10:13:04.510149+0000","last_undegraded":"2024-01-22T10:13:04.510149+0000","last_fullsized":"2024-01-22T10:13:04.510149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:05:11.277521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652376+0000","last_change":"2024-01-22T10:13:03.492397+0000","last_active":"2024-01-22T10:13:04.652376+0000","last_peered":"2024-01-22T10:13:04.652376+0000","last_clean":"2024-01-22T10:13:04.652376+0000","last_became_active":"2024-01-22T10:13:03.492127+0000","last_became_peered":"2024-01-22T10:13:03.492127+0000","last_unstale":"2024-01-22T10:13:04.652376+0000","last_undegraded":"2024-01-22T10:13:04.652376+0000","last_fullsized":"2024-01-22T10:13:04.652376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:26:13.650219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483270+0000","last_change":"2024-01-22T10:13:03.491259+0000","last_active":"2024-01-22T10:13:04.483270+0000","last_peered":"2024-01-22T10:13:04.483270+0000","last_clean":"2024-01-22T10:13:04.483270+0000","last_became_active":"2024-01-22T10:13:03.489580+0000","last_became_peered":"2024-01-22T10:13:03.489580+0000","last_unstale":"2024-01-22T10:13:04.483270+0000","last_undegraded":"2024-01-22T10:13:04.483270+0000","last_fullsized":"2024-01-22T10:13:04.483270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:43:40.855210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652921+0000","last_change":"2024-01-22T10:13:03.506931+0000","last_active":"2024-01-22T10:13:04.652921+0000","last_peered":"2024-01-22T10:13:04.652921+0000","last_clean":"2024-01-22T10:13:04.652921+0000","last_became_active":"2024-01-22T10:13:03.505686+0000","last_became_peered":"2024-01-22T10:13:03.505686+0000","last_unstale":"2024-01-22T10:13:04.652921+0000","last_undegraded":"2024-01-22T10:13:04.652921+0000","last_fullsized":"2024-01-22T10:13:04.652921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652496+0000","last_change":"2024-01-22T10:13:03.496832+0000","last_active":"2024-01-22T10:13:04.652496+0000","last_peered":"2024-01-22T10:13:04.652496+0000","last_clean":"2024-01-22T10:13:04.652496+0000","last_became_active":"2024-01-22T10:13:03.496550+0000","last_became_peered":"2024-01-22T10:13:03.496550+0000","last_unstale":"2024-01-22T10:13:04.652496+0000","last_undegraded":"2024-01-22T10:13:04.652496+0000","last_fullsized":"2024-01-22T10:13:04.652496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:43:22.787729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509734+0000","last_change":"2024-01-22T10:13:03.503279+0000","last_active":"2024-01-22T10:13:04.509734+0000","last_peered":"2024-01-22T10:13:04.509734+0000","last_clean":"2024-01-22T10:13:04.509734+0000","last_became_active":"2024-01-22T10:13:03.502324+0000","last_became_peered":"2024-01-22T10:13:03.502324+0000","last_unstale":"2024-01-22T10:13:04.509734+0000","last_undegraded":"2024-01-22T10:13:04.509734+0000","last_fullsized":"2024-01-22T10:13:04.509734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:52:13.153249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483600+0000","last_change":"2024-01-22T10:13:03.504327+0000","last_active":"2024-01-22T10:13:04.483600+0000","last_peered":"2024-01-22T10:13:04.483600+0000","last_clean":"2024-01-22T10:13:04.483600+0000","last_became_active":"2024-01-22T10:13:03.504047+0000","last_became_peered":"2024-01-22T10:13:03.504047+0000","last_unstale":"2024-01-22T10:13:04.483600+0000","last_undegraded":"2024-01-22T10:13:04.483600+0000","last_fullsized":"2024-01-22T10:13:04.483600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:10:02.956052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509658+0000","last_change":"2024-01-22T10:13:03.499696+0000","last_active":"2024-01-22T10:13:04.509658+0000","last_peered":"2024-01-22T10:13:04.509658+0000","last_clean":"2024-01-22T10:13:04.509658+0000","last_became_active":"2024-01-22T10:13:03.499363+0000","last_became_peered":"2024-01-22T10:13:03.499363+0000","last_unstale":"2024-01-22T10:13:04.509658+0000","last_undegraded":"2024-01-22T10:13:04.509658+0000","last_fullsized":"2024-01-22T10:13:04.509658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483902+0000","last_change":"2024-01-22T10:13:03.504284+0000","last_active":"2024-01-22T10:13:04.483902+0000","last_peered":"2024-01-22T10:13:04.483902+0000","last_clean":"2024-01-22T10:13:04.483902+0000","last_became_active":"2024-01-22T10:13:03.504024+0000","last_became_peered":"2024-01-22T10:13:03.504024+0000","last_unstale":"2024-01-22T10:13:04.483902+0000","last_undegraded":"2024-01-22T10:13:04.483902+0000","last_fullsized":"2024-01-22T10:13:04.483902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:52:13.153249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653011+0000","last_change":"2024-01-22T10:13:03.496717+0000","last_active":"2024-01-22T10:13:04.653011+0000","last_peered":"2024-01-22T10:13:04.653011+0000","last_clean":"2024-01-22T10:13:04.653011+0000","last_became_active":"2024-01-22T10:13:03.496422+0000","last_became_peered":"2024-01-22T10:13:03.496422+0000","last_unstale":"2024-01-22T10:13:04.653011+0000","last_undegraded":"2024-01-22T10:13:04.653011+0000","last_fullsized":"2024-01-22T10:13:04.653011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484458+0000","last_change":"2024-01-22T10:13:03.491265+0000","last_active":"2024-01-22T10:13:04.484458+0000","last_peered":"2024-01-22T10:13:04.484458+0000","last_clean":"2024-01-22T10:13:04.484458+0000","last_became_active":"2024-01-22T10:13:03.490993+0000","last_became_peered":"2024-01-22T10:13:03.490993+0000","last_unstale":"2024-01-22T10:13:04.484458+0000","last_undegraded":"2024-01-22T10:13:04.484458+0000","last_fullsized":"2024-01-22T10:13:04.484458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483894+0000","last_change":"2024-01-22T10:13:03.504160+0000","last_active":"2024-01-22T10:13:04.483894+0000","last_peered":"2024-01-22T10:13:04.483894+0000","last_clean":"2024-01-22T10:13:04.483894+0000","last_became_active":"2024-01-22T10:13:03.503946+0000","last_became_peered":"2024-01-22T10:13:03.503946+0000","last_unstale":"2024-01-22T10:13:04.483894+0000","last_undegraded":"2024-01-22T10:13:04.483894+0000","last_fullsized":"2024-01-22T10:13:04.483894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:23.433091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652533+0000","last_change":"2024-01-22T10:13:03.497065+0000","last_active":"2024-01-22T10:13:04.652533+0000","last_peered":"2024-01-22T10:13:04.652533+0000","last_clean":"2024-01-22T10:13:04.652533+0000","last_became_active":"2024-01-22T10:13:03.496805+0000","last_became_peered":"2024-01-22T10:13:03.496805+0000","last_unstale":"2024-01-22T10:13:04.652533+0000","last_undegraded":"2024-01-22T10:13:04.652533+0000","last_fullsized":"2024-01-22T10:13:04.652533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:33:39.926559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509854+0000","last_change":"2024-01-22T10:13:03.499866+0000","last_active":"2024-01-22T10:13:04.509854+0000","last_peered":"2024-01-22T10:13:04.509854+0000","last_clean":"2024-01-22T10:13:04.509854+0000","last_became_active":"2024-01-22T10:13:03.499534+0000","last_became_peered":"2024-01-22T10:13:03.499534+0000","last_unstale":"2024-01-22T10:13:04.509854+0000","last_undegraded":"2024-01-22T10:13:04.509854+0000","last_fullsized":"2024-01-22T10:13:04.509854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:59:10.835472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652166+0000","last_change":"2024-01-22T10:13:03.495017+0000","last_active":"2024-01-22T10:13:04.652166+0000","last_peered":"2024-01-22T10:13:04.652166+0000","last_clean":"2024-01-22T10:13:04.652166+0000","last_became_active":"2024-01-22T10:13:03.494765+0000","last_became_peered":"2024-01-22T10:13:03.494765+0000","last_unstale":"2024-01-22T10:13:04.652166+0000","last_undegraded":"2024-01-22T10:13:04.652166+0000","last_fullsized":"2024-01-22T10:13:04.652166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:28:12.828318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652480+0000","last_change":"2024-01-22T10:13:03.496343+0000","last_active":"2024-01-22T10:13:04.652480+0000","last_peered":"2024-01-22T10:13:04.652480+0000","last_clean":"2024-01-22T10:13:04.652480+0000","last_became_active":"2024-01-22T10:13:03.496071+0000","last_became_peered":"2024-01-22T10:13:03.496071+0000","last_unstale":"2024-01-22T10:13:04.652480+0000","last_undegraded":"2024-01-22T10:13:04.652480+0000","last_fullsized":"2024-01-22T10:13:04.652480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:14:37.672922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652604+0000","last_change":"2024-01-22T10:13:03.499195+0000","last_active":"2024-01-22T10:13:04.652604+0000","last_peered":"2024-01-22T10:13:04.652604+0000","last_clean":"2024-01-22T10:13:04.652604+0000","last_became_active":"2024-01-22T10:13:03.498657+0000","last_became_peered":"2024-01-22T10:13:03.498657+0000","last_unstale":"2024-01-22T10:13:04.652604+0000","last_undegraded":"2024-01-22T10:13:04.652604+0000","last_fullsized":"2024-01-22T10:13:04.652604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:52:50.082332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483961+0000","last_change":"2024-01-22T10:13:02.508626+0000","last_active":"2024-01-22T10:13:04.483961+0000","last_peered":"2024-01-22T10:13:04.483961+0000","last_clean":"2024-01-22T10:13:04.483961+0000","last_became_active":"2024-01-22T10:13:02.508377+0000","last_became_peered":"2024-01-22T10:13:02.508377+0000","last_unstale":"2024-01-22T10:13:04.483961+0000","last_undegraded":"2024-01-22T10:13:04.483961+0000","last_fullsized":"2024-01-22T10:13:04.483961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:55:15.314732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652615+0000","last_change":"2024-01-22T10:13:03.501315+0000","last_active":"2024-01-22T10:13:04.652615+0000","last_peered":"2024-01-22T10:13:04.652615+0000","last_clean":"2024-01-22T10:13:04.652615+0000","last_became_active":"2024-01-22T10:13:03.501151+0000","last_became_peered":"2024-01-22T10:13:03.501151+0000","last_unstale":"2024-01-22T10:13:04.652615+0000","last_undegraded":"2024-01-22T10:13:04.652615+0000","last_fullsized":"2024-01-22T10:13:04.652615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652770+0000","last_change":"2024-01-22T10:13:02.517526+0000","last_active":"2024-01-22T10:13:04.652770+0000","last_peered":"2024-01-22T10:13:04.652770+0000","last_clean":"2024-01-22T10:13:04.652770+0000","last_became_active":"2024-01-22T10:13:02.517235+0000","last_became_peered":"2024-01-22T10:13:02.517235+0000","last_unstale":"2024-01-22T10:13:04.652770+0000","last_undegraded":"2024-01-22T10:13:04.652770+0000","last_fullsized":"2024-01-22T10:13:04.652770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:53:07.743815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483581+0000","last_change":"2024-01-22T10:13:02.510486+0000","last_active":"2024-01-22T10:13:04.483581+0000","last_peered":"2024-01-22T10:13:04.483581+0000","last_clean":"2024-01-22T10:13:04.483581+0000","last_became_active":"2024-01-22T10:13:02.510213+0000","last_became_peered":"2024-01-22T10:13:02.510213+0000","last_unstale":"2024-01-22T10:13:04.483581+0000","last_undegraded":"2024-01-22T10:13:04.483581+0000","last_fullsized":"2024-01-22T10:13:04.483581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:12.080022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483938+0000","last_change":"2024-01-22T10:13:03.495558+0000","last_active":"2024-01-22T10:13:04.483938+0000","last_peered":"2024-01-22T10:13:04.483938+0000","last_clean":"2024-01-22T10:13:04.483938+0000","last_became_active":"2024-01-22T10:13:03.495279+0000","last_became_peered":"2024-01-22T10:13:03.495279+0000","last_unstale":"2024-01-22T10:13:04.483938+0000","last_undegraded":"2024-01-22T10:13:04.483938+0000","last_fullsized":"2024-01-22T10:13:04.483938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:33:39.926559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509710+0000","last_change":"2024-01-22T10:13:02.518247+0000","last_active":"2024-01-22T10:13:04.509710+0000","last_peered":"2024-01-22T10:13:04.509710+0000","last_clean":"2024-01-22T10:13:04.509710+0000","last_became_active":"2024-01-22T10:13:02.517891+0000","last_became_peered":"2024-01-22T10:13:02.517891+0000","last_unstale":"2024-01-22T10:13:04.509710+0000","last_undegraded":"2024-01-22T10:13:04.509710+0000","last_fullsized":"2024-01-22T10:13:04.509710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:52:49.078163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484290+0000","last_change":"2024-01-22T10:13:03.491458+0000","last_active":"2024-01-22T10:13:04.484290+0000","last_peered":"2024-01-22T10:13:04.484290+0000","last_clean":"2024-01-22T10:13:04.484290+0000","last_became_active":"2024-01-22T10:13:03.490965+0000","last_became_peered":"2024-01-22T10:13:03.490965+0000","last_unstale":"2024-01-22T10:13:04.484290+0000","last_undegraded":"2024-01-22T10:13:04.484290+0000","last_fullsized":"2024-01-22T10:13:04.484290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:43:22.787729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652631+0000","last_change":"2024-01-22T10:13:02.520405+0000","last_active":"2024-01-22T10:13:04.652631+0000","last_peered":"2024-01-22T10:13:04.652631+0000","last_clean":"2024-01-22T10:13:04.652631+0000","last_became_active":"2024-01-22T10:13:02.520031+0000","last_became_peered":"2024-01-22T10:13:02.520031+0000","last_unstale":"2024-01-22T10:13:04.652631+0000","last_undegraded":"2024-01-22T10:13:04.652631+0000","last_fullsized":"2024-01-22T10:13:04.652631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:52:49.078163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.510021+0000","last_change":"2024-01-22T10:13:03.501651+0000","last_active":"2024-01-22T10:13:04.510021+0000","last_peered":"2024-01-22T10:13:04.510021+0000","last_clean":"2024-01-22T10:13:04.510021+0000","last_became_active":"2024-01-22T10:13:03.501327+0000","last_became_peered":"2024-01-22T10:13:03.501327+0000","last_unstale":"2024-01-22T10:13:04.510021+0000","last_undegraded":"2024-01-22T10:13:04.510021+0000","last_fullsized":"2024-01-22T10:13:04.510021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:14:51.613418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.510024+0000","last_change":"2024-01-22T10:13:02.520696+0000","last_active":"2024-01-22T10:13:04.510024+0000","last_peered":"2024-01-22T10:13:04.510024+0000","last_clean":"2024-01-22T10:13:04.510024+0000","last_became_active":"2024-01-22T10:13:02.519608+0000","last_became_peered":"2024-01-22T10:13:02.519608+0000","last_unstale":"2024-01-22T10:13:04.510024+0000","last_undegraded":"2024-01-22T10:13:04.510024+0000","last_fullsized":"2024-01-22T10:13:04.510024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:55:15.314732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652656+0000","last_change":"2024-01-22T10:13:03.495561+0000","last_active":"2024-01-22T10:13:04.652656+0000","last_peered":"2024-01-22T10:13:04.652656+0000","last_clean":"2024-01-22T10:13:04.652656+0000","last_became_active":"2024-01-22T10:13:03.495046+0000","last_became_peered":"2024-01-22T10:13:03.495046+0000","last_unstale":"2024-01-22T10:13:04.652656+0000","last_undegraded":"2024-01-22T10:13:04.652656+0000","last_fullsized":"2024-01-22T10:13:04.652656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484426+0000","last_change":"2024-01-22T10:13:02.520255+0000","last_active":"2024-01-22T10:13:04.484426+0000","last_peered":"2024-01-22T10:13:04.484426+0000","last_clean":"2024-01-22T10:13:04.484426+0000","last_became_active":"2024-01-22T10:13:02.519958+0000","last_became_peered":"2024-01-22T10:13:02.519958+0000","last_unstale":"2024-01-22T10:13:04.484426+0000","last_undegraded":"2024-01-22T10:13:04.484426+0000","last_fullsized":"2024-01-22T10:13:04.484426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:26:12.646050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653423+0000","last_change":"2024-01-22T10:13:03.501610+0000","last_active":"2024-01-22T10:13:04.653423+0000","last_peered":"2024-01-22T10:13:04.653423+0000","last_clean":"2024-01-22T10:13:04.653423+0000","last_became_active":"2024-01-22T10:13:03.500770+0000","last_became_peered":"2024-01-22T10:13:03.500770+0000","last_unstale":"2024-01-22T10:13:04.653423+0000","last_undegraded":"2024-01-22T10:13:04.653423+0000","last_fullsized":"2024-01-22T10:13:04.653423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:46:21.339741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652911+0000","last_change":"2024-01-22T10:13:02.515746+0000","last_active":"2024-01-22T10:13:04.652911+0000","last_peered":"2024-01-22T10:13:04.652911+0000","last_clean":"2024-01-22T10:13:04.652911+0000","last_became_active":"2024-01-22T10:13:02.515480+0000","last_became_peered":"2024-01-22T10:13:02.515480+0000","last_unstale":"2024-01-22T10:13:04.652911+0000","last_undegraded":"2024-01-22T10:13:04.652911+0000","last_fullsized":"2024-01-22T10:13:04.652911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483017+0000","last_change":"2024-01-22T10:13:03.497330+0000","last_active":"2024-01-22T10:13:04.483017+0000","last_peered":"2024-01-22T10:13:04.483017+0000","last_clean":"2024-01-22T10:13:04.483017+0000","last_became_active":"2024-01-22T10:13:03.497059+0000","last_became_peered":"2024-01-22T10:13:03.497059+0000","last_unstale":"2024-01-22T10:13:04.483017+0000","last_undegraded":"2024-01-22T10:13:04.483017+0000","last_fullsized":"2024-01-22T10:13:04.483017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:14:51.613418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652626+0000","last_change":"2024-01-22T10:13:02.517370+0000","last_active":"2024-01-22T10:13:04.652626+0000","last_peered":"2024-01-22T10:13:04.652626+0000","last_clean":"2024-01-22T10:13:04.652626+0000","last_became_active":"2024-01-22T10:13:02.517049+0000","last_became_peered":"2024-01-22T10:13:02.517049+0000","last_unstale":"2024-01-22T10:13:04.652626+0000","last_undegraded":"2024-01-22T10:13:04.652626+0000","last_fullsized":"2024-01-22T10:13:04.652626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:33.688072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652365+0000","last_change":"2024-01-22T10:13:03.499203+0000","last_active":"2024-01-22T10:13:04.652365+0000","last_peered":"2024-01-22T10:13:04.652365+0000","last_clean":"2024-01-22T10:13:04.652365+0000","last_became_active":"2024-01-22T10:13:03.498882+0000","last_became_peered":"2024-01-22T10:13:03.498882+0000","last_unstale":"2024-01-22T10:13:04.652365+0000","last_undegraded":"2024-01-22T10:13:04.652365+0000","last_fullsized":"2024-01-22T10:13:04.652365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:26:02.561919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509844+0000","last_change":"2024-01-22T10:13:02.521514+0000","last_active":"2024-01-22T10:13:04.509844+0000","last_peered":"2024-01-22T10:13:04.509844+0000","last_clean":"2024-01-22T10:13:04.509844+0000","last_became_active":"2024-01-22T10:13:02.521145+0000","last_became_peered":"2024-01-22T10:13:02.521145+0000","last_unstale":"2024-01-22T10:13:04.509844+0000","last_undegraded":"2024-01-22T10:13:04.509844+0000","last_fullsized":"2024-01-22T10:13:04.509844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482950+0000","last_change":"2024-01-22T10:13:03.505052+0000","last_active":"2024-01-22T10:13:04.482950+0000","last_peered":"2024-01-22T10:13:04.482950+0000","last_clean":"2024-01-22T10:13:04.482950+0000","last_became_active":"2024-01-22T10:13:03.504265+0000","last_became_peered":"2024-01-22T10:13:03.504265+0000","last_unstale":"2024-01-22T10:13:04.482950+0000","last_undegraded":"2024-01-22T10:13:04.482950+0000","last_fullsized":"2024-01-22T10:13:04.482950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:25:05.310085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652525+0000","last_change":"2024-01-22T10:13:02.518658+0000","last_active":"2024-01-22T10:13:04.652525+0000","last_peered":"2024-01-22T10:13:04.652525+0000","last_clean":"2024-01-22T10:13:04.652525+0000","last_became_active":"2024-01-22T10:13:02.518390+0000","last_became_peered":"2024-01-22T10:13:02.518390+0000","last_unstale":"2024-01-22T10:13:04.652525+0000","last_undegraded":"2024-01-22T10:13:04.652525+0000","last_fullsized":"2024-01-22T10:13:04.652525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:12.080022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652570+0000","last_change":"2024-01-22T10:13:03.497378+0000","last_active":"2024-01-22T10:13:04.652570+0000","last_peered":"2024-01-22T10:13:04.652570+0000","last_clean":"2024-01-22T10:13:04.652570+0000","last_became_active":"2024-01-22T10:13:03.497000+0000","last_became_peered":"2024-01-22T10:13:03.497000+0000","last_unstale":"2024-01-22T10:13:04.652570+0000","last_undegraded":"2024-01-22T10:13:04.652570+0000","last_fullsized":"2024-01-22T10:13:04.652570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:43:22.787729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652033+0000","last_change":"2024-01-22T10:13:02.510852+0000","last_active":"2024-01-22T10:13:04.652033+0000","last_peered":"2024-01-22T10:13:04.652033+0000","last_clean":"2024-01-22T10:13:04.652033+0000","last_became_active":"2024-01-22T10:13:02.510574+0000","last_became_peered":"2024-01-22T10:13:02.510574+0000","last_unstale":"2024-01-22T10:13:04.652033+0000","last_undegraded":"2024-01-22T10:13:04.652033+0000","last_fullsized":"2024-01-22T10:13:04.652033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:55:15.314732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482713+0000","last_change":"2024-01-22T10:13:03.504783+0000","last_active":"2024-01-22T10:13:04.482713+0000","last_peered":"2024-01-22T10:13:04.482713+0000","last_clean":"2024-01-22T10:13:04.482713+0000","last_became_active":"2024-01-22T10:13:03.504479+0000","last_became_peered":"2024-01-22T10:13:03.504479+0000","last_unstale":"2024-01-22T10:13:04.482713+0000","last_undegraded":"2024-01-22T10:13:04.482713+0000","last_fullsized":"2024-01-22T10:13:04.482713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:24:59.153525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653388+0000","last_change":"2024-01-22T10:13:02.515839+0000","last_active":"2024-01-22T10:13:04.653388+0000","last_peered":"2024-01-22T10:13:04.653388+0000","last_clean":"2024-01-22T10:13:04.653388+0000","last_became_active":"2024-01-22T10:13:02.515570+0000","last_became_peered":"2024-01-22T10:13:02.515570+0000","last_unstale":"2024-01-22T10:13:04.653388+0000","last_undegraded":"2024-01-22T10:13:04.653388+0000","last_fullsized":"2024-01-22T10:13:04.653388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:53:07.456362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483233+0000","last_change":"2024-01-22T10:13:03.504368+0000","last_active":"2024-01-22T10:13:04.483233+0000","last_peered":"2024-01-22T10:13:04.483233+0000","last_clean":"2024-01-22T10:13:04.483233+0000","last_became_active":"2024-01-22T10:13:03.504085+0000","last_became_peered":"2024-01-22T10:13:03.504085+0000","last_unstale":"2024-01-22T10:13:04.483233+0000","last_undegraded":"2024-01-22T10:13:04.483233+0000","last_fullsized":"2024-01-22T10:13:04.483233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:42:23.812565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652462+0000","last_change":"2024-01-22T10:13:02.508413+0000","last_active":"2024-01-22T10:13:04.652462+0000","last_peered":"2024-01-22T10:13:04.652462+0000","last_clean":"2024-01-22T10:13:04.652462+0000","last_became_active":"2024-01-22T10:13:02.508164+0000","last_became_peered":"2024-01-22T10:13:02.508164+0000","last_unstale":"2024-01-22T10:13:04.652462+0000","last_undegraded":"2024-01-22T10:13:04.652462+0000","last_fullsized":"2024-01-22T10:13:04.652462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483520+0000","last_change":"2024-01-22T10:13:03.501288+0000","last_active":"2024-01-22T10:13:04.483520+0000","last_peered":"2024-01-22T10:13:04.483520+0000","last_clean":"2024-01-22T10:13:04.483520+0000","last_became_active":"2024-01-22T10:13:03.501009+0000","last_became_peered":"2024-01-22T10:13:03.501009+0000","last_unstale":"2024-01-22T10:13:04.483520+0000","last_undegraded":"2024-01-22T10:13:04.483520+0000","last_fullsized":"2024-01-22T10:13:04.483520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:06.156461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484504+0000","last_change":"2024-01-22T10:13:02.517585+0000","last_active":"2024-01-22T10:13:04.484504+0000","last_peered":"2024-01-22T10:13:04.484504+0000","last_clean":"2024-01-22T10:13:04.484504+0000","last_became_active":"2024-01-22T10:13:02.517264+0000","last_became_peered":"2024-01-22T10:13:02.517264+0000","last_unstale":"2024-01-22T10:13:04.484504+0000","last_undegraded":"2024-01-22T10:13:04.484504+0000","last_fullsized":"2024-01-22T10:13:04.484504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:28:11.824149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509907+0000","last_change":"2024-01-22T10:13:03.494074+0000","last_active":"2024-01-22T10:13:04.509907+0000","last_peered":"2024-01-22T10:13:04.509907+0000","last_clean":"2024-01-22T10:13:04.509907+0000","last_became_active":"2024-01-22T10:13:03.493813+0000","last_became_peered":"2024-01-22T10:13:03.493813+0000","last_unstale":"2024-01-22T10:13:04.509907+0000","last_undegraded":"2024-01-22T10:13:04.509907+0000","last_fullsized":"2024-01-22T10:13:04.509907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:24:59.153525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652344+0000","last_change":"2024-01-22T10:13:02.520256+0000","last_active":"2024-01-22T10:13:04.652344+0000","last_peered":"2024-01-22T10:13:04.652344+0000","last_clean":"2024-01-22T10:13:04.652344+0000","last_became_active":"2024-01-22T10:13:02.519958+0000","last_became_peered":"2024-01-22T10:13:02.519958+0000","last_unstale":"2024-01-22T10:13:04.652344+0000","last_undegraded":"2024-01-22T10:13:04.652344+0000","last_fullsized":"2024-01-22T10:13:04.652344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:53:07.743815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483076+0000","last_change":"2024-01-22T10:13:03.496747+0000","last_active":"2024-01-22T10:13:04.483076+0000","last_peered":"2024-01-22T10:13:04.483076+0000","last_clean":"2024-01-22T10:13:04.483076+0000","last_became_active":"2024-01-22T10:13:03.496101+0000","last_became_peered":"2024-01-22T10:13:03.496101+0000","last_unstale":"2024-01-22T10:13:04.483076+0000","last_undegraded":"2024-01-22T10:13:04.483076+0000","last_fullsized":"2024-01-22T10:13:04.483076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:05:11.277521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-22T10:13:03.481850+0000","last_change":"2024-01-22T10:12:52.033359+0000","last_active":"2024-01-22T10:13:03.481850+0000","last_peered":"2024-01-22T10:13:03.481850+0000","last_clean":"2024-01-22T10:13:03.481850+0000","last_became_active":"2024-01-22T10:12:52.033101+0000","last_became_peered":"2024-01-22T10:12:52.033101+0000","last_unstale":"2024-01-22T10:13:03.481850+0000","last_undegraded":"2024-01-22T10:13:03.481850+0000","last_fullsized":"2024-01-22T10:13:03.481850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_clean_scrub_stamp":"2024-01-22T10:12:51.022957+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:45:37.023233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509648+0000","last_change":"2024-01-22T10:13:02.520393+0000","last_active":"2024-01-22T10:13:04.509648+0000","last_peered":"2024-01-22T10:13:04.509648+0000","last_clean":"2024-01-22T10:13:04.509648+0000","last_became_active":"2024-01-22T10:13:02.519136+0000","last_became_peered":"2024-01-22T10:13:02.519136+0000","last_unstale":"2024-01-22T10:13:04.509648+0000","last_undegraded":"2024-01-22T10:13:04.509648+0000","last_fullsized":"2024-01-22T10:13:04.509648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:12.080022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483783+0000","last_change":"2024-01-22T10:13:03.492656+0000","last_active":"2024-01-22T10:13:04.483783+0000","last_peered":"2024-01-22T10:13:04.483783+0000","last_clean":"2024-01-22T10:13:04.483783+0000","last_became_active":"2024-01-22T10:13:03.492384+0000","last_became_peered":"2024-01-22T10:13:03.492384+0000","last_unstale":"2024-01-22T10:13:04.483783+0000","last_undegraded":"2024-01-22T10:13:04.483783+0000","last_fullsized":"2024-01-22T10:13:04.483783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482591+0000","last_change":"2024-01-22T10:13:02.516696+0000","last_active":"2024-01-22T10:13:04.482591+0000","last_peered":"2024-01-22T10:13:04.482591+0000","last_clean":"2024-01-22T10:13:04.482591+0000","last_became_active":"2024-01-22T10:13:02.515332+0000","last_became_peered":"2024-01-22T10:13:02.515332+0000","last_unstale":"2024-01-22T10:13:04.482591+0000","last_undegraded":"2024-01-22T10:13:04.482591+0000","last_fullsized":"2024-01-22T10:13:04.482591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:27:12.120129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652280+0000","last_change":"2024-01-22T10:13:03.503310+0000","last_active":"2024-01-22T10:13:04.652280+0000","last_peered":"2024-01-22T10:13:04.652280+0000","last_clean":"2024-01-22T10:13:04.652280+0000","last_became_active":"2024-01-22T10:13:03.503035+0000","last_became_peered":"2024-01-22T10:13:03.503035+0000","last_unstale":"2024-01-22T10:13:04.652280+0000","last_undegraded":"2024-01-22T10:13:04.652280+0000","last_fullsized":"2024-01-22T10:13:04.652280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:19:02.332837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652246+0000","last_change":"2024-01-22T10:13:02.515616+0000","last_active":"2024-01-22T10:13:04.652246+0000","last_peered":"2024-01-22T10:13:04.652246+0000","last_clean":"2024-01-22T10:13:04.652246+0000","last_became_active":"2024-01-22T10:13:02.515305+0000","last_became_peered":"2024-01-22T10:13:02.515305+0000","last_unstale":"2024-01-22T10:13:04.652246+0000","last_undegraded":"2024-01-22T10:13:04.652246+0000","last_fullsized":"2024-01-22T10:13:04.652246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:12.080022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484326+0000","last_change":"2024-01-22T10:13:03.488752+0000","last_active":"2024-01-22T10:13:04.484326+0000","last_peered":"2024-01-22T10:13:04.484326+0000","last_clean":"2024-01-22T10:13:04.484326+0000","last_became_active":"2024-01-22T10:13:03.488507+0000","last_became_peered":"2024-01-22T10:13:03.488507+0000","last_unstale":"2024-01-22T10:13:04.484326+0000","last_undegraded":"2024-01-22T10:13:04.484326+0000","last_fullsized":"2024-01-22T10:13:04.484326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:10:02.956052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509999+0000","last_change":"2024-01-22T10:13:02.519467+0000","last_active":"2024-01-22T10:13:04.509999+0000","last_peered":"2024-01-22T10:13:04.509999+0000","last_clean":"2024-01-22T10:13:04.509999+0000","last_became_active":"2024-01-22T10:13:02.518703+0000","last_became_peered":"2024-01-22T10:13:02.518703+0000","last_unstale":"2024-01-22T10:13:04.509999+0000","last_undegraded":"2024-01-22T10:13:04.509999+0000","last_fullsized":"2024-01-22T10:13:04.509999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:53:07.743815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653092+0000","last_change":"2024-01-22T10:13:03.502386+0000","last_active":"2024-01-22T10:13:04.653092+0000","last_peered":"2024-01-22T10:13:04.653092+0000","last_clean":"2024-01-22T10:13:04.653092+0000","last_became_active":"2024-01-22T10:13:03.501769+0000","last_became_peered":"2024-01-22T10:13:03.501769+0000","last_unstale":"2024-01-22T10:13:04.653092+0000","last_undegraded":"2024-01-22T10:13:04.653092+0000","last_fullsized":"2024-01-22T10:13:04.653092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:28:12.828318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484433+0000","last_change":"2024-01-22T10:13:02.513770+0000","last_active":"2024-01-22T10:13:04.484433+0000","last_peered":"2024-01-22T10:13:04.484433+0000","last_clean":"2024-01-22T10:13:04.484433+0000","last_became_active":"2024-01-22T10:13:02.513467+0000","last_became_peered":"2024-01-22T10:13:02.513467+0000","last_unstale":"2024-01-22T10:13:04.484433+0000","last_undegraded":"2024-01-22T10:13:04.484433+0000","last_fullsized":"2024-01-22T10:13:04.484433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:27:12.120129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.510030+0000","last_change":"2024-01-22T10:13:03.494128+0000","last_active":"2024-01-22T10:13:04.510030+0000","last_peered":"2024-01-22T10:13:04.510030+0000","last_clean":"2024-01-22T10:13:04.510030+0000","last_became_active":"2024-01-22T10:13:03.493896+0000","last_became_peered":"2024-01-22T10:13:03.493896+0000","last_unstale":"2024-01-22T10:13:04.510030+0000","last_undegraded":"2024-01-22T10:13:04.510030+0000","last_fullsized":"2024-01-22T10:13:04.510030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:01:27.029405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483336+0000","last_change":"2024-01-22T10:13:02.516338+0000","last_active":"2024-01-22T10:13:04.483336+0000","last_peered":"2024-01-22T10:13:04.483336+0000","last_clean":"2024-01-22T10:13:04.483336+0000","last_became_active":"2024-01-22T10:13:02.516078+0000","last_became_peered":"2024-01-22T10:13:02.516078+0000","last_unstale":"2024-01-22T10:13:04.483336+0000","last_undegraded":"2024-01-22T10:13:04.483336+0000","last_fullsized":"2024-01-22T10:13:04.483336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:20:15.623335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484425+0000","last_change":"2024-01-22T10:13:03.489431+0000","last_active":"2024-01-22T10:13:04.484425+0000","last_peered":"2024-01-22T10:13:04.484425+0000","last_clean":"2024-01-22T10:13:04.484425+0000","last_became_active":"2024-01-22T10:13:03.489087+0000","last_became_peered":"2024-01-22T10:13:03.489087+0000","last_unstale":"2024-01-22T10:13:04.484425+0000","last_undegraded":"2024-01-22T10:13:04.484425+0000","last_fullsized":"2024-01-22T10:13:04.484425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:08:01.408684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:05.520945+0000","last_change":"2024-01-22T10:13:02.511112+0000","last_active":"2024-01-22T10:13:05.520945+0000","last_peered":"2024-01-22T10:13:05.520945+0000","last_clean":"2024-01-22T10:13:05.520945+0000","last_became_active":"2024-01-22T10:13:02.510787+0000","last_became_peered":"2024-01-22T10:13:02.510787+0000","last_unstale":"2024-01-22T10:13:05.520945+0000","last_undegraded":"2024-01-22T10:13:05.520945+0000","last_fullsized":"2024-01-22T10:13:05.520945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:52:49.078163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483990+0000","last_change":"2024-01-22T10:13:03.493410+0000","last_active":"2024-01-22T10:13:04.483990+0000","last_peered":"2024-01-22T10:13:04.483990+0000","last_clean":"2024-01-22T10:13:04.483990+0000","last_became_active":"2024-01-22T10:13:03.493143+0000","last_became_peered":"2024-01-22T10:13:03.493143+0000","last_unstale":"2024-01-22T10:13:04.483990+0000","last_undegraded":"2024-01-22T10:13:04.483990+0000","last_fullsized":"2024-01-22T10:13:04.483990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:18:49.293366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652802+0000","last_change":"2024-01-22T10:13:02.513484+0000","last_active":"2024-01-22T10:13:04.652802+0000","last_peered":"2024-01-22T10:13:04.652802+0000","last_clean":"2024-01-22T10:13:04.652802+0000","last_became_active":"2024-01-22T10:13:02.513171+0000","last_became_peered":"2024-01-22T10:13:02.513171+0000","last_unstale":"2024-01-22T10:13:04.652802+0000","last_undegraded":"2024-01-22T10:13:04.652802+0000","last_fullsized":"2024-01-22T10:13:04.652802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:27:12.120129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652593+0000","last_change":"2024-01-22T10:13:03.495046+0000","last_active":"2024-01-22T10:13:04.652593+0000","last_peered":"2024-01-22T10:13:04.652593+0000","last_clean":"2024-01-22T10:13:04.652593+0000","last_became_active":"2024-01-22T10:13:03.494817+0000","last_became_peered":"2024-01-22T10:13:03.494817+0000","last_unstale":"2024-01-22T10:13:04.652593+0000","last_undegraded":"2024-01-22T10:13:04.652593+0000","last_fullsized":"2024-01-22T10:13:04.652593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:08:01.408684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482603+0000","last_change":"2024-01-22T10:13:02.516259+0000","last_active":"2024-01-22T10:13:04.482603+0000","last_peered":"2024-01-22T10:13:04.482603+0000","last_clean":"2024-01-22T10:13:04.482603+0000","last_became_active":"2024-01-22T10:13:02.515672+0000","last_became_peered":"2024-01-22T10:13:02.515672+0000","last_unstale":"2024-01-22T10:13:04.482603+0000","last_undegraded":"2024-01-22T10:13:04.482603+0000","last_fullsized":"2024-01-22T10:13:04.482603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:28:11.824149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653012+0000","last_change":"2024-01-22T10:13:03.501480+0000","last_active":"2024-01-22T10:13:04.653012+0000","last_peered":"2024-01-22T10:13:04.653012+0000","last_clean":"2024-01-22T10:13:04.653012+0000","last_became_active":"2024-01-22T10:13:03.500884+0000","last_became_peered":"2024-01-22T10:13:03.500884+0000","last_unstale":"2024-01-22T10:13:04.653012+0000","last_undegraded":"2024-01-22T10:13:04.653012+0000","last_fullsized":"2024-01-22T10:13:04.653012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:27:13.124298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484380+0000","last_change":"2024-01-22T10:13:02.507443+0000","last_active":"2024-01-22T10:13:04.484380+0000","last_peered":"2024-01-22T10:13:04.484380+0000","last_clean":"2024-01-22T10:13:04.484380+0000","last_became_active":"2024-01-22T10:13:02.507186+0000","last_became_peered":"2024-01-22T10:13:02.507186+0000","last_unstale":"2024-01-22T10:13:04.484380+0000","last_undegraded":"2024-01-22T10:13:04.484380+0000","last_fullsized":"2024-01-22T10:13:04.484380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:53:07.743815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483642+0000","last_change":"2024-01-22T10:13:03.487955+0000","last_active":"2024-01-22T10:13:04.483642+0000","last_peered":"2024-01-22T10:13:04.483642+0000","last_clean":"2024-01-22T10:13:04.483642+0000","last_became_active":"2024-01-22T10:13:03.487676+0000","last_became_peered":"2024-01-22T10:13:03.487676+0000","last_unstale":"2024-01-22T10:13:04.483642+0000","last_undegraded":"2024-01-22T10:13:04.483642+0000","last_fullsized":"2024-01-22T10:13:04.483642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:08:01.408684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484589+0000","last_change":"2024-01-22T10:13:02.507207+0000","last_active":"2024-01-22T10:13:04.484589+0000","last_peered":"2024-01-22T10:13:04.484589+0000","last_clean":"2024-01-22T10:13:04.484589+0000","last_became_active":"2024-01-22T10:13:02.506859+0000","last_became_peered":"2024-01-22T10:13:02.506859+0000","last_unstale":"2024-01-22T10:13:04.484589+0000","last_undegraded":"2024-01-22T10:13:04.484589+0000","last_fullsized":"2024-01-22T10:13:04.484589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483733+0000","last_change":"2024-01-22T10:13:03.495441+0000","last_active":"2024-01-22T10:13:04.483733+0000","last_peered":"2024-01-22T10:13:04.483733+0000","last_clean":"2024-01-22T10:13:04.483733+0000","last_became_active":"2024-01-22T10:13:03.495161+0000","last_became_peered":"2024-01-22T10:13:03.495161+0000","last_unstale":"2024-01-22T10:13:04.483733+0000","last_undegraded":"2024-01-22T10:13:04.483733+0000","last_fullsized":"2024-01-22T10:13:04.483733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483100+0000","last_change":"2024-01-22T10:13:02.519141+0000","last_active":"2024-01-22T10:13:04.483100+0000","last_peered":"2024-01-22T10:13:04.483100+0000","last_clean":"2024-01-22T10:13:04.483100+0000","last_became_active":"2024-01-22T10:13:02.518879+0000","last_became_peered":"2024-01-22T10:13:02.518879+0000","last_unstale":"2024-01-22T10:13:04.483100+0000","last_undegraded":"2024-01-22T10:13:04.483100+0000","last_fullsized":"2024-01-22T10:13:04.483100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:23:06.376125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652801+0000","last_change":"2024-01-22T10:13:03.505053+0000","last_active":"2024-01-22T10:13:04.652801+0000","last_peered":"2024-01-22T10:13:04.652801+0000","last_clean":"2024-01-22T10:13:04.652801+0000","last_became_active":"2024-01-22T10:13:03.504770+0000","last_became_peered":"2024-01-22T10:13:03.504770+0000","last_unstale":"2024-01-22T10:13:04.652801+0000","last_undegraded":"2024-01-22T10:13:04.652801+0000","last_fullsized":"2024-01-22T10:13:04.652801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:10:02.956052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509948+0000","last_change":"2024-01-22T10:13:03.503528+0000","last_active":"2024-01-22T10:13:04.509948+0000","last_peered":"2024-01-22T10:13:04.509948+0000","last_clean":"2024-01-22T10:13:04.509948+0000","last_became_active":"2024-01-22T10:13:03.503272+0000","last_became_peered":"2024-01-22T10:13:03.503272+0000","last_unstale":"2024-01-22T10:13:04.509948+0000","last_undegraded":"2024-01-22T10:13:04.509948+0000","last_fullsized":"2024-01-22T10:13:04.509948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:25:05.310085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482933+0000","last_change":"2024-01-22T10:13:02.521399+0000","last_active":"2024-01-22T10:13:04.482933+0000","last_peered":"2024-01-22T10:13:04.482933+0000","last_clean":"2024-01-22T10:13:04.482933+0000","last_became_active":"2024-01-22T10:13:02.521125+0000","last_became_peered":"2024-01-22T10:13:02.521125+0000","last_unstale":"2024-01-22T10:13:04.482933+0000","last_undegraded":"2024-01-22T10:13:04.482933+0000","last_fullsized":"2024-01-22T10:13:04.482933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:26:12.646050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509872+0000","last_change":"2024-01-22T10:13:03.503608+0000","last_active":"2024-01-22T10:13:04.509872+0000","last_peered":"2024-01-22T10:13:04.509872+0000","last_clean":"2024-01-22T10:13:04.509872+0000","last_became_active":"2024-01-22T10:13:03.503334+0000","last_became_peered":"2024-01-22T10:13:03.503334+0000","last_unstale":"2024-01-22T10:13:04.509872+0000","last_undegraded":"2024-01-22T10:13:04.509872+0000","last_fullsized":"2024-01-22T10:13:04.509872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:18:49.293366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483210+0000","last_change":"2024-01-22T10:13:02.511844+0000","last_active":"2024-01-22T10:13:04.483210+0000","last_peered":"2024-01-22T10:13:04.483210+0000","last_clean":"2024-01-22T10:13:04.483210+0000","last_became_active":"2024-01-22T10:13:02.510702+0000","last_became_peered":"2024-01-22T10:13:02.510702+0000","last_unstale":"2024-01-22T10:13:04.483210+0000","last_undegraded":"2024-01-22T10:13:04.483210+0000","last_fullsized":"2024-01-22T10:13:04.483210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:46:20.335572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652546+0000","last_change":"2024-01-22T10:13:03.495676+0000","last_active":"2024-01-22T10:13:04.652546+0000","last_peered":"2024-01-22T10:13:04.652546+0000","last_clean":"2024-01-22T10:13:04.652546+0000","last_became_active":"2024-01-22T10:13:03.495309+0000","last_became_peered":"2024-01-22T10:13:03.495309+0000","last_unstale":"2024-01-22T10:13:04.652546+0000","last_undegraded":"2024-01-22T10:13:04.652546+0000","last_fullsized":"2024-01-22T10:13:04.652546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:10:02.956052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483976+0000","last_change":"2024-01-22T10:13:02.513564+0000","last_active":"2024-01-22T10:13:04.483976+0000","last_peered":"2024-01-22T10:13:04.483976+0000","last_clean":"2024-01-22T10:13:04.483976+0000","last_became_active":"2024-01-22T10:13:02.513272+0000","last_became_peered":"2024-01-22T10:13:02.513272+0000","last_unstale":"2024-01-22T10:13:04.483976+0000","last_undegraded":"2024-01-22T10:13:04.483976+0000","last_fullsized":"2024-01-22T10:13:04.483976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483925+0000","last_change":"2024-01-22T10:13:03.492530+0000","last_active":"2024-01-22T10:13:04.483925+0000","last_peered":"2024-01-22T10:13:04.483925+0000","last_clean":"2024-01-22T10:13:04.483925+0000","last_became_active":"2024-01-22T10:13:03.492265+0000","last_became_peered":"2024-01-22T10:13:03.492265+0000","last_unstale":"2024-01-22T10:13:04.483925+0000","last_undegraded":"2024-01-22T10:13:04.483925+0000","last_fullsized":"2024-01-22T10:13:04.483925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:59:10.835472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652704+0000","last_change":"2024-01-22T10:13:02.519858+0000","last_active":"2024-01-22T10:13:04.652704+0000","last_peered":"2024-01-22T10:13:04.652704+0000","last_clean":"2024-01-22T10:13:04.652704+0000","last_became_active":"2024-01-22T10:13:02.519559+0000","last_became_peered":"2024-01-22T10:13:02.519559+0000","last_unstale":"2024-01-22T10:13:04.652704+0000","last_undegraded":"2024-01-22T10:13:04.652704+0000","last_fullsized":"2024-01-22T10:13:04.652704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:53:07.456362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T10:13:06.761 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T10:13:06.761 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-22T10:13:06.761 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-22T10:13:06.761 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-22T10:13:06.762 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-22T10:13:06.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.913+0000 7f0b51a75640 1 Processor -- start 2024-01-22T10:13:06.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.913+0000 7f0b51a75640 1 -- start start 2024-01-22T10:13:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b51a75640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c0babd0 0x7f0b4c071b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b51a75640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4c0b57c0 con 0x7f0b4c070a30 2024-01-22T10:13:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b51a75640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4c072080 con 0x7f0b4c14b8a0 2024-01-22T10:13:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b51a75640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0b4c30 con 0x7f0b4c0babd0 2024-01-22T10:13:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4affd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0b4c070a30 0x7f0b4c1422a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53306/0 (socket says 172.21.15.88:53306) 2024-01-22T10:13:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4affd640 1 -- 172.21.15.88:0/764638719 learned_addr learned my addr 172.21.15.88:0/764638719 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4b7fe640 1 --2- 172.21.15.88:0/764638719 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c0babd0 0x7f0b4c071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742489983 0 0) 0x7f0b4c0b57c0 con 0x7f0b4c070a30 2024-01-22T10:13:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b34003520 con 0x7f0b4c070a30 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2887417221 0 0) 0x7f0b34003520 con 0x7f0b4c070a30 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c0babd0 msgr2=0x7f0b4c071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 --2- 172.21.15.88:0/764638719 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c0babd0 0x7f0b4c071b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 >> v1:172.21.15.119:6789/0 conn(0x7f0b4c14b8a0 legacy=0x7f0b4c152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c0b9f10 con 0x7f0b4c070a30 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f0b40001670 con 0x7f0b4c070a30 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 >> v1:172.21.15.88:6789/0 conn(0x7f0b4c070a30 legacy=0x7f0b4c1422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 --2- 172.21.15.88:0/764638719 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c0babd0 0x7f0b34003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 --2- 172.21.15.88:0/764638719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b34003fc0 0x7f0b340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 --2- 172.21.15.88:0/764638719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b34004d00 0x7f0b34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0b4c30 con 0x7f0b34003fc0 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3400bac0 con 0x7f0b34004d00 2024-01-22T10:13:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3400bc80 con 0x7f0b4c0babd0 2024-01-22T10:13:06.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4affd640 1 --2- 172.21.15.88:0/764638719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b34003fc0 0x7f0b340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4b7fe640 1 --2- 172.21.15.88:0/764638719 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c0babd0 0x7f0b34003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.914+0000 7f0b4bfff640 1 --2- 172.21.15.88:0/764638719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b34004d00 0x7f0b34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.915+0000 7f0b4affd640 1 -- 172.21.15.88:0/764638719 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c0babd0 msgr2=0x7f0b34003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:06.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.915+0000 7f0b4affd640 1 --2- 172.21.15.88:0/764638719 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c0babd0 0x7f0b34003a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.915+0000 7f0b4affd640 1 -- 172.21.15.88:0/764638719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b34004d00 msgr2=0x7f0b34005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:06.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.915+0000 7f0b4affd640 1 --2- 172.21.15.88:0/764638719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b34004d00 0x7f0b34005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.915+0000 7f0b4affd640 1 -- 172.21.15.88:0/764638719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b34003520 con 0x7f0b34003fc0 2024-01-22T10:13:06.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.915+0000 7f0b4affd640 1 --2- 172.21.15.88:0/764638719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b34003fc0 0x7f0b340047c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c160 tx=0x7f0b340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7005425112765990 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:06.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.915+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40005ad0 con 0x7f0b34003fc0 2024-01-22T10:13:06.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.915+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b40005c50 con 0x7f0b34003fc0 2024-01-22T10:13:06.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.916+0000 7f0b4a7fc640 1 -- 172.21.15.88:0/764638719 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40007070 con 0x7f0b34003fc0 2024-01-22T10:13:06.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.916+0000 7f0b51a75640 1 -- 172.21.15.88:0/764638719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b34003fc0 msgr2=0x7f0b340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.916+0000 7f0b51a75640 1 --2- 172.21.15.88:0/764638719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b34003fc0 0x7f0b340047c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c160 tx=0x7f0b340057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.916+0000 7f0b4bfff640 1 -- 172.21.15.88:0/764638719 reap_dead start 2024-01-22T10:13:06.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.916+0000 7f0b51a75640 1 -- 172.21.15.88:0/764638719 shutdown_connections 2024-01-22T10:13:06.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.916+0000 7f0b51a75640 1 -- 172.21.15.88:0/764638719 >> 172.21.15.88:0/764638719 conn(0x7f0b4c06b9e0 msgr2=0x7f0b4c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:06.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.916+0000 7f0b51a75640 1 -- 172.21.15.88:0/764638719 shutdown_connections 2024-01-22T10:13:06.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.916+0000 7f0b51a75640 1 -- 172.21.15.88:0/764638719 wait complete. 2024-01-22T10:13:06.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.917+0000 7f0b51a75640 1 Processor -- start 2024-01-22T10:13:06.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.917+0000 7f0b51a75640 1 -- start start 2024-01-22T10:13:06.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b51a75640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b34003fc0 0x7f0b4c146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b51a75640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b4c0b5990 0x7f0b4c1dcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b51a75640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c13acc0 0x7f0b4c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b51a75640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c1468b0 con 0x7f0b4c0b5990 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b51a75640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c1dc350 con 0x7f0b34003fc0 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b51a75640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c1dd2c0 con 0x7f0b4c13acc0 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b4c0b5990 0x7f0b4c1dcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b4c0b5990 0x7f0b4c1dcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36456/0 (socket says 172.21.15.88:36456) 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4affd640 1 -- 172.21.15.88:0/261094998 learned_addr learned my addr 172.21.15.88:0/261094998 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4bfff640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c13acc0 0x7f0b4c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4b7fe640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b34003fc0 0x7f0b4c146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4affd640 1 -- 172.21.15.88:0/261094998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c13acc0 msgr2=0x7f0b4c138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4affd640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c13acc0 0x7f0b4c138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4affd640 1 -- 172.21.15.88:0/261094998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b34003fc0 msgr2=0x7f0b4c146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4affd640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b34003fc0 0x7f0b4c146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:06.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4affd640 1 -- 172.21.15.88:0/261094998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c13b280 con 0x7f0b4c0b5990 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4bfff640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c13acc0 0x7f0b4c138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4b7fe640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b34003fc0 0x7f0b4c146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b4affd640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b4c0b5990 0x7f0b4c1dcd80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0b4002c3e0 tx=0x7f0b4c0b8150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.918+0000 7f0b33fff640 1 -- 172.21.15.88:0/261094998 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4003c040 con 0x7f0b4c0b5990 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.919+0000 7f0b33fff640 1 -- 172.21.15.88:0/261094998 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b400074a0 con 0x7f0b4c0b5990 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.919+0000 7f0b33fff640 1 -- 172.21.15.88:0/261094998 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4002c770 con 0x7f0b4c0b5990 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.919+0000 7f0b51a75640 1 -- 172.21.15.88:0/261094998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4c1dc580 con 0x7f0b4c0b5990 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.919+0000 7f0b51a75640 1 -- 172.21.15.88:0/261094998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4c148e30 con 0x7f0b4c0b5990 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.920+0000 7f0b51a75640 1 -- 172.21.15.88:0/261094998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4c13b4c0 con 0x7f0b4c0b5990 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.920+0000 7f0b33fff640 1 -- 172.21.15.88:0/261094998 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f0b40032070 con 0x7f0b4c0b5990 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.920+0000 7f0b33fff640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0b3806b300 0x7f0b3806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.920+0000 7f0b33fff640 1 -- 172.21.15.88:0/261094998 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b400ab050 con 0x7f0b4c0b5990 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.920+0000 7f0b4b7fe640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0b3806b300 0x7f0b3806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.921+0000 7f0b4b7fe640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0b3806b300 0x7f0b3806d7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009bc0 tx=0x7f0b3c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:06.924+0000 7f0b33fff640 1 -- 172.21.15.88:0/261094998 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0b4c13b4c0 con 0x7f0b4c0b5990 2024-01-22T10:13:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.134+0000 7f0b51a75640 1 -- 172.21.15.88:0/261094998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0b4c13b4c0 con 0x7f0b4c0b5990 2024-01-22T10:13:07.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.137+0000 7f0b33fff640 1 -- 172.21.15.88:0/261094998 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171305 (secure 0 0 0) 0x7f0b4c13b4c0 con 0x7f0b4c0b5990 2024-01-22T10:13:07.122 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.140+0000 7f0b51a75640 1 -- 172.21.15.88:0/261094998 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0b3806b300 msgr2=0x7f0b3806d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.140+0000 7f0b51a75640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0b3806b300 0x7f0b3806d7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009bc0 tx=0x7f0b3c008040 comp rx=0 tx=0).stop 2024-01-22T10:13:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.140+0000 7f0b51a75640 1 -- 172.21.15.88:0/261094998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b4c0b5990 msgr2=0x7f0b4c1dcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.140+0000 7f0b51a75640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b4c0b5990 0x7f0b4c1dcd80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0b4002c3e0 tx=0x7f0b4c0b8150 comp rx=0 tx=0).stop 2024-01-22T10:13:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.140+0000 7f0b51a75640 1 -- 172.21.15.88:0/261094998 shutdown_connections 2024-01-22T10:13:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.140+0000 7f0b51a75640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0b3806b300 0x7f0b3806d7c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.140+0000 7f0b51a75640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b4c13acc0 0x7f0b4c138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.140+0000 7f0b51a75640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b4c0b5990 0x7f0b4c1dcd80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.140+0000 7f0b51a75640 1 --2- 172.21.15.88:0/261094998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b34003fc0 0x7f0b4c146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.140+0000 7f0b51a75640 1 -- 172.21.15.88:0/261094998 >> 172.21.15.88:0/261094998 conn(0x7f0b4c06b9e0 msgr2=0x7f0b4c13bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.140+0000 7f0b51a75640 1 -- 172.21.15.88:0/261094998 shutdown_connections 2024-01-22T10:13:07.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.140+0000 7f0b51a75640 1 -- 172.21.15.88:0/261094998 wait complete. 2024-01-22T10:13:07.133 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3644863096},{"type":"v1","addr":"172.21.15.88:6833","nonce":3644863096}]},"active_addr":"172.21.15.88:6833/3644863096","active_change":"2024-01-22T10:12:42.694036+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4117,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":130809875}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":2673037234}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":1983196523}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":627027482}]}]} 2024-01-22T10:13:07.137 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-22T10:13:07.137 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-22T10:13:07.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:07.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.254+0000 7fe9c26d3640 1 Processor -- start 2024-01-22T10:13:07.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.254+0000 7fe9c26d3640 1 -- start start 2024-01-22T10:13:07.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.254+0000 7fe9c26d3640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9bc06d2b0 0x7fe9bc14bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.254+0000 7fe9c26d3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe9bc06baa0 0x7fe9bc06bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.254+0000 7fe9c26d3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9bc0a40c0 0x7fe9bc14ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.254+0000 7fe9c26d3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9bc14b700 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.254+0000 7fe9c26d3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9bc06f340 con 0x7fe9bc06baa0 2024-01-22T10:13:07.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.254+0000 7fe9c26d3640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc06de90 con 0x7fe9bc06d2b0 2024-01-22T10:13:07.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.254+0000 7fe9c0c70640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9bc0a40c0 0x7fe9bc14ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.254+0000 7fe9c0c70640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9bc0a40c0 0x7fe9bc14ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36468/0 (socket says 172.21.15.88:36468) 2024-01-22T10:13:07.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.254+0000 7fe9c0c70640 1 -- 172.21.15.88:0/1495676172 learned_addr learned my addr 172.21.15.88:0/1495676172 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.255+0000 7fe9bb7fe640 1 --2- 172.21.15.88:0/1495676172 >> v2:172.21.15.119:3300/0 conn(0x7fe9bc06baa0 0x7fe9bc06bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.255+0000 7fe9bbfff640 1 --2- 172.21.15.88:0/1495676172 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9bc06d2b0 0x7fe9bc14bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.255+0000 7fe9c0c70640 1 -- 172.21.15.88:0/1495676172 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9bc06d2b0 msgr2=0x7fe9bc14bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.255+0000 7fe9c0c70640 1 --2- 172.21.15.88:0/1495676172 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9bc06d2b0 0x7fe9bc14bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.255+0000 7fe9c0c70640 1 -- 172.21.15.88:0/1495676172 >> v2:172.21.15.119:3300/0 conn(0x7fe9bc06baa0 msgr2=0x7fe9bc06bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.255+0000 7fe9c0c70640 1 --2- 172.21.15.88:0/1495676172 >> v2:172.21.15.119:3300/0 conn(0x7fe9bc06baa0 0x7fe9bc06bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.255+0000 7fe9c0c70640 1 -- 172.21.15.88:0/1495676172 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc06f5e0 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.255+0000 7fe9bb7fe640 1 --2- 172.21.15.88:0/1495676172 >> v2:172.21.15.119:3300/0 conn(0x7fe9bc06baa0 0x7fe9bc06bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:07.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.255+0000 7fe9c0c70640 1 --2- 172.21.15.88:0/1495676172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9bc0a40c0 0x7fe9bc14ec00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc074620 tx=0x7fe9b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffa55a95835f5bb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.256+0000 7fe9baffd640 1 -- 172.21.15.88:0/1495676172 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b402ca70 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.256+0000 7fe9baffd640 1 -- 172.21.15.88:0/1495676172 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b402cbd0 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.256+0000 7fe9baffd640 1 -- 172.21.15.88:0/1495676172 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b40343f0 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.256+0000 7fe9c26d3640 1 -- 172.21.15.88:0/1495676172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9bc0a40c0 msgr2=0x7fe9bc14ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.256+0000 7fe9c26d3640 1 --2- 172.21.15.88:0/1495676172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9bc0a40c0 0x7fe9bc14ec00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc074620 tx=0x7fe9b402bed0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.256+0000 7fe9c26d3640 1 -- 172.21.15.88:0/1495676172 shutdown_connections 2024-01-22T10:13:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.256+0000 7fe9c26d3640 1 --2- 172.21.15.88:0/1495676172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9bc0a40c0 0x7fe9bc14ec00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.256+0000 7fe9c26d3640 1 --2- 172.21.15.88:0/1495676172 >> v2:172.21.15.119:3300/0 conn(0x7fe9bc06baa0 0x7fe9bc06bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.256+0000 7fe9c26d3640 1 --2- 172.21.15.88:0/1495676172 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9bc06d2b0 0x7fe9bc14bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.256+0000 7fe9c26d3640 1 -- 172.21.15.88:0/1495676172 >> 172.21.15.88:0/1495676172 conn(0x7fe9bc0bb8d0 msgr2=0x7fe9bc0bbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.256+0000 7fe9c26d3640 1 -- 172.21.15.88:0/1495676172 shutdown_connections 2024-01-22T10:13:07.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.256+0000 7fe9c26d3640 1 -- 172.21.15.88:0/1495676172 wait complete. 2024-01-22T10:13:07.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.257+0000 7fe9c26d3640 1 Processor -- start 2024-01-22T10:13:07.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.257+0000 7fe9c26d3640 1 -- start start 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c26d3640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9bc06baa0 0x7fe9bc0b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c26d3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9bc06d2b0 0x7fe9bc0b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c26d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9bc0a40c0 0x7fe9bc0b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c26d3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc0b6850 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c26d3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc0b5f60 con 0x7fe9bc06d2b0 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c26d3640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc0b7bc0 con 0x7fe9bc06baa0 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c0c70640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9bc0a40c0 0x7fe9bc0b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c0c70640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9bc0a40c0 0x7fe9bc0b8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36484/0 (socket says 172.21.15.88:36484) 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c0c70640 1 -- 172.21.15.88:0/569124882 learned_addr learned my addr 172.21.15.88:0/569124882 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9bbfff640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9bc06baa0 0x7fe9bc0b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9bb7fe640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9bc06d2b0 0x7fe9bc0b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c0c70640 1 -- 172.21.15.88:0/569124882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9bc06baa0 msgr2=0x7fe9bc0b73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c0c70640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9bc06baa0 0x7fe9bc0b73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c0c70640 1 -- 172.21.15.88:0/569124882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9bc06d2b0 msgr2=0x7fe9bc0b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c0c70640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9bc06d2b0 0x7fe9bc0b8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c0c70640 1 -- 172.21.15.88:0/569124882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b4009b30 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9c0c70640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9bc0a40c0 0x7fe9bc0b8890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4036040 tx=0x7fe9b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.258+0000 7fe9b8ff9640 1 -- 172.21.15.88:0/569124882 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4009510 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.259+0000 7fe9b8ff9640 1 -- 172.21.15.88:0/569124882 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b403e450 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.259+0000 7fe9c26d3640 1 -- 172.21.15.88:0/569124882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9bc0b6200 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.259+0000 7fe9b8ff9640 1 -- 172.21.15.88:0/569124882 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b403e800 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.259+0000 7fe9c26d3640 1 -- 172.21.15.88:0/569124882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9bc0b78e0 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.260+0000 7fe9c26d3640 1 -- 172.21.15.88:0/569124882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9bc04ea30 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.260+0000 7fe9b8ff9640 1 -- 172.21.15.88:0/569124882 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fe9b403e960 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.260+0000 7fe9b8ff9640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe9a806b330 0x7fe9a806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.260+0000 7fe9bbfff640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe9a806b330 0x7fe9a806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.260+0000 7fe9b8ff9640 1 -- 172.21.15.88:0/569124882 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9b40ac900 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.261+0000 7fe9bbfff640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe9a806b330 0x7fe9a806d7f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0006fd0 tx=0x7fe9b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.265+0000 7fe9b8ff9640 1 -- 172.21.15.88:0/569124882 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe9b4077620 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.434+0000 7fe9c26d3640 1 -- 172.21.15.88:0/569124882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9bc0b6990 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.435+0000 7fe9b8ff9640 1 -- 172.21.15.88:0/569124882 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fe9b4081070 con 0x7fe9bc0a40c0 2024-01-22T10:13:07.418 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:07.418 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.437+0000 7fe9c26d3640 1 -- 172.21.15.88:0/569124882 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe9a806b330 msgr2=0x7fe9a806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.437+0000 7fe9c26d3640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe9a806b330 0x7fe9a806d7f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0006fd0 tx=0x7fe9b0008040 comp rx=0 tx=0).stop 2024-01-22T10:13:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.437+0000 7fe9c26d3640 1 -- 172.21.15.88:0/569124882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9bc0a40c0 msgr2=0x7fe9bc0b8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.437+0000 7fe9c26d3640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9bc0a40c0 0x7fe9bc0b8890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4036040 tx=0x7fe9b4004a40 comp rx=0 tx=0).stop 2024-01-22T10:13:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.437+0000 7fe9c26d3640 1 -- 172.21.15.88:0/569124882 shutdown_connections 2024-01-22T10:13:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.437+0000 7fe9c26d3640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe9a806b330 0x7fe9a806d7f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.437+0000 7fe9c26d3640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9bc0a40c0 0x7fe9bc0b8890 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.437+0000 7fe9c26d3640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9bc06d2b0 0x7fe9bc0b8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.437+0000 7fe9c26d3640 1 --2- 172.21.15.88:0/569124882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9bc06baa0 0x7fe9bc0b73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.437+0000 7fe9c26d3640 1 -- 172.21.15.88:0/569124882 >> 172.21.15.88:0/569124882 conn(0x7fe9bc0bb8d0 msgr2=0x7fe9bc149500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.438+0000 7fe9c26d3640 1 -- 172.21.15.88:0/569124882 shutdown_connections 2024-01-22T10:13:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.438+0000 7fe9c26d3640 1 -- 172.21.15.88:0/569124882 wait complete. 2024-01-22T10:13:07.431 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-22T10:13:07.431 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:07.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.548+0000 7fd42e5d5640 1 Processor -- start 2024-01-22T10:13:07.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.548+0000 7fd42e5d5640 1 -- start start 2024-01-22T10:13:07.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd42e5d5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4280b54b0 0x7fd4280b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd42e5d5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd42814cfe0 0x7fd42814d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd42e5d5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4280b78e0 con 0x7fd428143510 2024-01-22T10:13:07.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd42e5d5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4280b58f0 con 0x7fd4280b54b0 2024-01-22T10:13:07.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd42e5d5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4281438f0 con 0x7fd42814cfe0 2024-01-22T10:13:07.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd4277fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4280b54b0 0x7fd4280b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd427fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd428143510 0x7fd428072590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41884/0 (socket says 172.21.15.88:41884) 2024-01-22T10:13:07.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd427fff640 1 -- 172.21.15.88:0/2477943317 learned_addr learned my addr 172.21.15.88:0/2477943317 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:07.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd42cb72640 1 --2- 172.21.15.88:0/2477943317 >> v2:172.21.15.119:3300/0 conn(0x7fd42814cfe0 0x7fd42814d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd4277fe640 1 -- 172.21.15.88:0/2477943317 >> v2:172.21.15.119:3300/0 conn(0x7fd42814cfe0 msgr2=0x7fd42814d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd4277fe640 1 --2- 172.21.15.88:0/2477943317 >> v2:172.21.15.119:3300/0 conn(0x7fd42814cfe0 0x7fd42814d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd4277fe640 1 -- 172.21.15.88:0/2477943317 >> v1:172.21.15.88:6789/0 conn(0x7fd428143510 legacy=0x7fd428072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd4277fe640 1 -- 172.21.15.88:0/2477943317 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42814cb50 con 0x7fd4280b54b0 2024-01-22T10:13:07.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.549+0000 7fd426ffd640 1 -- 172.21.15.88:0/2477943317 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802543666 0 0) 0x7fd4280b78e0 con 0x7fd428143510 2024-01-22T10:13:07.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.550+0000 7fd4277fe640 1 --2- 172.21.15.88:0/2477943317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4280b54b0 0x7fd4280b6cd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd4280b87b0 tx=0x7fd41c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9171805c1f808f53 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.550+0000 7fd426ffd640 1 -- 172.21.15.88:0/2477943317 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c031830 con 0x7fd4280b54b0 2024-01-22T10:13:07.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.550+0000 7fd426ffd640 1 -- 172.21.15.88:0/2477943317 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c031990 con 0x7fd4280b54b0 2024-01-22T10:13:07.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.550+0000 7fd426ffd640 1 -- 172.21.15.88:0/2477943317 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c031d20 con 0x7fd4280b54b0 2024-01-22T10:13:07.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.551+0000 7fd42e5d5640 1 -- 172.21.15.88:0/2477943317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4280b54b0 msgr2=0x7fd4280b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.551+0000 7fd42e5d5640 1 --2- 172.21.15.88:0/2477943317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4280b54b0 0x7fd4280b6cd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd4280b87b0 tx=0x7fd41c02b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.551+0000 7fd42e5d5640 1 -- 172.21.15.88:0/2477943317 shutdown_connections 2024-01-22T10:13:07.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.551+0000 7fd42e5d5640 1 --2- 172.21.15.88:0/2477943317 >> v2:172.21.15.119:3300/0 conn(0x7fd42814cfe0 0x7fd42814d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.551+0000 7fd42e5d5640 1 --2- 172.21.15.88:0/2477943317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4280b54b0 0x7fd4280b6cd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.551+0000 7fd42e5d5640 1 -- 172.21.15.88:0/2477943317 >> 172.21.15.88:0/2477943317 conn(0x7fd4280bdbf0 msgr2=0x7fd4280bdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.551+0000 7fd42e5d5640 1 -- 172.21.15.88:0/2477943317 shutdown_connections 2024-01-22T10:13:07.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.551+0000 7fd42e5d5640 1 -- 172.21.15.88:0/2477943317 wait complete. 2024-01-22T10:13:07.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.552+0000 7fd42e5d5640 1 Processor -- start 2024-01-22T10:13:07.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.552+0000 7fd42e5d5640 1 -- start start 2024-01-22T10:13:07.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd42e5d5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4280b54b0 0x7fd4280bd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd42e5d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd428143510 0x7fd42813ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd42e5d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd42814cfe0 0x7fd4281e0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd42e5d5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280bd820 con 0x7fd4280b54b0 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd42e5d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42813b2c0 con 0x7fd428143510 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd42e5d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280bda00 con 0x7fd42814cfe0 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd427fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4280b54b0 0x7fd4280bd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd427fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4280b54b0 0x7fd4280bd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43548/0 (socket says 172.21.15.88:43548) 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd427fff640 1 -- 172.21.15.88:0/238705302 learned_addr learned my addr 172.21.15.88:0/238705302 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd42cb72640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd42814cfe0 0x7fd4281e0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd4277fe640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd428143510 0x7fd42813ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd427fff640 1 -- 172.21.15.88:0/238705302 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd42814cfe0 msgr2=0x7fd4281e0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd427fff640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd42814cfe0 0x7fd4281e0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd427fff640 1 -- 172.21.15.88:0/238705302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd428143510 msgr2=0x7fd42813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd427fff640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd428143510 0x7fd42813ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd427fff640 1 -- 172.21.15.88:0/238705302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c009400 con 0x7fd4280b54b0 2024-01-22T10:13:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd42cb72640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd42814cfe0 0x7fd4281e0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd4277fe640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd428143510 0x7fd42813ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd427fff640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4280b54b0 0x7fd4280bd2e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c500 tx=0x7fd41800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd424ff9640 1 -- 172.21.15.88:0/238705302 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418007560 con 0x7fd4280b54b0 2024-01-22T10:13:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd424ff9640 1 -- 172.21.15.88:0/238705302 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4180047e0 con 0x7fd4280b54b0 2024-01-22T10:13:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd42e5d5640 1 -- 172.21.15.88:0/238705302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4281e4900 con 0x7fd4280b54b0 2024-01-22T10:13:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd424ff9640 1 -- 172.21.15.88:0/238705302 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418004b90 con 0x7fd4280b54b0 2024-01-22T10:13:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.553+0000 7fd42e5d5640 1 -- 172.21.15.88:0/238705302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4281e4340 con 0x7fd4280b54b0 2024-01-22T10:13:07.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.554+0000 7fd42e5d5640 1 -- 172.21.15.88:0/238705302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42804ea30 con 0x7fd4280b54b0 2024-01-22T10:13:07.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.555+0000 7fd424ff9640 1 -- 172.21.15.88:0/238705302 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fd418004cf0 con 0x7fd4280b54b0 2024-01-22T10:13:07.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.555+0000 7fd424ff9640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd41406b330 0x7fd41406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.555+0000 7fd424ff9640 1 -- 172.21.15.88:0/238705302 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd418089090 con 0x7fd4280b54b0 2024-01-22T10:13:07.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.555+0000 7fd4277fe640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd41406b330 0x7fd41406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.556+0000 7fd4277fe640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd41406b330 0x7fd41406d7f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd41c036000 tx=0x7fd41c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.559+0000 7fd424ff9640 1 -- 172.21.15.88:0/238705302 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd418053db0 con 0x7fd4280b54b0 2024-01-22T10:13:07.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.728+0000 7fd42e5d5640 1 -- 172.21.15.88:0/238705302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4281e4150 con 0x7fd4280b54b0 2024-01-22T10:13:07.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.729+0000 7fd424ff9640 1 -- 172.21.15.88:0/238705302 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fd4281e4150 con 0x7fd4280b54b0 2024-01-22T10:13:07.712 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:07.712 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:07.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.731+0000 7fd42e5d5640 1 -- 172.21.15.88:0/238705302 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd41406b330 msgr2=0x7fd41406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.731+0000 7fd42e5d5640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd41406b330 0x7fd41406d7f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd41c036000 tx=0x7fd41c008030 comp rx=0 tx=0).stop 2024-01-22T10:13:07.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.731+0000 7fd42e5d5640 1 -- 172.21.15.88:0/238705302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4280b54b0 msgr2=0x7fd4280bd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.731+0000 7fd42e5d5640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4280b54b0 0x7fd4280bd2e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c500 tx=0x7fd41800c9c0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.731+0000 7fd42e5d5640 1 -- 172.21.15.88:0/238705302 shutdown_connections 2024-01-22T10:13:07.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.731+0000 7fd42e5d5640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd41406b330 0x7fd41406d7f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.731+0000 7fd42e5d5640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd42814cfe0 0x7fd4281e0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.731+0000 7fd42e5d5640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd428143510 0x7fd42813ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.731+0000 7fd42e5d5640 1 --2- 172.21.15.88:0/238705302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4280b54b0 0x7fd4280bd2e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.731+0000 7fd42e5d5640 1 -- 172.21.15.88:0/238705302 >> 172.21.15.88:0/238705302 conn(0x7fd4280bdbf0 msgr2=0x7fd428072590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.731+0000 7fd42e5d5640 1 -- 172.21.15.88:0/238705302 shutdown_connections 2024-01-22T10:13:07.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.731+0000 7fd42e5d5640 1 -- 172.21.15.88:0/238705302 wait complete. 2024-01-22T10:13:07.725 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-22T10:13:07.725 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-22T10:13:07.726 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-22T10:13:07.726 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-22T10:13:07.727 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-22T10:13:07.727 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-22T10:13:07.727 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-22T10:13:07.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-22T10:13:07.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.912+0000 7f3814490640 1 Processor -- start 2024-01-22T10:13:07.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.912+0000 7f3814490640 1 -- start start 2024-01-22T10:13:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.913+0000 7fc32b675640 1 Processor -- start 2024-01-22T10:13:07.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.913+0000 7fc32b675640 1 -- start start 2024-01-22T10:13:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.915+0000 7fc32b675640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3240b7430 0x7fc3240b6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.915+0000 7fc32b675640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc3240b3eb0 0x7fc3240b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.915+0000 7fc32b675640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3240b7a50 con 0x7fc324149070 2024-01-22T10:13:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.915+0000 7fc32b675640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3240b6ec0 con 0x7fc3240b7430 2024-01-22T10:13:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.915+0000 7fc32b675640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3241485d0 con 0x7fc3240b3eb0 2024-01-22T10:13:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.915+0000 7fc328c10640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3240b7430 0x7fc3240b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.915+0000 7fc328c10640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3240b7430 0x7fc3240b6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43568/0 (socket says 172.21.15.88:43568) 2024-01-22T10:13:07.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.915+0000 7fc328c10640 1 -- 172.21.15.88:0/997379139 learned_addr learned my addr 172.21.15.88:0/997379139 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.913+0000 7f3814490640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f380c0b77f0 0x7f380c1535f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.913+0000 7f3814490640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380c153b30 0x7f380c15a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.913+0000 7f3814490640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380c153fc0 con 0x7f380c149ec0 2024-01-22T10:13:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.913+0000 7f3814490640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380c0713a0 con 0x7f380c0b77f0 2024-01-22T10:13:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.913+0000 7f3814490640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c1531a0 con 0x7f380c153b30 2024-01-22T10:13:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.913+0000 7f3811a2b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f380c0b77f0 0x7f380c1535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.913+0000 7f3812a2d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380c153b30 0x7f380c15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.913+0000 7f3812a2d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380c153b30 0x7f380c15a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49644/0 (socket says 172.21.15.88:49644) 2024-01-22T10:13:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.913+0000 7f3812a2d640 1 -- 172.21.15.88:0/4109623224 learned_addr learned my addr 172.21.15.88:0/4109623224 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.914+0000 7f3812a2d640 1 -- 172.21.15.88:0/4109623224 >> v2:172.21.15.88:3300/0 conn(0x7f380c0b77f0 msgr2=0x7f380c1535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.914+0000 7f3812a2d640 1 --2- 172.21.15.88:0/4109623224 >> v2:172.21.15.88:3300/0 conn(0x7f380c0b77f0 0x7f380c1535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.914+0000 7f3812a2d640 1 -- 172.21.15.88:0/4109623224 >> v1:172.21.15.119:6789/0 conn(0x7f380c149ec0 legacy=0x7f380c0baa50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-22T10:13:07.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.914+0000 7f3812a2d640 1 -- 172.21.15.88:0/4109623224 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c0bb160 con 0x7f380c153b30 2024-01-22T10:13:07.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.915+0000 7f3811a2b640 1 --2- 172.21.15.88:0/4109623224 >> v2:172.21.15.88:3300/0 conn(0x7f380c0b77f0 0x7f380c1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:07.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.914+0000 7f6005ed3640 1 Processor -- start 2024-01-22T10:13:07.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.915+0000 7f6005ed3640 1 -- start start 2024-01-22T10:13:07.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.915+0000 7fc329c12640 1 --2- 172.21.15.88:0/997379139 >> v2:172.21.15.119:3300/0 conn(0x7fc3240b3eb0 0x7fc3240b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.915+0000 7f3812a2d640 1 --2- 172.21.15.88:0/4109623224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380c153b30 0x7f380c15a530 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3804009e50 tx=0x7f380402bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94859929cc012808 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7fc31bfff640 1 -- 172.21.15.88:0/997379139 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882066570 0 0) 0x7fc3240b7a50 con 0x7fc324149070 2024-01-22T10:13:07.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7fc31bfff640 1 -- 172.21.15.88:0/997379139 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc310003520 con 0x7fc324149070 2024-01-22T10:13:07.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7fc328c10640 1 -- 172.21.15.88:0/997379139 >> v2:172.21.15.119:3300/0 conn(0x7fc3240b3eb0 msgr2=0x7fc3240b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7fc328c10640 1 --2- 172.21.15.88:0/997379139 >> v2:172.21.15.119:3300/0 conn(0x7fc3240b3eb0 0x7fc3240b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7fc328c10640 1 -- 172.21.15.88:0/997379139 >> v1:172.21.15.88:6789/0 conn(0x7fc324149070 legacy=0x7fc324142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7fc328c10640 1 -- 172.21.15.88:0/997379139 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc324070360 con 0x7fc3240b7430 2024-01-22T10:13:07.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f381122a640 1 -- 172.21.15.88:0/4109623224 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380402caa0 con 0x7f380c153b30 2024-01-22T10:13:07.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f381122a640 1 -- 172.21.15.88:0/4109623224 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380402cc00 con 0x7f380c153b30 2024-01-22T10:13:07.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f381122a640 1 -- 172.21.15.88:0/4109623224 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040343f0 con 0x7f380c153b30 2024-01-22T10:13:07.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f6005ed3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5ff803b650 0x7f5ff80ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f6005ed3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5ff80cd4d0 0x7f5ff80c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f6005ed3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff8039210 con 0x7f5ff803b270 2024-01-22T10:13:07.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f6005ed3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff803baa0 con 0x7f5ff803b650 2024-01-22T10:13:07.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f6005ed3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff803a2c0 con 0x7f5ff80cd4d0 2024-01-22T10:13:07.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f5ffffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5ff80cd4d0 0x7f5ff80c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f5ffffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5ff80cd4d0 0x7f5ff80c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:33706/0 (socket says 172.21.15.88:33706) 2024-01-22T10:13:07.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f5fff7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5ff803b270 0x7f5ff8039bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.88:47470/0 (socket says 172.21.15.88:47470) 2024-01-22T10:13:07.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f5ffffff640 1 -- 172.21.15.88:0/3341134361 learned_addr learned my addr 172.21.15.88:0/3341134361 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f5ffeffd640 1 --2- 172.21.15.88:0/3341134361 >> v2:172.21.15.88:3300/0 conn(0x7f5ff803b650 0x7f5ff80ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7fc328c10640 1 --2- 172.21.15.88:0/997379139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3240b7430 0x7fc3240b6980 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc3240b3d60 tx=0x7fc31402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a814e299460084d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f3814490640 1 -- 172.21.15.88:0/4109623224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380c153b30 msgr2=0x7f380c15a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f3814490640 1 --2- 172.21.15.88:0/4109623224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380c153b30 0x7f380c15a530 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3804009e50 tx=0x7f380402bf00 comp rx=0 tx=0).stop 2024-01-22T10:13:07.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f3814490640 1 -- 172.21.15.88:0/4109623224 shutdown_connections 2024-01-22T10:13:07.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f3814490640 1 --2- 172.21.15.88:0/4109623224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380c153b30 0x7f380c15a530 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f3814490640 1 --2- 172.21.15.88:0/4109623224 >> v2:172.21.15.88:3300/0 conn(0x7f380c0b77f0 0x7f380c1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f3814490640 1 -- 172.21.15.88:0/4109623224 >> 172.21.15.88:0/4109623224 conn(0x7f380c06bc20 msgr2=0x7f380c06c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f5ffeffd640 1 -- 172.21.15.88:0/3341134361 >> v2:172.21.15.119:3300/0 conn(0x7f5ff80cd4d0 msgr2=0x7f5ff80c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f5ffeffd640 1 --2- 172.21.15.88:0/3341134361 >> v2:172.21.15.119:3300/0 conn(0x7f5ff80cd4d0 0x7f5ff80c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f5ffeffd640 1 -- 172.21.15.88:0/3341134361 >> v1:172.21.15.119:6789/0 conn(0x7f5ff803b270 legacy=0x7f5ff8039bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.916+0000 7f5ffeffd640 1 -- 172.21.15.88:0/3341134361 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff8007480 con 0x7f5ff803b650 2024-01-22T10:13:07.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f89f4db0640 1 Processor -- start 2024-01-22T10:13:07.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f7fe889a640 1 Processor -- start 2024-01-22T10:13:07.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f3814490640 1 -- 172.21.15.88:0/4109623224 shutdown_connections 2024-01-22T10:13:07.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f3814490640 1 -- 172.21.15.88:0/4109623224 wait complete. 2024-01-22T10:13:07.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f69e359e640 1 Processor -- start 2024-01-22T10:13:07.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f69e359e640 1 -- start start 2024-01-22T10:13:07.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f89f4db0640 1 -- start start 2024-01-22T10:13:07.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f5ffeffd640 1 --2- 172.21.15.88:0/3341134361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff803b650 0x7f5ff80ccf90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6000050330 tx=0x7f60000a61f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccdc836e8f02ec11 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f5ffe7fc640 1 -- 172.21.15.88:0/3341134361 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60000738e0 con 0x7f5ff803b650 2024-01-22T10:13:07.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f5ffe7fc640 1 -- 172.21.15.88:0/3341134361 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6000073a40 con 0x7f5ff803b650 2024-01-22T10:13:07.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f5ffe7fc640 1 -- 172.21.15.88:0/3341134361 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6000073e90 con 0x7f5ff803b650 2024-01-22T10:13:07.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.917+0000 7f7fe889a640 1 -- start start 2024-01-22T10:13:07.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f7fe889a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7fe40bd280 0x7f7fe40bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f7fe889a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7fe4153c80 0x7f7fe415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7fcbc3fff640 1 Processor -- start 2024-01-22T10:13:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f7fe889a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe40b8e90 con 0x7f7fe40bb520 2024-01-22T10:13:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f7fe889a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe40b8350 con 0x7f7fe4153c80 2024-01-22T10:13:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f7fe889a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe40b7cc0 con 0x7f7fe40bd280 2024-01-22T10:13:07.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7fcbc3fff640 1 -- start start 2024-01-22T10:13:07.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f7fe359e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7fe4153c80 0x7f7fe415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f7fe359e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7fe4153c80 0x7f7fe415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43586/0 (socket says 172.21.15.88:43586) 2024-01-22T10:13:07.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f7fe359e640 1 -- 172.21.15.88:0/2031305681 learned_addr learned my addr 172.21.15.88:0/2031305681 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f7fe359e640 1 -- 172.21.15.88:0/2031305681 >> v2:172.21.15.119:3300/0 conn(0x7f7fe40bd280 msgr2=0x7f7fe40bafe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-22T10:13:07.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f7fe359e640 1 --2- 172.21.15.88:0/2031305681 >> v2:172.21.15.119:3300/0 conn(0x7f7fe40bd280 0x7f7fe40bafe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.918+0000 7f7fe359e640 1 -- 172.21.15.88:0/2031305681 >> v1:172.21.15.119:6789/0 conn(0x7f7fe40bb520 legacy=0x7f7fe4153570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-22T10:13:07.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f69e259c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f69e406c3a0 0x7f69e40b3180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41904/0 (socket says 172.21.15.88:41904) 2024-01-22T10:13:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f89f4db0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89f006ad10 0x7f89f00c0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f89f4db0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89f00bec20 0x7f89f00bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f89f4db0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f00c0820 con 0x7f89f00b44b0 2024-01-22T10:13:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f89f4db0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f00c0b00 con 0x7f89f00bec20 2024-01-22T10:13:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f89f4db0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00bd250 con 0x7f89f006ad10 2024-01-22T10:13:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f7fe359e640 1 -- 172.21.15.88:0/2031305681 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe40b8560 con 0x7f7fe4153c80 2024-01-22T10:13:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f69e259c640 1 -- 172.21.15.88:0/3347682824 learned_addr learned my addr 172.21.15.88:0/3347682824 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f3814490640 1 Processor -- start 2024-01-22T10:13:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f6005ed3640 1 -- 172.21.15.88:0/3341134361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff803b650 msgr2=0x7f5ff80ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f6005ed3640 1 --2- 172.21.15.88:0/3341134361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff803b650 0x7f5ff80ccf90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6000050330 tx=0x7f60000a61f0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f89eed9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89f00bec20 0x7f89f00bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f3814490640 1 -- start start 2024-01-22T10:13:07.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f89eed9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89f00bec20 0x7f89f00bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:33736/0 (socket says 172.21.15.88:33736) 2024-01-22T10:13:07.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f89eed9d640 1 -- 172.21.15.88:0/2597793871 learned_addr learned my addr 172.21.15.88:0/2597793871 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7fcbc3fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcbbc03f660 0x7fcbbc042a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f6005ed3640 1 -- 172.21.15.88:0/3341134361 shutdown_connections 2024-01-22T10:13:07.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f6005ed3640 1 --2- 172.21.15.88:0/3341134361 >> v2:172.21.15.119:3300/0 conn(0x7f5ff80cd4d0 0x7f5ff80c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f6005ed3640 1 --2- 172.21.15.88:0/3341134361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff803b650 0x7f5ff80ccf90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f6005ed3640 1 -- 172.21.15.88:0/3341134361 >> 172.21.15.88:0/3341134361 conn(0x7f5ff80062a0 msgr2=0x7f5ff8006680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7fcbc3fff640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc03ebf0 con 0x7fcbbc0cafc0 2024-01-22T10:13:07.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7fcbc3fff640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc0075b0 con 0x7fcbbc0cb3a0 2024-01-22T10:13:07.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7fcbc3fff640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc03ee60 con 0x7fcbbc03f660 2024-01-22T10:13:07.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f69e359e640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69e40b7d50 0x7f69e4153d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7fcbc2ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcbbc0cafc0 0x7fcbbc0d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41918/0 (socket says 172.21.15.88:41918) 2024-01-22T10:13:07.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7fcbc2ffd640 1 -- 172.21.15.88:0/2148315619 learned_addr learned my addr 172.21.15.88:0/2148315619 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:07.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f4cad9fa640 1 Processor -- start 2024-01-22T10:13:07.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7fcbc37fe640 1 --2- 172.21.15.88:0/2148315619 >> v2:172.21.15.119:3300/0 conn(0x7fcbbc03f660 0x7fcbbc042a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7fc31bfff640 1 -- 172.21.15.88:0/997379139 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314031870 con 0x7fc3240b7430 2024-01-22T10:13:07.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7fc31bfff640 1 -- 172.21.15.88:0/997379139 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3140319d0 con 0x7fc3240b7430 2024-01-22T10:13:07.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7fc31bfff640 1 -- 172.21.15.88:0/997379139 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314031d60 con 0x7fc3240b7430 2024-01-22T10:13:07.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f4cad9fa640 1 -- start start 2024-01-22T10:13:07.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7fcbc1ffb640 1 -- 172.21.15.88:0/2148315619 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946598800 0 0) 0x7fcbbc03ebf0 con 0x7fcbbc0cafc0 2024-01-22T10:13:07.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7fcbc1ffb640 1 -- 172.21.15.88:0/2148315619 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbac003520 con 0x7fcbbc0cafc0 2024-01-22T10:13:07.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f3814490640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380c0b77f0 0x7f380c13c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f69e2d9d640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69e40b7d50 0x7f69e4153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f69e359e640 1 -- 172.21.15.88:0/3347682824 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e406cda0 con 0x7f69e406c3a0 2024-01-22T10:13:07.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f3814490640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c149ec0 0x7f380c0bcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7fc32b675640 1 -- 172.21.15.88:0/997379139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3240b7430 msgr2=0x7fc3240b6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7fc32b675640 1 --2- 172.21.15.88:0/997379139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3240b7430 0x7fc3240b6980 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc3240b3d60 tx=0x7fc31402b910 comp rx=0 tx=0).stop 2024-01-22T10:13:07.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f3814490640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f380c153b30 0x7f380c13d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f69e359e640 1 -- 172.21.15.88:0/3347682824 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e406cac0 con 0x7f69e406d2f0 2024-01-22T10:13:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f3814490640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c13cea0 con 0x7f380c149ec0 2024-01-22T10:13:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f3811a2b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c149ec0 0x7f380c0bcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f7fe359e640 1 --2- 172.21.15.88:0/2031305681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe4153c80 0x7f7fe415a400 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7fe409f440 tx=0x7f7fd402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bed008359ffc36 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f69e359e640 1 -- 172.21.15.88:0/3347682824 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e406bd80 con 0x7f69e40b7d50 2024-01-22T10:13:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f3811a2b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c149ec0 0x7f380c0bcf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43588/0 (socket says 172.21.15.88:43588) 2024-01-22T10:13:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f3811a2b640 1 -- 172.21.15.88:0/436899853 learned_addr learned my addr 172.21.15.88:0/436899853 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c1e1330 con 0x7f380c153b30 2024-01-22T10:13:07.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0be860 con 0x7f380c0b77f0 2024-01-22T10:13:07.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338888170 0 0) 0x7f69e406cda0 con 0x7f69e406c3a0 2024-01-22T10:13:07.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f381222c640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380c0b77f0 0x7f380c13c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f89eed9d640 1 -- 172.21.15.88:0/2597793871 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89f006ad10 msgr2=0x7f89f00c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f89eed9d640 1 --2- 172.21.15.88:0/2597793871 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89f006ad10 0x7f89f00c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f89eed9d640 1 -- 172.21.15.88:0/2597793871 >> v1:172.21.15.119:6789/0 conn(0x7f89f00b44b0 legacy=0x7f89f014bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.919+0000 7f89eed9d640 1 -- 172.21.15.88:0/2597793871 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f00bb920 con 0x7f89f00bec20 2024-01-22T10:13:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d0003520 con 0x7f69e406c3a0 2024-01-22T10:13:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7fc32b675640 1 -- 172.21.15.88:0/997379139 shutdown_connections 2024-01-22T10:13:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7fc32b675640 1 --2- 172.21.15.88:0/997379139 >> v2:172.21.15.119:3300/0 conn(0x7fc3240b3eb0 0x7fc3240b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7fc32b675640 1 --2- 172.21.15.88:0/997379139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3240b7430 0x7fc3240b6980 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f7fe1d9b640 1 -- 172.21.15.88:0/2031305681 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd402c7d0 con 0x7f7fe4153c80 2024-01-22T10:13:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7fc32b675640 1 -- 172.21.15.88:0/997379139 >> 172.21.15.88:0/997379139 conn(0x7fc3240bcab0 msgr2=0x7fc3240bce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f4cad9fa640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ca80b9660 0x7f4ca80bbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7f7fe1d9b640 1 -- 172.21.15.88:0/2031305681 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd402c930 con 0x7f7fe4153c80 2024-01-22T10:13:07.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cad9fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ca80b8610 0x7f4ca814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cad9fa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4ca80bafc0 0x7f4ca814c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cad9fa640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca814ca30 con 0x7f4ca80b9660 2024-01-22T10:13:07.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f3811a2b640 1 -- 172.21.15.88:0/436899853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380c0b77f0 msgr2=0x7f380c13c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f3811a2b640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380c0b77f0 0x7f380c13c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f3811a2b640 1 -- 172.21.15.88:0/436899853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f380c153b30 msgr2=0x7f380c13d670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-22T10:13:07.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f3811a2b640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f380c153b30 0x7f380c13d670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f3811a2b640 1 -- 172.21.15.88:0/436899853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3808009400 con 0x7f380c149ec0 2024-01-22T10:13:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414580347 0 0) 0x7f69e406cac0 con 0x7f69e406d2f0 2024-01-22T10:13:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f7fe1d9b640 1 -- 172.21.15.88:0/2031305681 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd402ccc0 con 0x7f7fe4153c80 2024-01-22T10:13:07.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f89eed9d640 1 --2- 172.21.15.88:0/2597793871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f00bec20 0x7f89f00bf0b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009e50 tx=0x7f89e802bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bfb2b989deb4a2d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cad9fa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca80bad30 con 0x7f4ca80bafc0 2024-01-22T10:13:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ca80b8610 0x7f4ca814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cad9fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80bb750 con 0x7f4ca80b8610 2024-01-22T10:13:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ca80b8610 0x7f4ca814bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49688/0 (socket says 172.21.15.88:49688) 2024-01-22T10:13:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4ca7fff640 1 -- 172.21.15.88:0/2838182666 learned_addr learned my addr 172.21.15.88:0/2838182666 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7fcbc37fe640 1 -- 172.21.15.88:0/2148315619 >> v1:172.21.15.119:6789/0 conn(0x7fcbbc0cb3a0 legacy=0x7fcbbc006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7fcbc37fe640 1 -- 172.21.15.88:0/2148315619 >> v1:172.21.15.88:6789/0 conn(0x7fcbbc0cafc0 legacy=0x7fcbbc0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.920+0000 7fcbc37fe640 1 -- 172.21.15.88:0/2148315619 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc03f140 con 0x7fcbbc03f660 2024-01-22T10:13:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f3811a2b640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c149ec0 0x7f380c0bcf60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f380801f800 tx=0x7f380801fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cac9f8640 1 --2- 172.21.15.88:0/2838182666 >> v2:172.21.15.88:3300/0 conn(0x7f4ca80b9660 0x7f4ca80bbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cad1f9640 1 --2- 172.21.15.88:0/2838182666 >> v2:172.21.15.119:3300/0 conn(0x7f4ca80bafc0 0x7f4ca814c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cac9f8640 1 -- 172.21.15.88:0/2838182666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ca80b8610 msgr2=0x7f4ca814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cac9f8640 1 --2- 172.21.15.88:0/2838182666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ca80b8610 0x7f4ca814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cac9f8640 1 -- 172.21.15.88:0/2838182666 >> v2:172.21.15.119:3300/0 conn(0x7f4ca80bafc0 msgr2=0x7f4ca814c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cac9f8640 1 --2- 172.21.15.88:0/2838182666 >> v2:172.21.15.119:3300/0 conn(0x7f4ca80bafc0 0x7f4ca814c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7fc32b675640 1 -- 172.21.15.88:0/997379139 shutdown_connections 2024-01-22T10:13:07.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f6005ed3640 1 -- 172.21.15.88:0/3341134361 shutdown_connections 2024-01-22T10:13:07.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7fcbc37fe640 1 --2- 172.21.15.88:0/2148315619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbbc03f660 0x7fcbbc042a90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcbc404f7e0 tx=0x7fcbc40a6190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ac4c61b8e42059e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f89ed59a640 1 -- 172.21.15.88:0/2597793871 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e802cb90 con 0x7f89f00bec20 2024-01-22T10:13:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f89ed59a640 1 -- 172.21.15.88:0/2597793871 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e802ccf0 con 0x7f89f00bec20 2024-01-22T10:13:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f89ed59a640 1 -- 172.21.15.88:0/2597793871 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8034610 con 0x7f89f00bec20 2024-01-22T10:13:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cac9f8640 1 -- 172.21.15.88:0/2838182666 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca80bba30 con 0x7f4ca80b9660 2024-01-22T10:13:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f4cad1f9640 1 --2- 172.21.15.88:0/2838182666 >> v2:172.21.15.119:3300/0 conn(0x7f4ca80bafc0 0x7f4ca814c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7fcbc1ffb640 1 -- 172.21.15.88:0/2148315619 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc40ae440 con 0x7fcbbc03f660 2024-01-22T10:13:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7fcbc1ffb640 1 -- 172.21.15.88:0/2148315619 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc40ae5a0 con 0x7fcbbc03f660 2024-01-22T10:13:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7fcbc1ffb640 1 -- 172.21.15.88:0/2148315619 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc40ae440 con 0x7fcbbc03f660 2024-01-22T10:13:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f7fe889a640 1 -- 172.21.15.88:0/2031305681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe4153c80 msgr2=0x7f7fe415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f7fe889a640 1 --2- 172.21.15.88:0/2031305681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe4153c80 0x7f7fe415a400 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7fe409f440 tx=0x7f7fd402bc30 comp rx=0 tx=0).stop 2024-01-22T10:13:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f7fe889a640 1 -- 172.21.15.88:0/2031305681 shutdown_connections 2024-01-22T10:13:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f7fe889a640 1 --2- 172.21.15.88:0/2031305681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe4153c80 0x7f7fe415a400 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f7fe889a640 1 --2- 172.21.15.88:0/2031305681 >> v2:172.21.15.119:3300/0 conn(0x7f7fe40bd280 0x7f7fe40bafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f7fe889a640 1 -- 172.21.15.88:0/2031305681 >> 172.21.15.88:0/2031305681 conn(0x7f7fe409eb20 msgr2=0x7f7fe40bc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f7fe889a640 1 -- 172.21.15.88:0/2031305681 shutdown_connections 2024-01-22T10:13:07.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f6005ed3640 1 -- 172.21.15.88:0/3341134361 wait complete. 2024-01-22T10:13:07.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f3802ffd640 1 -- 172.21.15.88:0/436899853 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808009760 con 0x7f380c149ec0 2024-01-22T10:13:07.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f3802ffd640 1 -- 172.21.15.88:0/436899853 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380801db50 con 0x7f380c149ec0 2024-01-22T10:13:07.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f3802ffd640 1 -- 172.21.15.88:0/436899853 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380801dee0 con 0x7f380c149ec0 2024-01-22T10:13:07.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3804009b30 con 0x7f380c149ec0 2024-01-22T10:13:07.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c1e0a90 con 0x7f380c149ec0 2024-01-22T10:13:07.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e406cda0 con 0x7f69e406d2f0 2024-01-22T10:13:07.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3921555275 0 0) 0x7f69d0003520 con 0x7f69e406c3a0 2024-01-22T10:13:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69e40b7d50 msgr2=0x7f69e4153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f89f4db0640 1 -- 172.21.15.88:0/2597793871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f00bec20 msgr2=0x7f89f00bf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f89f4db0640 1 --2- 172.21.15.88:0/2597793871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f00bec20 0x7f89f00bf0b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009e50 tx=0x7f89e802bff0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7fcbc3fff640 1 -- 172.21.15.88:0/2148315619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbbc03f660 msgr2=0x7fcbbc042a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7fcbc3fff640 1 --2- 172.21.15.88:0/2148315619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbbc03f660 0x7fcbbc042a90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcbc404f7e0 tx=0x7fcbc40a6190 comp rx=0 tx=0).stop 2024-01-22T10:13:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7f4cac9f8640 1 --2- 172.21.15.88:0/2838182666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca80b9660 0x7f4ca80bbfb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ca806b7b0 tx=0x7f4ca002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca6e6699029f968 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7fcbc3fff640 1 -- 172.21.15.88:0/2148315619 shutdown_connections 2024-01-22T10:13:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7fcbc3fff640 1 --2- 172.21.15.88:0/2148315619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbbc03f660 0x7fcbbc042a90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7fcbc3fff640 1 -- 172.21.15.88:0/2148315619 >> 172.21.15.88:0/2148315619 conn(0x7fcbbc047020 msgr2=0x7fcbbc0432b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7f6005ed3640 1 Processor -- start 2024-01-22T10:13:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7fc32b675640 1 -- 172.21.15.88:0/997379139 wait complete. 2024-01-22T10:13:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7fc32b675640 1 Processor -- start 2024-01-22T10:13:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69e40b7d50 0x7f69e4153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 >> v1:172.21.15.119:6789/0 conn(0x7f69e406d2f0 legacy=0x7f69e40b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e406baa0 con 0x7f69e406c3a0 2024-01-22T10:13:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f69d4001670 con 0x7f69e406c3a0 2024-01-22T10:13:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 >> v1:172.21.15.88:6789/0 conn(0x7f69e406c3a0 legacy=0x7f69e40b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69d0004c00 0x7f69d0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69d0003760 0x7f69d0003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d0004170 0x7f69d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e406bd80 con 0x7f69d0004170 2024-01-22T10:13:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d00148e0 con 0x7f69d0004c00 2024-01-22T10:13:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d0014aa0 con 0x7f69d0003760 2024-01-22T10:13:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69e259c640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69d0004c00 0x7f69d0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.921+0000 7f69dbfff640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69d0003760 0x7f69d0003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f69e2d9d640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69e40b7d50 0x7f69e4153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:07.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f69e259c640 1 -- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69d0003760 msgr2=0x7f69d0003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:07.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f69e259c640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69d0003760 0x7f69d0003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f69e259c640 1 -- 172.21.15.88:0/3347682824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d0004170 msgr2=0x7f69d000b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-22T10:13:07.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7f69e2d9d640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d0004170 0x7f69d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7f69e259c640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69d0004170 0x7f69d000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7f69e259c640 1 -- 172.21.15.88:0/3347682824 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0003520 con 0x7f69d0004c00 2024-01-22T10:13:07.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7f6005ed3640 1 -- start start 2024-01-22T10:13:07.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.922+0000 7f7fe889a640 1 -- 172.21.15.88:0/2031305681 wait complete. 2024-01-22T10:13:07.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7f7fe889a640 1 Processor -- start 2024-01-22T10:13:07.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7f4ca77fe640 1 -- 172.21.15.88:0/2838182666 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00317c0 con 0x7f4ca80b9660 2024-01-22T10:13:07.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f4ca77fe640 1 -- 172.21.15.88:0/2838182666 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca0031920 con 0x7f4ca80b9660 2024-01-22T10:13:07.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.923+0000 7fc32b675640 1 -- start start 2024-01-22T10:13:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f4ca77fe640 1 -- 172.21.15.88:0/2838182666 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0031c90 con 0x7f4ca80b9660 2024-01-22T10:13:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f89f4db0640 1 -- 172.21.15.88:0/2597793871 shutdown_connections 2024-01-22T10:13:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f89f4db0640 1 --2- 172.21.15.88:0/2597793871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f00bec20 0x7f89f00bf0b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f89f4db0640 1 --2- 172.21.15.88:0/2597793871 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89f006ad10 0x7f89f00c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f89f4db0640 1 -- 172.21.15.88:0/2597793871 >> 172.21.15.88:0/2597793871 conn(0x7f89f00c0e20 msgr2=0x7f89f00c1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7fc32b675640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3240b3eb0 0x7fc3241388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7fcbc3fff640 1 -- 172.21.15.88:0/2148315619 shutdown_connections 2024-01-22T10:13:07.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7fc32b675640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3240b7430 0x7fc324142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f6005ed3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff803b270 0x7f5ff802bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7fcbc3fff640 1 -- 172.21.15.88:0/2148315619 wait complete. 2024-01-22T10:13:07.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f69e259c640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69d0004c00 0x7f69d0005000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f69d401d170 tx=0x7f69d00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92d55b631f7275c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7fc329411640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3240b3eb0 0x7fc3241388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7fc329411640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3240b3eb0 0x7fc3241388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:33764/0 (socket says 172.21.15.88:33764) 2024-01-22T10:13:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7fc329411640 1 -- 172.21.15.88:0/739042432 learned_addr learned my addr 172.21.15.88:0/739042432 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7fc32b675640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc324149070 0x7fc32414bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7fc32b675640 1 -- 172.21.15.88:0/739042432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc324143330 con 0x7fc324149070 2024-01-22T10:13:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f5fff7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff803b270 0x7f5ff802bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f5fff7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff803b270 0x7f5ff802bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43622/0 (socket says 172.21.15.88:43622) 2024-01-22T10:13:07.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7fc32b675640 1 -- 172.21.15.88:0/739042432 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc324139270 con 0x7fc3240b3eb0 2024-01-22T10:13:07.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7fc32b675640 1 -- 172.21.15.88:0/739042432 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc324138fb0 con 0x7fc3240b7430 2024-01-22T10:13:07.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f5fff7fe640 1 -- 172.21.15.88:0/1736385501 learned_addr learned my addr 172.21.15.88:0/1736385501 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f6005ed3640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff803b650 0x7f5ff80cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d403db50 con 0x7f69d0004c00 2024-01-22T10:13:07.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f7fe889a640 1 -- start start 2024-01-22T10:13:07.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f7fe889a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe40bb520 0x7f7fe40707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f7fe889a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40bd280 0x7f7fe4071270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f7fe889a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe4153c80 0x7f7fe40717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f7fe889a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4070350 con 0x7f7fe40bd280 2024-01-22T10:13:07.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f7fe889a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4071cf0 con 0x7f7fe40bb520 2024-01-22T10:13:07.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f7fe889a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe406fd70 con 0x7f7fe4153c80 2024-01-22T10:13:07.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d403dcb0 con 0x7f69d0004c00 2024-01-22T10:13:07.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7fc329c12640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc324149070 0x7fc32414bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f69e1d9b640 1 -- 172.21.15.88:0/3347682824 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4005af0 con 0x7f69d0004c00 2024-01-22T10:13:07.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f4cad9fa640 1 -- 172.21.15.88:0/2838182666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca80b9660 msgr2=0x7f4ca80bbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f4cad9fa640 1 --2- 172.21.15.88:0/2838182666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca80b9660 0x7f4ca80bbfb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4ca806b7b0 tx=0x7f4ca002b860 comp rx=0 tx=0).stop 2024-01-22T10:13:07.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7fc328c10640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3240b7430 0x7fc324142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.924+0000 7f3802ffd640 1 -- 172.21.15.88:0/436899853 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f3808024480 con 0x7f380c149ec0 2024-01-22T10:13:07.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f4cad9fa640 1 -- 172.21.15.88:0/2838182666 shutdown_connections 2024-01-22T10:13:07.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f4cad9fa640 1 --2- 172.21.15.88:0/2838182666 >> v2:172.21.15.119:3300/0 conn(0x7f4ca80bafc0 0x7f4ca814c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f4cad9fa640 1 --2- 172.21.15.88:0/2838182666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ca80b8610 0x7f4ca814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f4cad9fa640 1 --2- 172.21.15.88:0/2838182666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca80b9660 0x7f4ca80bbfb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f89f4db0640 1 -- 172.21.15.88:0/2597793871 shutdown_connections 2024-01-22T10:13:07.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f4cad9fa640 1 -- 172.21.15.88:0/2838182666 >> 172.21.15.88:0/2838182666 conn(0x7f4ca809e6d0 msgr2=0x7f4ca809eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f4cad9fa640 1 -- 172.21.15.88:0/2838182666 shutdown_connections 2024-01-22T10:13:07.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f3802ffd640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f37f006b380 0x7f37f006d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f6005ed3640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff80ccac0 0x7f5ff80c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f6005ed3640 1 -- 172.21.15.88:0/1736385501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff802c220 con 0x7f5ff803b270 2024-01-22T10:13:07.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f6005ed3640 1 -- 172.21.15.88:0/1736385501 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80cc000 con 0x7f5ff80ccac0 2024-01-22T10:13:07.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f6005ed3640 1 -- 172.21.15.88:0/1736385501 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80c9a70 con 0x7f5ff803b650 2024-01-22T10:13:07.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f5ffeffd640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff803b650 0x7f5ff80cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f5ffffff640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff80ccac0 0x7f5ff80c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f4cad9fa640 1 -- 172.21.15.88:0/2838182666 wait complete. 2024-01-22T10:13:07.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7fc329c12640 1 -- 172.21.15.88:0/739042432 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3240b7430 msgr2=0x7fc324142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f89f4db0640 1 -- 172.21.15.88:0/2597793871 wait complete. 2024-01-22T10:13:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f3802ffd640 1 -- 172.21.15.88:0/436899853 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3808069de0 con 0x7f380c149ec0 2024-01-22T10:13:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f69e359e640 1 -- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69d0004c00 msgr2=0x7f69d0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f69e359e640 1 --2- 172.21.15.88:0/3347682824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69d0004c00 0x7f69d0005000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f69d401d170 tx=0x7f69d00057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f3814490640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] conn(0x7f37f4001650 0x7f37f4003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 --> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37f4006bb0 con 0x7f37f4001650 2024-01-22T10:13:07.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f5fff7fe640 1 -- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff803b650 msgr2=0x7f5ff80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f5fff7fe640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ff803b650 0x7f5ff80cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f5fff7fe640 1 -- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff80ccac0 msgr2=0x7f5ff80c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f5fff7fe640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ff80ccac0 0x7f5ff80c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f5fff7fe640 1 -- 172.21.15.88:0/1736385501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80ca700 con 0x7f5ff803b270 2024-01-22T10:13:07.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fc329c12640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3240b7430 0x7fc324142690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fc329c12640 1 -- 172.21.15.88:0/739042432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3240b3eb0 msgr2=0x7fc3241388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fc329c12640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3240b3eb0 0x7fc3241388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fc329c12640 1 -- 172.21.15.88:0/739042432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3140094d0 con 0x7fc324149070 2024-01-22T10:13:07.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fc329411640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3240b3eb0 0x7fc3241388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:07.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fc328c10640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3240b7430 0x7fc324142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:07.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f69e2d9d640 1 -- 172.21.15.88:0/3347682824 reap_dead start 2024-01-22T10:13:07.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f69e359e640 1 -- 172.21.15.88:0/3347682824 shutdown_connections 2024-01-22T10:13:07.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f69e359e640 1 -- 172.21.15.88:0/3347682824 >> 172.21.15.88:0/3347682824 conn(0x7f69e40bc8e0 msgr2=0x7f69e40bccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:07.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fc329c12640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc324149070 0x7fc32414bd90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc32000eba0 tx=0x7fc32000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f69e359e640 1 -- 172.21.15.88:0/3347682824 shutdown_connections 2024-01-22T10:13:07.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f69e359e640 1 -- 172.21.15.88:0/3347682824 wait complete. 2024-01-22T10:13:07.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f5fff7fe640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff803b270 0x7f5ff802bce0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c450 tx=0x7f5ff400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fcbc3fff640 1 Processor -- start 2024-01-22T10:13:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f3812a2d640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] conn(0x7f37f4001650 0x7f37f4003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f5febfff640 1 -- 172.21.15.88:0/1736385501 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4007480 con 0x7f5ff803b270 2024-01-22T10:13:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f5febfff640 1 -- 172.21.15.88:0/1736385501 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff40075e0 con 0x7f5ff803b270 2024-01-22T10:13:07.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fcbc3fff640 1 -- start start 2024-01-22T10:13:07.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f6005ed3640 1 -- 172.21.15.88:0/1736385501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff80cc2c0 con 0x7f5ff803b270 2024-01-22T10:13:07.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.927+0000 7f6005ed3640 1 -- 172.21.15.88:0/1736385501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff80cb2b0 con 0x7f5ff803b270 2024-01-22T10:13:07.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.927+0000 7f89f4db0640 1 Processor -- start 2024-01-22T10:13:07.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.927+0000 7f5febfff640 1 -- 172.21.15.88:0/1736385501 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4005a50 con 0x7f5ff803b270 2024-01-22T10:13:07.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.927+0000 7f3812a2d640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] conn(0x7f37f4001650 0x7f37f4003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.927+0000 7f4cad9fa640 1 Processor -- start 2024-01-22T10:13:07.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.927+0000 7f4cad9fa640 1 -- start start 2024-01-22T10:13:07.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fc319ffb640 1 -- 172.21.15.88:0/739042432 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32000cd20 con 0x7fc324149070 2024-01-22T10:13:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fc319ffb640 1 -- 172.21.15.88:0/739042432 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32000f040 con 0x7fc324149070 2024-01-22T10:13:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fc319ffb640 1 -- 172.21.15.88:0/739042432 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3200146c0 con 0x7fc324149070 2024-01-22T10:13:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7fc32b675640 1 -- 172.21.15.88:0/739042432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32414b590 con 0x7fc324149070 2024-01-22T10:13:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.927+0000 7fc32b675640 1 -- 172.21.15.88:0/739042432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32406c4d0 con 0x7fc324149070 2024-01-22T10:13:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7fc30f7fe640 1 -- 172.21.15.88:0/739042432 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc324072c30 con 0x7fc324149070 2024-01-22T10:13:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.927+0000 7f89f4db0640 1 -- start start 2024-01-22T10:13:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f89f4db0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89f006ad10 0x7f89f013fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f89f4db0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f00b44b0 0x7f89f00b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f89f4db0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89f00bec20 0x7f89f01e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f89f4db0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00b50d0 con 0x7f89f00bec20 2024-01-22T10:13:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f89f4db0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0140250 con 0x7f89f00b44b0 2024-01-22T10:13:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f89f4db0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0140530 con 0x7f89f006ad10 2024-01-22T10:13:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f89eed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89f00bec20 0x7f89f01e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f89eed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89f00bec20 0x7f89f01e8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43654/0 (socket says 172.21.15.88:43654) 2024-01-22T10:13:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f89eed9d640 1 -- 172.21.15.88:0/3873099362 learned_addr learned my addr 172.21.15.88:0/3873099362 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f7fe2d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe40bb520 0x7f7fe40707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f7fe2d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe40bb520 0x7f7fe40707e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:33770/0 (socket says 172.21.15.88:33770) 2024-01-22T10:13:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f7fe2d9d640 1 -- 172.21.15.88:0/2270740074 learned_addr learned my addr 172.21.15.88:0/2270740074 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f7fe2d9d640 1 -- 172.21.15.88:0/2270740074 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe4153c80 msgr2=0x7f7fe40717b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-22T10:13:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f7fe2d9d640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe4153c80 0x7f7fe40717b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f7fe2d9d640 1 -- 172.21.15.88:0/2270740074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40bd280 msgr2=0x7f7fe4071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.925+0000 7f7fe259c640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40bd280 0x7f7fe4071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f7fe2d9d640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40bd280 0x7f7fe4071270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f7fe2d9d640 1 -- 172.21.15.88:0/2270740074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd40094d0 con 0x7f7fe40bb520 2024-01-22T10:13:07.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f7fe259c640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fe40bd280 0x7f7fe4071270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f7fe2d9d640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe40bb520 0x7f7fe40707e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800b480 tx=0x7f7fd800b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f7fcb7fe640 1 -- 172.21.15.88:0/2270740074 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8010870 con 0x7f7fe40bb520 2024-01-22T10:13:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.926+0000 7f7fcb7fe640 1 -- 172.21.15.88:0/2270740074 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd80109f0 con 0x7f7fe40bb520 2024-01-22T10:13:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.927+0000 7f7fcb7fe640 1 -- 172.21.15.88:0/2270740074 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8010da0 con 0x7f7fe40bb520 2024-01-22T10:13:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.927+0000 7f7fe889a640 1 -- 172.21.15.88:0/2270740074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe406f0e0 con 0x7f7fe40bb520 2024-01-22T10:13:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.927+0000 7f7fe889a640 1 -- 172.21.15.88:0/2270740074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe40b0e40 con 0x7f7fe40bb520 2024-01-22T10:13:07.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f69e359e640 1 Processor -- start 2024-01-22T10:13:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f4cad9fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ca80b9660 0x7f4ca806fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f4cad9fa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca80bafc0 0x7f4ca8144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f3802ffd640 1 -- 172.21.15.88:0/436899853 <== osd.3 v2:172.21.15.88:6811/1947300237 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f37f4006bb0 con 0x7f37f4001650 2024-01-22T10:13:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f381222c640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f37f006b380 0x7f37f006d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f4cad9fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ca81e1bc0 0x7f4ca8071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f89ee59c640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89f006ad10 0x7f89f013fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f89edd9b640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f00b44b0 0x7f89f00b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f4cad9fa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca806f2d0 con 0x7f4ca80bafc0 2024-01-22T10:13:07.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f4cad9fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80b6af0 con 0x7f4ca80b9660 2024-01-22T10:13:07.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.928+0000 7f7fe889a640 1 -- 172.21.15.88:0/2270740074 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7fe40bb930 con 0x7f7fe40bb520 2024-01-22T10:13:07.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f69e359e640 1 -- start start 2024-01-22T10:13:07.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca80bafc0 0x7f4ca8144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f4cac9f8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ca80b9660 0x7f4ca806fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f4cad9fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca81e10e0 con 0x7f4ca81e1bc0 2024-01-22T10:13:07.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f89eed9d640 1 -- 172.21.15.88:0/3873099362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89f006ad10 msgr2=0x7f89f013fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f89eed9d640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89f006ad10 0x7f89f013fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f89eed9d640 1 -- 172.21.15.88:0/3873099362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f00b44b0 msgr2=0x7f89f00b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f89eed9d640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89f00b44b0 0x7f89f00b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f4cad1f9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ca81e1bc0 0x7f4ca8071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f89eed9d640 1 -- 172.21.15.88:0/3873099362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e8009b30 con 0x7f89f00bec20 2024-01-22T10:13:07.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f89ee59c640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89f006ad10 0x7f89f013fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:07.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca80bafc0 0x7f4ca8144af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43670/0 (socket says 172.21.15.88:43670) 2024-01-22T10:13:07.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f4cac9f8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ca80b9660 0x7f4ca806fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:33806/0 (socket says 172.21.15.88:33806) 2024-01-22T10:13:07.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f89eed9d640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89f00bec20 0x7f89f01e8e80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f89e8036040 tx=0x7f89e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7fcbc3fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbbc03f660 0x7fcbbc0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7fcbc3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbbc0cafc0 0x7fcbbc15bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7fcbc3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbbc0cb3a0 0x7fcbbc166780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f4ca7fff640 1 -- 172.21.15.88:0/553313009 learned_addr learned my addr 172.21.15.88:0/553313009 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7fcbc3fff640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc15c210 con 0x7fcbbc0cb3a0 2024-01-22T10:13:07.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7fcbc3fff640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0ce7e0 con 0x7fcbbc0cafc0 2024-01-22T10:13:07.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.929+0000 7f89e6ffd640 1 -- 172.21.15.88:0/3873099362 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e803e450 con 0x7f89f00bec20 2024-01-22T10:13:07.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7fcbc3fff640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0ce500 con 0x7fcbbc03f660 2024-01-22T10:13:07.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7fcbc2ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbbc03f660 0x7fcbbc0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7fcbc2ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbbc03f660 0x7fcbbc0cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49750/0 (socket says 172.21.15.88:49750) 2024-01-22T10:13:07.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7fcbc2ffd640 1 -- 172.21.15.88:0/4064419336 learned_addr learned my addr 172.21.15.88:0/4064419336 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f69e359e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69e4148170 0x7f69e41e0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f69e359e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69e41465e0 0x7f69e41e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f69e359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e4142810 0x7f69e4142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f69e359e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e4146b50 con 0x7f69e4142810 2024-01-22T10:13:07.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f69e359e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41431d0 con 0x7f69e4148170 2024-01-22T10:13:07.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f69e359e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e4144300 con 0x7f69e41465e0 2024-01-22T10:13:07.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7fcbc27fc640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbbc0cafc0 0x7fcbbc15bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f69dbfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69e41465e0 0x7f69e41e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f69dbfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69e41465e0 0x7f69e41e06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49764/0 (socket says 172.21.15.88:49764) 2024-01-22T10:13:07.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f69dbfff640 1 -- 172.21.15.88:0/3223843005 learned_addr learned my addr 172.21.15.88:0/3223843005 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:07.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f381222c640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f37f006b380 0x7f37f006d840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37fc006fd0 tx=0x7f37fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f89f4db0640 1 -- 172.21.15.88:0/3873099362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f01e8680 con 0x7f89f00bec20 2024-01-22T10:13:07.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f89f4db0640 1 -- 172.21.15.88:0/3873099362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f00a0200 con 0x7f89f00bec20 2024-01-22T10:13:07.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f89e6ffd640 1 -- 172.21.15.88:0/3873099362 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e803e5d0 con 0x7f89f00bec20 2024-01-22T10:13:07.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f89e6ffd640 1 -- 172.21.15.88:0/3873099362 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e803e980 con 0x7f89f00bec20 2024-01-22T10:13:07.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f5febfff640 1 -- 172.21.15.88:0/1736385501 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f5ff4005bb0 con 0x7f5ff803b270 2024-01-22T10:13:07.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f69dbfff640 1 -- 172.21.15.88:0/3223843005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69e4148170 msgr2=0x7f69e41e0160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-22T10:13:07.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f69dbfff640 1 --2- 172.21.15.88:0/3223843005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69e4148170 0x7f69e41e0160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f69dbfff640 1 -- 172.21.15.88:0/3223843005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e4142810 msgr2=0x7f69e4142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f69dbfff640 1 --2- 172.21.15.88:0/3223843005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69e4142810 0x7f69e4142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f69dbfff640 1 -- 172.21.15.88:0/3223843005 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e41445e0 con 0x7f69e41465e0 2024-01-22T10:13:07.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f4ca7fff640 1 -- 172.21.15.88:0/553313009 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ca81e1bc0 msgr2=0x7f4ca8071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7fcbc37fe640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbbc0cb3a0 0x7fcbbc166780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7fcbc2ffd640 1 -- 172.21.15.88:0/4064419336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbbc0cafc0 msgr2=0x7fcbbc15bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7fcbc2ffd640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbbc0cafc0 0x7fcbbc15bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7fcbc2ffd640 1 -- 172.21.15.88:0/4064419336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbbc0cb3a0 msgr2=0x7fcbbc166780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f6005ed3640 1 -- 172.21.15.88:0/1736385501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5fe0001030 con 0x7f5ff803b270 2024-01-22T10:13:07.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f89f4db0640 1 -- 172.21.15.88:0/3873099362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89cc001030 con 0x7f89f00bec20 2024-01-22T10:13:07.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7fcbc2ffd640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbbc0cb3a0 0x7fcbbc166780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7fcbc2ffd640 1 -- 172.21.15.88:0/4064419336 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4069970 con 0x7fcbbc03f660 2024-01-22T10:13:07.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7fcbc37fe640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbbc0cb3a0 0x7fcbbc166780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:07.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f4ca7fff640 1 --2- 172.21.15.88:0/553313009 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ca81e1bc0 0x7f4ca8071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f4ca7fff640 1 -- 172.21.15.88:0/553313009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ca80b9660 msgr2=0x7f4ca806fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:07.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f4ca7fff640 1 --2- 172.21.15.88:0/553313009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ca80b9660 0x7f4ca806fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:07.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f4ca7fff640 1 -- 172.21.15.88:0/553313009 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca0009400 con 0x7f4ca80bafc0 2024-01-22T10:13:07.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.930+0000 7f4ca7fff640 1 --2- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca80bafc0 0x7f4ca8144af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800eed0 tx=0x7f4c9800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f7fcb7fe640 1 -- 172.21.15.88:0/2270740074 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f7fd8004020 con 0x7f7fe40bb520 2024-01-22T10:13:07.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f7fcb7fe640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7fd006b430 0x7f7fd006d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f69dbfff640 1 --2- 172.21.15.88:0/3223843005 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69e41465e0 0x7f69e41e06a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00f820 tx=0x7f69cc00fce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7fcbc2ffd640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbbc03f660 0x7fcbbc0cc4c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800c580 tx=0x7fcbb800ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f69daffd640 1 -- 172.21.15.88:0/3223843005 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc00fed0 con 0x7f69e41465e0 2024-01-22T10:13:07.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f7fcb7fe640 1 -- 172.21.15.88:0/2270740074 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fd808a440 con 0x7f7fe40bb520 2024-01-22T10:13:07.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f5febfff640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5fe406b400 0x7f5fe406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f69daffd640 1 -- 172.21.15.88:0/3223843005 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc0052e0 con 0x7f69e41465e0 2024-01-22T10:13:07.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7f69daffd640 1 -- 172.21.15.88:0/3223843005 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc00d950 con 0x7f69e41465e0 2024-01-22T10:13:07.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f69e359e640 1 -- 172.21.15.88:0/3223843005 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e41448c0 con 0x7f69e41465e0 2024-01-22T10:13:07.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f69e359e640 1 -- 172.21.15.88:0/3223843005 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e4148550 con 0x7f69e41465e0 2024-01-22T10:13:07.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f4ca57fa640 1 -- 172.21.15.88:0/553313009 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98010040 con 0x7f4ca80bafc0 2024-01-22T10:13:07.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.931+0000 7fc319ffb640 1 -- 172.21.15.88:0/739042432 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fc320014820 con 0x7fc324149070 2024-01-22T10:13:07.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7fc319ffb640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc30806b430 0x7fc30806d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7fc319ffb640 1 -- 172.21.15.88:0/739042432 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc32008b250 con 0x7fc324149070 2024-01-22T10:13:07.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7fc319ffb640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] conn(0x7fc308073650 0x7fc308075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7fc319ffb640 1 -- 172.21.15.88:0/739042432 --> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc308076120 con 0x7fc308073650 2024-01-22T10:13:07.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7fc319ffb640 1 -- 172.21.15.88:0/739042432 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc32008b600 con 0x7fc324149070 2024-01-22T10:13:07.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f5febfff640 1 -- 172.21.15.88:0/1736385501 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ff40890d0 con 0x7f5ff803b270 2024-01-22T10:13:07.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f5febfff640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] conn(0x7f5fe40735a0 0x7f5fe40759c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f5febfff640 1 -- 172.21.15.88:0/1736385501 --> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fe4076070 con 0x7f5fe40735a0 2024-01-22T10:13:07.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f5febfff640 1 -- 172.21.15.88:0/1736385501 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ff4053df0 con 0x7f5ff803b270 2024-01-22T10:13:07.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7fcbab7fe640 1 -- 172.21.15.88:0/4064419336 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8007560 con 0x7fcbbc03f660 2024-01-22T10:13:07.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f4ca57fa640 1 -- 172.21.15.88:0/553313009 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c980092e0 con 0x7f4ca80bafc0 2024-01-22T10:13:07.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f5ffeffd640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5fe406b400 0x7f5fe406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7fc329411640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc30806b430 0x7fc30806d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f5ffffff640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] conn(0x7f5fe40735a0 0x7f5fe40759c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7fcbc3fff640 1 -- 172.21.15.88:0/4064419336 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc005e50 con 0x7fcbbc03f660 2024-01-22T10:13:07.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7fcbc3fff640 1 -- 172.21.15.88:0/4064419336 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc0ce190 con 0x7fcbbc03f660 2024-01-22T10:13:07.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7fcbab7fe640 1 -- 172.21.15.88:0/4064419336 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb80047e0 con 0x7fcbbc03f660 2024-01-22T10:13:07.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.933+0000 7f4ca57fa640 1 -- 172.21.15.88:0/553313009 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98014400 con 0x7f4ca80bafc0 2024-01-22T10:13:07.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.933+0000 7f69e359e640 1 -- 172.21.15.88:0/3223843005 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69e4144470 con 0x7f69e41465e0 2024-01-22T10:13:07.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.933+0000 7f5ffeffd640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5fe406b400 0x7f5fe406d8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8008850 tx=0x7f60000aa000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.933+0000 7fcbab7fe640 1 -- 172.21.15.88:0/4064419336 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8004b90 con 0x7fcbbc03f660 2024-01-22T10:13:07.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.932+0000 7f7fe259c640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7fd006b430 0x7f7fd006d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.933+0000 7f7fcb7fe640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] conn(0x7f7fd0073650 0x7f7fd0075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.933+0000 7f7fcb7fe640 1 -- 172.21.15.88:0/2270740074 --> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fd0076120 con 0x7f7fd0073650 2024-01-22T10:13:07.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.933+0000 7f7fcb7fe640 1 -- 172.21.15.88:0/2270740074 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fd808a7f0 con 0x7f7fe40bb520 2024-01-22T10:13:07.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.933+0000 7f4cad9fa640 1 -- 172.21.15.88:0/553313009 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca81e13c0 con 0x7f4ca80bafc0 2024-01-22T10:13:07.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.933+0000 7f4cad9fa640 1 -- 172.21.15.88:0/553313009 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca8070170 con 0x7f4ca80bafc0 2024-01-22T10:13:07.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.933+0000 7f7fe359e640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] conn(0x7f7fd0073650 0x7f7fd0075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7f7fe359e640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] conn(0x7f7fd0073650 0x7f7fd0075a70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.933+0000 7f89e6ffd640 1 -- 172.21.15.88:0/3873099362 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f89e803eae0 con 0x7f89f00bec20 2024-01-22T10:13:07.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7fc329411640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc30806b430 0x7fc30806d8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0011e0 tx=0x7fc31c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7f5ffffff640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] conn(0x7f5fe40735a0 0x7f5fe40759c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7f89e6ffd640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f89d806b400 0x7f89d806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7fc328c10640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] conn(0x7fc308073650 0x7fc308075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7f7fe259c640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7fd006b430 0x7f7fd006d8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40b6b80 tx=0x7f7fdc0073e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7f89e6ffd640 1 -- 172.21.15.88:0/3873099362 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89e80acc90 con 0x7f89f00bec20 2024-01-22T10:13:07.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7f4cad9fa640 1 -- 172.21.15.88:0/553313009 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ca80b81f0 con 0x7f4ca80bafc0 2024-01-22T10:13:07.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7fc328c10640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] conn(0x7fc308073650 0x7fc308075a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7f69daffd640 1 -- 172.21.15.88:0/3223843005 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f69cc00dab0 con 0x7f69e41465e0 2024-01-22T10:13:07.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.935+0000 7f69daffd640 1 --2- 172.21.15.88:0/3223843005 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f69c406b400 0x7f69c406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7f89ee59c640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f89d806b400 0x7f89d806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7f89e6ffd640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] conn(0x7f89d8073620 0x7f89d8075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7f89e6ffd640 1 -- 172.21.15.88:0/3873099362 --> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89d80760f0 con 0x7f89d8073620 2024-01-22T10:13:07.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.934+0000 7f89e6ffd640 1 -- 172.21.15.88:0/3873099362 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89e80ad040 con 0x7f89f00bec20 2024-01-22T10:13:07.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.935+0000 7f89ee59c640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f89d806b400 0x7f89d806d8c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009d60 tx=0x7f89dc009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.935+0000 7fcbab7fe640 1 -- 172.21.15.88:0/4064419336 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fcbb8004cf0 con 0x7fcbbc03f660 2024-01-22T10:13:07.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.935+0000 7f5febfff640 1 -- 172.21.15.88:0/1736385501 <== osd.4 v2:172.21.15.119:6800/4248437697 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5fe4076070 con 0x7f5fe40735a0 2024-01-22T10:13:07.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.935+0000 7f69daffd640 1 -- 172.21.15.88:0/3223843005 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69cc08a210 con 0x7f69e41465e0 2024-01-22T10:13:07.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.935+0000 7f69daffd640 1 --2- 172.21.15.88:0/3223843005 >> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] conn(0x7f69c40734b0 0x7f69c40758d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.935+0000 7f69daffd640 1 -- 172.21.15.88:0/3223843005 --> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69c4075f80 con 0x7f69c40734b0 2024-01-22T10:13:07.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.935+0000 7f69daffd640 1 -- 172.21.15.88:0/3223843005 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69cc08a5c0 con 0x7f69e41465e0 2024-01-22T10:13:07.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.935+0000 7f69e259c640 1 --2- 172.21.15.88:0/3223843005 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f69c406b400 0x7f69c406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.935+0000 7f7fcb7fe640 1 -- 172.21.15.88:0/2270740074 <== osd.7 v2:172.21.15.119:6816/3533070748 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7fd0076120 con 0x7f7fd0073650 2024-01-22T10:13:07.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.935+0000 7fcbab7fe640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcbb006b400 0x7fcbb006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.935+0000 7f4ca57fa640 1 -- 172.21.15.88:0/553313009 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f4c98014560 con 0x7f4ca80bafc0 2024-01-22T10:13:07.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.936+0000 7fc319ffb640 1 -- 172.21.15.88:0/739042432 <== osd.1 v2:172.21.15.88:6808/398753072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc308076120 con 0x7fc308073650 2024-01-22T10:13:07.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.936+0000 7fcbab7fe640 1 -- 172.21.15.88:0/4064419336 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbb8089190 con 0x7fcbbc03f660 2024-01-22T10:13:07.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.936+0000 7f69e2d9d640 1 --2- 172.21.15.88:0/3223843005 >> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] conn(0x7f69c40734b0 0x7f69c40758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.936+0000 7f69e259c640 1 --2- 172.21.15.88:0/3223843005 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f69c406b400 0x7f69c406d8c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f69d4045000 tx=0x7f69d4040000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:07.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.936+0000 7fcbc27fc640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcbb006b400 0x7fcbb006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.936+0000 7f89edd9b640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] conn(0x7f89d8073620 0x7f89d8075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:07.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.936+0000 7fcbc3fff640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] conn(0x7fcba4001650 0x7fcba4003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:07.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.936+0000 7fcbc3fff640 1 -- 172.21.15.88:0/4064419336 --> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcba4006bb0 con 0x7fcba4001650 2024-01-22T10:13:07.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.936+0000 7f89edd9b640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] conn(0x7f89d8073620 0x7f89d8075a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.936+0000 7fcbc37fe640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] conn(0x7fcba4001650 0x7fcba4003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.937+0000 7fcbc27fc640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcbb006b400 0x7fcbb006d8c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0063b0 tx=0x7fcbb4007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.937+0000 7f69e2d9d640 1 --2- 172.21.15.88:0/3223843005 >> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] conn(0x7f69c40734b0 0x7f69c40758d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.937+0000 7f4ca57fa640 1 --2- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f4c8806b400 0x7f4c8806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.937+0000 7fcbc37fe640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] conn(0x7fcba4001650 0x7fcba4003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.937+0000 7f4ca57fa640 1 -- 172.21.15.88:0/553313009 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c98089dd0 con 0x7f4ca80bafc0 2024-01-22T10:13:08.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.937+0000 7f4ca57fa640 1 --2- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] conn(0x7f4c88073620 0x7f4c88075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.937+0000 7f4ca57fa640 1 -- 172.21.15.88:0/553313009 --> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c880760f0 con 0x7f4c88073620 2024-01-22T10:13:08.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.937+0000 7f4ca57fa640 1 -- 172.21.15.88:0/553313009 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c9808c3f0 con 0x7f4ca80bafc0 2024-01-22T10:13:08.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.937+0000 7f4cac9f8640 1 --2- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f4c8806b400 0x7f4c8806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.937+0000 7f89e6ffd640 1 -- 172.21.15.88:0/3873099362 <== osd.6 v2:172.21.15.119:6819/3033097923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f89d80760f0 con 0x7f89d8073620 2024-01-22T10:13:08.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.937+0000 7f4cad1f9640 1 --2- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] conn(0x7f4c88073620 0x7f4c88075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.938+0000 7f69daffd640 1 -- 172.21.15.88:0/3223843005 <== osd.2 v2:172.21.15.88:6824/1293056926 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f69c4075f80 con 0x7f69c40734b0 2024-01-22T10:13:08.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.938+0000 7f4cac9f8640 1 --2- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f4c8806b400 0x7f4c8806d8c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0036000 tx=0x7f4ca0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.938+0000 7f4cad1f9640 1 --2- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] conn(0x7f4c88073620 0x7f4c88075a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.939+0000 7f4ca57fa640 1 -- 172.21.15.88:0/553313009 <== osd.0 v2:172.21.15.88:6800/3205918640 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4c880760f0 con 0x7f4c88073620 2024-01-22T10:13:08.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.939+0000 7fcbab7fe640 1 -- 172.21.15.88:0/4064419336 <== osd.5 v2:172.21.15.119:6808/24229537 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcba4006bb0 con 0x7fcba4001650 2024-01-22T10:13:08.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.958+0000 7f7fe889a640 1 -- 172.21.15.88:0/2270740074 --> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7fe40b8b20 con 0x7f7fd0073650 2024-01-22T10:13:08.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.959+0000 7f7fcb7fe640 1 -- 172.21.15.88:0/2270740074 <== osd.7 v2:172.21.15.119:6816/3533070748 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7fd402caa0 con 0x7f7fd0073650 2024-01-22T10:13:08.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.960+0000 7f7fc97fa640 1 -- 172.21.15.88:0/2270740074 >> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] conn(0x7f7fd0073650 msgr2=0x7f7fd0075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.960+0000 7f7fc97fa640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] conn(0x7f7fd0073650 0x7f7fd0075a70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.960+0000 7f7fc97fa640 1 -- 172.21.15.88:0/2270740074 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7fd006b430 msgr2=0x7f7fd006d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.960+0000 7f7fc97fa640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7fd006b430 0x7f7fd006d8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40b6b80 tx=0x7f7fdc0073e0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.960+0000 7f7fc97fa640 1 -- 172.21.15.88:0/2270740074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe40bb520 msgr2=0x7f7fe40707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.961+0000 7f7fc97fa640 1 --2- 172.21.15.88:0/2270740074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe40bb520 0x7f7fe40707e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800b480 tx=0x7f7fd800b940 comp rx=0 tx=0).stop 2024-01-22T10:13:08.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.961+0000 7f7fe359e640 1 -- 172.21.15.88:0/2270740074 reap_dead start 2024-01-22T10:13:08.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.961+0000 7f7fc97fa640 1 -- 172.21.15.88:0/2270740074 shutdown_connections 2024-01-22T10:13:08.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.961+0000 7f7fc97fa640 1 -- 172.21.15.88:0/2270740074 >> 172.21.15.88:0/2270740074 conn(0x7f7fe409eb20 msgr2=0x7f7fe409a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.961+0000 7f7fc97fa640 1 -- 172.21.15.88:0/2270740074 shutdown_connections 2024-01-22T10:13:08.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.961+0000 7f7fc97fa640 1 -- 172.21.15.88:0/2270740074 wait complete. 2024-01-22T10:13:08.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.962+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 --> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f37f4005c40 con 0x7f37f4001650 2024-01-22T10:13:08.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.963+0000 7f3802ffd640 1 -- 172.21.15.88:0/436899853 <== osd.3 v2:172.21.15.88:6811/1947300237 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f37f4005c40 con 0x7f37f4001650 2024-01-22T10:13:08.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.964+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] conn(0x7f37f4001650 msgr2=0x7f37f4003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.964+0000 7f3814490640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] conn(0x7f37f4001650 0x7f37f4003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.964+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f37f006b380 msgr2=0x7f37f006d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.964+0000 7f3814490640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f37f006b380 0x7f37f006d840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37fc006fd0 tx=0x7f37fc008040 comp rx=0 tx=0).stop 2024-01-22T10:13:08.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.964+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c149ec0 msgr2=0x7f380c0bcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.964+0000 7f3814490640 1 --2- 172.21.15.88:0/436899853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c149ec0 0x7f380c0bcf60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f380801f800 tx=0x7f380801fcc0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.964+0000 7f3812a2d640 1 -- 172.21.15.88:0/436899853 reap_dead start 2024-01-22T10:13:08.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.965+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 shutdown_connections 2024-01-22T10:13:08.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.965+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 >> 172.21.15.88:0/436899853 conn(0x7f380c06bc20 msgr2=0x7f380c147ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.965+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 shutdown_connections 2024-01-22T10:13:08.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.965+0000 7f3814490640 1 -- 172.21.15.88:0/436899853 wait complete. 2024-01-22T10:13:08.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.967+0000 7f6005ed3640 1 -- 172.21.15.88:0/1736385501 --> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5fe0002d30 con 0x7f5fe40735a0 2024-01-22T10:13:08.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.967+0000 7fc30f7fe640 1 -- 172.21.15.88:0/739042432 --> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc324148b50 con 0x7fc308073650 2024-01-22T10:13:08.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.968+0000 7fc319ffb640 1 -- 172.21.15.88:0/739042432 <== osd.1 v2:172.21.15.88:6808/398753072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc308076120 con 0x7fc308073650 2024-01-22T10:13:08.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.968+0000 7f5febfff640 1 -- 172.21.15.88:0/1736385501 <== osd.4 v2:172.21.15.119:6800/4248437697 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5fe0002d30 con 0x7f5fe40735a0 2024-01-22T10:13:08.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7fc30f7fe640 1 -- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] conn(0x7fc308073650 msgr2=0x7fc308075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7fc30f7fe640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] conn(0x7fc308073650 0x7fc308075a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7f5fe9ffb640 1 -- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] conn(0x7f5fe40735a0 msgr2=0x7f5fe40759c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7f5fe9ffb640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] conn(0x7f5fe40735a0 0x7f5fe40759c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7fc30f7fe640 1 -- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc30806b430 msgr2=0x7fc30806d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7fc30f7fe640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc30806b430 0x7fc30806d8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0011e0 tx=0x7fc31c009040 comp rx=0 tx=0).stop 2024-01-22T10:13:08.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7fc30f7fe640 1 -- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc324149070 msgr2=0x7fc32414bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7f5fe9ffb640 1 -- 172.21.15.88:0/1736385501 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5fe406b400 msgr2=0x7f5fe406d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7f5fe9ffb640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5fe406b400 0x7f5fe406d8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8008850 tx=0x7f60000aa000 comp rx=0 tx=0).stop 2024-01-22T10:13:08.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7f5fe9ffb640 1 -- 172.21.15.88:0/1736385501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff803b270 msgr2=0x7f5ff802bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7f5fe9ffb640 1 --2- 172.21.15.88:0/1736385501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ff803b270 0x7f5ff802bce0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400c450 tx=0x7f5ff400c910 comp rx=0 tx=0).stop 2024-01-22T10:13:08.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7f5ffffff640 1 -- 172.21.15.88:0/1736385501 reap_dead start 2024-01-22T10:13:08.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7fc30f7fe640 1 --2- 172.21.15.88:0/739042432 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc324149070 0x7fc32414bd90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc32000eba0 tx=0x7fc32000c490 comp rx=0 tx=0).stop 2024-01-22T10:13:08.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7f89f4db0640 1 -- 172.21.15.88:0/3873099362 --> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f89cc002cb0 con 0x7f89d8073620 2024-01-22T10:13:08.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7fc329c12640 1 -- 172.21.15.88:0/739042432 reap_dead start 2024-01-22T10:13:08.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7f5fe9ffb640 1 -- 172.21.15.88:0/1736385501 shutdown_connections 2024-01-22T10:13:08.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7fc30f7fe640 1 -- 172.21.15.88:0/739042432 shutdown_connections 2024-01-22T10:13:08.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7f5fe9ffb640 1 -- 172.21.15.88:0/1736385501 >> 172.21.15.88:0/1736385501 conn(0x7f5ff80062a0 msgr2=0x7f5ff803e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7fc30f7fe640 1 -- 172.21.15.88:0/739042432 >> 172.21.15.88:0/739042432 conn(0x7fc3240bcab0 msgr2=0x7fc3240bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7fc30f7fe640 1 -- 172.21.15.88:0/739042432 shutdown_connections 2024-01-22T10:13:08.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.969+0000 7f69e359e640 1 -- 172.21.15.88:0/3223843005 --> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f69e40a2b50 con 0x7f69c40734b0 2024-01-22T10:13:08.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.970+0000 7fc30f7fe640 1 -- 172.21.15.88:0/739042432 wait complete. 2024-01-22T10:13:08.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.970+0000 7f5fe9ffb640 1 -- 172.21.15.88:0/1736385501 shutdown_connections 2024-01-22T10:13:08.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.970+0000 7f5fe9ffb640 1 -- 172.21.15.88:0/1736385501 wait complete. 2024-01-22T10:13:08.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.970+0000 7f89e6ffd640 1 -- 172.21.15.88:0/3873099362 <== osd.6 v2:172.21.15.119:6819/3033097923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f89cc002cb0 con 0x7f89d8073620 2024-01-22T10:13:08.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.970+0000 7f69daffd640 1 -- 172.21.15.88:0/3223843005 <== osd.2 v2:172.21.15.88:6824/1293056926 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f69e40a2b50 con 0x7f69c40734b0 2024-01-22T10:13:08.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f69e359e640 1 -- 172.21.15.88:0/3223843005 >> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] conn(0x7f69c40734b0 msgr2=0x7f69c40758d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f69e359e640 1 --2- 172.21.15.88:0/3223843005 >> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] conn(0x7f69c40734b0 0x7f69c40758d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f89e4ff9640 1 -- 172.21.15.88:0/3873099362 >> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] conn(0x7f89d8073620 msgr2=0x7f89d8075a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f89e4ff9640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] conn(0x7f89d8073620 0x7f89d8075a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f89e4ff9640 1 -- 172.21.15.88:0/3873099362 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f89d806b400 msgr2=0x7f89d806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f89e4ff9640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f89d806b400 0x7f89d806d8c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009d60 tx=0x7f89dc009110 comp rx=0 tx=0).stop 2024-01-22T10:13:08.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f89e4ff9640 1 -- 172.21.15.88:0/3873099362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89f00bec20 msgr2=0x7f89f01e8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f89e4ff9640 1 --2- 172.21.15.88:0/3873099362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89f00bec20 0x7f89f01e8e80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f89e8036040 tx=0x7f89e8004a40 comp rx=0 tx=0).stop 2024-01-22T10:13:08.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f89eed9d640 1 -- 172.21.15.88:0/3873099362 reap_dead start 2024-01-22T10:13:08.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f89e4ff9640 1 -- 172.21.15.88:0/3873099362 shutdown_connections 2024-01-22T10:13:08.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f89e4ff9640 1 -- 172.21.15.88:0/3873099362 >> 172.21.15.88:0/3873099362 conn(0x7f89f00c0e20 msgr2=0x7f89f00bff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f69e359e640 1 -- 172.21.15.88:0/3223843005 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f69c406b400 msgr2=0x7f69c406d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.971+0000 7f69e359e640 1 --2- 172.21.15.88:0/3223843005 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f69c406b400 0x7f69c406d8c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f69d4045000 tx=0x7f69d4040000 comp rx=0 tx=0).stop 2024-01-22T10:13:08.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.972+0000 7f69e359e640 1 -- 172.21.15.88:0/3223843005 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69e41465e0 msgr2=0x7f69e41e06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.972+0000 7f69e359e640 1 --2- 172.21.15.88:0/3223843005 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69e41465e0 0x7f69e41e06a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00f820 tx=0x7f69cc00fce0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.972+0000 7f69e2d9d640 1 -- 172.21.15.88:0/3223843005 reap_dead start 2024-01-22T10:13:08.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.972+0000 7f69e359e640 1 -- 172.21.15.88:0/3223843005 shutdown_connections 2024-01-22T10:13:08.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.972+0000 7f69e359e640 1 -- 172.21.15.88:0/3223843005 >> 172.21.15.88:0/3223843005 conn(0x7f69e40bc8e0 msgr2=0x7f69e40b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.972+0000 7f89e4ff9640 1 -- 172.21.15.88:0/3873099362 shutdown_connections 2024-01-22T10:13:08.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.972+0000 7f69e359e640 1 -- 172.21.15.88:0/3223843005 shutdown_connections 2024-01-22T10:13:08.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.972+0000 7f69e359e640 1 -- 172.21.15.88:0/3223843005 wait complete. 2024-01-22T10:13:08.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.972+0000 7f89e4ff9640 1 -- 172.21.15.88:0/3873099362 wait complete. 2024-01-22T10:13:08.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.973+0000 7f4cad9fa640 1 -- 172.21.15.88:0/553313009 --> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ca80ba9c0 con 0x7f4c88073620 2024-01-22T10:13:08.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.973+0000 7f4ca57fa640 1 -- 172.21.15.88:0/553313009 <== osd.0 v2:172.21.15.88:6800/3205918640 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4c9000bac0 con 0x7f4c88073620 2024-01-22T10:13:08.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.974+0000 7fcbc3fff640 1 -- 172.21.15.88:0/4064419336 --> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcba4005c40 con 0x7fcba4001650 2024-01-22T10:13:08.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.974+0000 7f4cad9fa640 1 -- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] conn(0x7f4c88073620 msgr2=0x7f4c88075a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.974+0000 7f4cad9fa640 1 --2- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] conn(0x7f4c88073620 0x7f4c88075a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.974+0000 7fcbab7fe640 1 -- 172.21.15.88:0/4064419336 <== osd.5 v2:172.21.15.119:6808/24229537 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcba4005c40 con 0x7fcba4001650 2024-01-22T10:13:08.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7f4cad9fa640 1 -- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f4c8806b400 msgr2=0x7f4c8806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7f4cad9fa640 1 --2- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f4c8806b400 0x7f4c8806d8c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0036000 tx=0x7f4ca0008030 comp rx=0 tx=0).stop 2024-01-22T10:13:08.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7f4cad9fa640 1 -- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca80bafc0 msgr2=0x7f4ca8144af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7f4cad9fa640 1 --2- 172.21.15.88:0/553313009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca80bafc0 0x7f4ca8144af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800eed0 tx=0x7f4c9800b480 comp rx=0 tx=0).stop 2024-01-22T10:13:08.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7f4cad1f9640 1 -- 172.21.15.88:0/553313009 reap_dead start 2024-01-22T10:13:08.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7f4cad9fa640 1 -- 172.21.15.88:0/553313009 shutdown_connections 2024-01-22T10:13:08.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7f4cad9fa640 1 -- 172.21.15.88:0/553313009 >> 172.21.15.88:0/553313009 conn(0x7f4ca809e6d0 msgr2=0x7f4ca809fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7fcbc3fff640 1 -- 172.21.15.88:0/4064419336 >> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] conn(0x7fcba4001650 msgr2=0x7fcba4003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7fcbc3fff640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] conn(0x7fcba4001650 0x7fcba4003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7fcbc3fff640 1 -- 172.21.15.88:0/4064419336 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcbb006b400 msgr2=0x7fcbb006d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7fcbc3fff640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcbb006b400 0x7fcbb006d8c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0063b0 tx=0x7fcbb4007e30 comp rx=0 tx=0).stop 2024-01-22T10:13:08.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7fcbc3fff640 1 -- 172.21.15.88:0/4064419336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbbc03f660 msgr2=0x7fcbbc0cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7fcbc3fff640 1 --2- 172.21.15.88:0/4064419336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbbc03f660 0x7fcbbc0cc4c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800c580 tx=0x7fcbb800ca40 comp rx=0 tx=0).stop 2024-01-22T10:13:08.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7fcbc37fe640 1 -- 172.21.15.88:0/4064419336 reap_dead start 2024-01-22T10:13:08.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.975+0000 7f4cad9fa640 1 -- 172.21.15.88:0/553313009 shutdown_connections 2024-01-22T10:13:08.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.976+0000 7fcbc3fff640 1 -- 172.21.15.88:0/4064419336 shutdown_connections 2024-01-22T10:13:08.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.976+0000 7fcbc3fff640 1 -- 172.21.15.88:0/4064419336 >> 172.21.15.88:0/4064419336 conn(0x7fcbbc047020 msgr2=0x7fcbbc03b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.976+0000 7f4cad9fa640 1 -- 172.21.15.88:0/553313009 wait complete. 2024-01-22T10:13:08.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.976+0000 7fcbc3fff640 1 -- 172.21.15.88:0/4064419336 shutdown_connections 2024-01-22T10:13:08.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:07.976+0000 7fcbc3fff640 1 -- 172.21.15.88:0/4064419336 wait complete. 2024-01-22T10:13:08.031 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-01-22T10:13:08.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-22T10:13:08.032 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-01-22T10:13:08.032 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-22T10:13:08.033 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-01-22T10:13:08.033 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-22T10:13:08.034 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-01-22T10:13:08.034 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-22T10:13:08.035 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-01-22T10:13:08.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-22T10:13:08.036 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-01-22T10:13:08.036 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-22T10:13:08.037 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-01-22T10:13:08.037 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-22T10:13:08.038 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-01-22T10:13:08.039 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-22T10:13:08.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.257+0000 7f6b860da640 1 Processor -- start 2024-01-22T10:13:08.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.257+0000 7f6b860da640 1 -- start start 2024-01-22T10:13:08.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.257+0000 7f7ef865c640 1 Processor -- start 2024-01-22T10:13:08.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.258+0000 7f6b860da640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800b8ff0 0x7f6b800b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.258+0000 7f6b860da640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b800b4f00 con 0x7f6b8006b1e0 2024-01-22T10:13:08.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.258+0000 7f6b860da640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b800b9450 con 0x7f6b800b7a70 2024-01-22T10:13:08.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.258+0000 7f6b860da640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80148820 con 0x7f6b800b8ff0 2024-01-22T10:13:08.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.258+0000 7f91e8b0f640 1 Processor -- start 2024-01-22T10:13:08.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.257+0000 7f7ef865c640 1 -- start start 2024-01-22T10:13:08.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.258+0000 7f57301dc640 1 Processor -- start 2024-01-22T10:13:08.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f7ef865c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ef00b6b60 0x7f7ef00b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f7ef865c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef00b3510 0x7f7ef00b9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f7ef865c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef00b7e30 con 0x7f7ef014f900 2024-01-22T10:13:08.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f7ef865c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef00b43c0 con 0x7f7ef00b6b60 2024-01-22T10:13:08.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f7ef865c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef014d390 con 0x7f7ef00b3510 2024-01-22T10:13:08.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.258+0000 7f6b7f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6b8006b1e0 0x7f6b80148110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41924/0 (socket says 172.21.15.88:41924) 2024-01-22T10:13:08.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.258+0000 7f6b7f7fe640 1 -- 172.21.15.88:0/2051019464 learned_addr learned my addr 172.21.15.88:0/2051019464 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:08.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.258+0000 7f6b7effd640 1 --2- 172.21.15.88:0/2051019464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800b8ff0 0x7f6b800b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519528930 0 0) 0x7f6b800b9450 con 0x7f6b800b7a70 2024-01-22T10:13:08.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b68003520 con 0x7f6b800b7a70 2024-01-22T10:13:08.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f7ef5bf7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef00b3510 0x7f7ef00b9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f7ef5bf7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef00b3510 0x7f7ef00b9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49784/0 (socket says 172.21.15.88:49784) 2024-01-22T10:13:08.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f7ef5bf7640 1 -- 172.21.15.88:0/3492496933 learned_addr learned my addr 172.21.15.88:0/3492496933 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:08.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 533842857 0 0) 0x7f6b68003520 con 0x7f6b800b7a70 2024-01-22T10:13:08.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800b8ff0 msgr2=0x7f6b800b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:08.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f6b7e7fc640 1 --2- 172.21.15.88:0/2051019464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800b8ff0 0x7f6b800b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 >> v1:172.21.15.88:6789/0 conn(0x7f6b8006b1e0 legacy=0x7f6b80148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b800ba340 con 0x7f6b800b7a70 2024-01-22T10:13:08.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 <== mon.1 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f6b780019f0 con 0x7f6b800b7a70 2024-01-22T10:13:08.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f57301dc640 1 -- start start 2024-01-22T10:13:08.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 >> v1:172.21.15.119:6789/0 conn(0x7f6b800b7a70 legacy=0x7f6b80153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7fad54fcf640 1 Processor -- start 2024-01-22T10:13:08.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7fad54fcf640 1 -- start start 2024-01-22T10:13:08.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f7ef5bf7640 1 -- 172.21.15.88:0/3492496933 >> v2:172.21.15.88:3300/0 conn(0x7f7ef00b6b60 msgr2=0x7f7ef00b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:08.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f7ef5bf7640 1 --2- 172.21.15.88:0/3492496933 >> v2:172.21.15.88:3300/0 conn(0x7f7ef00b6b60 0x7f7ef00b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f7ef5bf7640 1 -- 172.21.15.88:0/3492496933 >> v1:172.21.15.88:6789/0 conn(0x7f7ef014f900 legacy=0x7f7ef00b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:08.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f7ef5bf7640 1 -- 172.21.15.88:0/3492496933 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef00b6f40 con 0x7f7ef00b3510 2024-01-22T10:13:08.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f57301dc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f572003ce30 0x7f57200d5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f57301dc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57200d8990 con 0x7f572003d2a0 2024-01-22T10:13:08.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f57301dc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57200d9510 con 0x7f5720007410 2024-01-22T10:13:08.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f57301dc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572003fe80 con 0x7f572003ce30 2024-01-22T10:13:08.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f91e8b0f640 1 -- start start 2024-01-22T10:13:08.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f91e8b0f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f91e40b25b0 0x7f91e4153250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f572d777640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f572003ce30 0x7f57200d5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f572d777640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f572003ce30 0x7f57200d5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:33832/0 (socket says 172.21.15.88:33832) 2024-01-22T10:13:08.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f572d777640 1 -- 172.21.15.88:0/2297124159 learned_addr learned my addr 172.21.15.88:0/2297124159 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:08.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f91e8b0f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f91e4153790 0x7f91e415a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f91e8b0f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e40b6fa0 con 0x7f91e40b6bc0 2024-01-22T10:13:08.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f91e8b0f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e40bd930 con 0x7f91e40b25b0 2024-01-22T10:13:08.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f91e8b0f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e40b3350 con 0x7f91e4153790 2024-01-22T10:13:08.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.259+0000 7f6b7e7fc640 1 --2- 172.21.15.88:0/2051019464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800b8ff0 0x7f6b68003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7e7fc640 1 --2- 172.21.15.88:0/2051019464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b68003f40 0x7f6b680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7e7fc640 1 --2- 172.21.15.88:0/2051019464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b68004d00 0x7f6b68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7f7fe640 1 --2- 172.21.15.88:0/2051019464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800b8ff0 0x7f6b68003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7effd640 1 --2- 172.21.15.88:0/2051019464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b68003f40 0x7f6b680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80148820 con 0x7f6b68004d00 2024-01-22T10:13:08.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6800bb20 con 0x7f6b68003f40 2024-01-22T10:13:08.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6800bce0 con 0x7f6b800b8ff0 2024-01-22T10:13:08.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7ffff640 1 --2- 172.21.15.88:0/2051019464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b68004d00 0x7f6b68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6dd7a97640 1 Processor -- start 2024-01-22T10:13:08.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6dd7a97640 1 -- start start 2024-01-22T10:13:08.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7f7fe640 1 -- 172.21.15.88:0/2051019464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b68003f40 msgr2=0x7f6b680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:08.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7f7fe640 1 --2- 172.21.15.88:0/2051019464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b68003f40 0x7f6b680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7f7fe640 1 -- 172.21.15.88:0/2051019464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b68004d00 msgr2=0x7f6b68005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:08.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7f7fe640 1 --2- 172.21.15.88:0/2051019464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b68004d00 0x7f6b68005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f6b7f7fe640 1 -- 172.21.15.88:0/2051019464 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68003520 con 0x7f6b800b8ff0 2024-01-22T10:13:08.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f91e2d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f91e4153790 0x7f91e415a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7fad54fcf640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad48007100 0x7fad4803c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7f91e259c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f91e40b6bc0 0x7f91e40bd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41940/0 (socket says 172.21.15.88:41940) 2024-01-22T10:13:08.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7f91e259c640 1 -- 172.21.15.88:0/1525431311 learned_addr learned my addr 172.21.15.88:0/1525431311 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:08.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f572d777640 1 -- 172.21.15.88:0/2297124159 >> v1:172.21.15.119:6789/0 conn(0x7f5720007410 legacy=0x7f572003e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f572d777640 1 -- 172.21.15.88:0/2297124159 >> v1:172.21.15.88:6789/0 conn(0x7f572003d2a0 legacy=0x7f57200dfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7f572d777640 1 -- 172.21.15.88:0/2297124159 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572003e790 con 0x7f572003ce30 2024-01-22T10:13:08.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.260+0000 7fb4f64b2640 1 Processor -- start 2024-01-22T10:13:08.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7fb4f64b2640 1 -- start start 2024-01-22T10:13:08.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7f1d2a600640 1 Processor -- start 2024-01-22T10:13:08.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7f7ef5bf7640 1 --2- 172.21.15.88:0/3492496933 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef00b3510 0x7f7ef00b9a50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009e50 tx=0x7f7eec02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cac2a7de3842814 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7fad54fcf640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4803aee0 con 0x7fad4803a390 2024-01-22T10:13:08.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7fad54fcf640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4803a920 con 0x7fad480d8a30 2024-01-22T10:13:08.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7fad54fcf640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4803ac00 con 0x7fad48007100 2024-01-22T10:13:08.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7fad4effd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fad480d8a30 0x7fad4803e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.88:47536/0 (socket says 172.21.15.88:47536) 2024-01-22T10:13:08.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7fad4effd640 1 -- 172.21.15.88:0/1598024 learned_addr learned my addr 172.21.15.88:0/1598024 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:08.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7f1d2a600640 1 -- start start 2024-01-22T10:13:08.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332460429 0 0) 0x7fad4803a920 con 0x7fad480d8a30 2024-01-22T10:13:08.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad40003520 con 0x7fad480d8a30 2024-01-22T10:13:08.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7f7ef53f6640 1 -- 172.21.15.88:0/3492496933 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec02ca70 con 0x7f7ef00b3510 2024-01-22T10:13:08.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7f7ef53f6640 1 -- 172.21.15.88:0/3492496933 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec02cbd0 con 0x7f7ef00b3510 2024-01-22T10:13:08.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7f7ef53f6640 1 -- 172.21.15.88:0/3492496933 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0343f0 con 0x7f7ef00b3510 2024-01-22T10:13:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7f91e1d9b640 1 --2- 172.21.15.88:0/1525431311 >> v2:172.21.15.88:3300/0 conn(0x7f91e40b25b0 0x7f91e4153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7f91e159a640 1 -- 172.21.15.88:0/1525431311 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010281852 0 0) 0x7f91e40b6fa0 con 0x7f91e40b6bc0 2024-01-22T10:13:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7f91e159a640 1 -- 172.21.15.88:0/1525431311 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91cc003520 con 0x7f91e40b6bc0 2024-01-22T10:13:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.261+0000 7fad4f7fe640 1 --2- 172.21.15.88:0/1598024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad48007100 0x7fad4803c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 232068543 0 0) 0x7fad40003520 con 0x7fad480d8a30 2024-01-22T10:13:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad48007100 msgr2=0x7fad4803c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f6b7f7fe640 1 --2- 172.21.15.88:0/2051019464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800b8ff0 0x7f6b68003970 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6b74007fd0 tx=0x7f6b680057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f151e174a82216c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 --2- 172.21.15.88:0/1598024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad48007100 0x7fad4803c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 >> v1:172.21.15.88:6789/0 conn(0x7fad4803a390 legacy=0x7fad480cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fb4f64b2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 0x7fb4f00bc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fb4f64b2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb4f00bd550 0x7fb4f0153690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4803e140 con 0x7fad480d8a30 2024-01-22T10:13:08.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 <== mon.1 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fad3c001670 con 0x7fad480d8a30 2024-01-22T10:13:08.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f91e2d9d640 1 -- 172.21.15.88:0/1525431311 >> v2:172.21.15.88:3300/0 conn(0x7f91e40b25b0 msgr2=0x7f91e4153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:08.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f91e2d9d640 1 --2- 172.21.15.88:0/1525431311 >> v2:172.21.15.88:3300/0 conn(0x7f91e40b25b0 0x7f91e4153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f91e2d9d640 1 -- 172.21.15.88:0/1525431311 >> v1:172.21.15.88:6789/0 conn(0x7f91e40b6bc0 legacy=0x7f91e40bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f572d777640 1 --2- 172.21.15.88:0/2297124159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f572003ce30 0x7f57200d5440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5718009870 tx=0x7f571802ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fd6bd9fd7204dd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 >> v1:172.21.15.119:6789/0 conn(0x7fad480d8a30 legacy=0x7fad4803e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 --2- 172.21.15.88:0/1598024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad40003970 0x7fad40003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 --2- 172.21.15.88:0/1598024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad400047c0 0x7fad40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 --2- 172.21.15.88:0/1598024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad40005180 0x7fad4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4803ac00 con 0x7fad400047c0 2024-01-22T10:13:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4000c050 con 0x7fad40003970 2024-01-22T10:13:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4000c1c0 con 0x7fad40005180 2024-01-22T10:13:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4effd640 1 --2- 172.21.15.88:0/1598024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad400047c0 0x7fad40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4f7fe640 1 --2- 172.21.15.88:0/1598024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad48007100 0x7fad4803c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7403e040 con 0x7f6b800b8ff0 2024-01-22T10:13:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b74004aa0 con 0x7f6b800b8ff0 2024-01-22T10:13:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f6b7e7fc640 1 -- 172.21.15.88:0/2051019464 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74004e50 con 0x7f6b800b8ff0 2024-01-22T10:13:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f91e2d9d640 1 -- 172.21.15.88:0/1525431311 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40b3630 con 0x7f91e4153790 2024-01-22T10:13:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f91e1d9b640 1 --2- 172.21.15.88:0/1525431311 >> v2:172.21.15.88:3300/0 conn(0x7f91e40b25b0 0x7f91e4153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f6dd7a97640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6dd00b7530 0x7f6dd0147e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f6dd5833640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6dd006d690 0x7f6dd00b8d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41964/0 (socket says 172.21.15.88:41964) 2024-01-22T10:13:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f6dd5833640 1 -- 172.21.15.88:0/3411079505 learned_addr learned my addr 172.21.15.88:0/3411079505 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fb4f64b2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f00722d0 con 0x7fb4f0153bd0 2024-01-22T10:13:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fb4f64b2640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f00bcaf0 con 0x7fb4f00bd550 2024-01-22T10:13:08.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fb4f64b2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f006bf00 con 0x7fb4f00bc1d0 2024-01-22T10:13:08.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fb4ef7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb4f00bd550 0x7fb4f0153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fb4effff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 0x7fb4f00bc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f1d2a600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1d240b8a30 0x7f1d240b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f1d2a600640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d240b1dd0 0x7f1d24152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f1d2a600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d24071af0 0x7f1d24071f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f1d2a600640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d240b33c0 con 0x7f1d240b1dd0 2024-01-22T10:13:08.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f1d2a600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d240b22d0 con 0x7f1d240b8a30 2024-01-22T10:13:08.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f1d2a600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d240b25b0 con 0x7f1d24071af0 2024-01-22T10:13:08.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f6dd7a97640 1 -- 172.21.15.88:0/3411079505 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd00b9eb0 con 0x7f6dd006d690 2024-01-22T10:13:08.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f7ef865c640 1 -- 172.21.15.88:0/3492496933 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef00b3510 msgr2=0x7f7ef00b9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f7ef865c640 1 --2- 172.21.15.88:0/3492496933 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef00b3510 0x7f7ef00b9a50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009e50 tx=0x7f7eec02bed0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4f7fe640 1 --2- 172.21.15.88:0/1598024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad40003970 0x7fad40003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4effd640 1 -- 172.21.15.88:0/1598024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad40005180 msgr2=0x7fad4000b980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-22T10:13:08.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fb4effff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 0x7fb4f00bc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49794/0 (socket says 172.21.15.88:49794) 2024-01-22T10:13:08.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fb4effff640 1 -- 172.21.15.88:0/3202112373 learned_addr learned my addr 172.21.15.88:0/3202112373 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:08.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4effd640 1 --2- 172.21.15.88:0/1598024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad40005180 0x7fad4000b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4effd640 1 -- 172.21.15.88:0/1598024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad40003970 msgr2=0x7fad40003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:08.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4effd640 1 --2- 172.21.15.88:0/1598024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad40003970 0x7fad40003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7fad4effd640 1 -- 172.21.15.88:0/1598024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4803e140 con 0x7fad400047c0 2024-01-22T10:13:08.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f6dd7a97640 1 -- 172.21.15.88:0/3411079505 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd00b9430 con 0x7f6dd00b79c0 2024-01-22T10:13:08.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f6dd7a97640 1 -- 172.21.15.88:0/3411079505 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd00729d0 con 0x7f6dd00b7530 2024-01-22T10:13:08.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.262+0000 7f6dd5032640 1 --2- 172.21.15.88:0/3411079505 >> v2:172.21.15.119:3300/0 conn(0x7f6dd00b7530 0x7f6dd0147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f6dd4831640 1 -- 172.21.15.88:0/3411079505 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105541378 0 0) 0x7f6dd00b9eb0 con 0x7f6dd006d690 2024-01-22T10:13:08.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f6dd4831640 1 -- 172.21.15.88:0/3411079505 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dbc003520 con 0x7f6dd006d690 2024-01-22T10:13:08.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f1d28b9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d24071af0 0x7f1d24071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f7ef865c640 1 -- 172.21.15.88:0/3492496933 shutdown_connections 2024-01-22T10:13:08.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f7ef865c640 1 --2- 172.21.15.88:0/3492496933 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef00b3510 0x7f7ef00b9a50 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009e50 tx=0x7f7eec02bed0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f7ef865c640 1 --2- 172.21.15.88:0/3492496933 >> v2:172.21.15.88:3300/0 conn(0x7f7ef00b6b60 0x7f7ef00b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f7ef865c640 1 -- 172.21.15.88:0/3492496933 >> 172.21.15.88:0/3492496933 conn(0x7f7ef006ab10 msgr2=0x7f7ef006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f1d28b9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d24071af0 0x7f1d24071f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49814/0 (socket says 172.21.15.88:49814) 2024-01-22T10:13:08.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f1d28b9d640 1 -- 172.21.15.88:0/2724939075 learned_addr learned my addr 172.21.15.88:0/2724939075 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:08.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f7ef865c640 1 -- 172.21.15.88:0/3492496933 shutdown_connections 2024-01-22T10:13:08.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f7ef865c640 1 -- 172.21.15.88:0/3492496933 wait complete. 2024-01-22T10:13:08.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f1d237fe640 1 --2- 172.21.15.88:0/2724939075 >> v2:172.21.15.88:3300/0 conn(0x7f1d240b1dd0 0x7f1d24152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f1d23fff640 1 --2- 172.21.15.88:0/2724939075 >> v2:172.21.15.119:3300/0 conn(0x7f1d240b8a30 0x7f1d240b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f91e2d9d640 1 --2- 172.21.15.88:0/1525431311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e4153790 0x7f91e415a320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f91e4150a70 tx=0x7f91d802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fff254a0fd5eb236 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f572cf76640 1 -- 172.21.15.88:0/2297124159 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571802f860 con 0x7f572003ce30 2024-01-22T10:13:08.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f572cf76640 1 -- 172.21.15.88:0/2297124159 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571802f9c0 con 0x7f572003ce30 2024-01-22T10:13:08.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f572cf76640 1 -- 172.21.15.88:0/2297124159 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571802fd50 con 0x7f572003ce30 2024-01-22T10:13:08.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f6dd5032640 1 -- 172.21.15.88:0/3411079505 >> v1:172.21.15.119:6789/0 conn(0x7f6dd00b79c0 legacy=0x7f6dd014bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f6dd5032640 1 -- 172.21.15.88:0/3411079505 >> v1:172.21.15.88:6789/0 conn(0x7f6dd006d690 legacy=0x7f6dd00b8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f6dd5032640 1 -- 172.21.15.88:0/3411079505 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd00b9b80 con 0x7f6dd00b7530 2024-01-22T10:13:08.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7fad4effd640 1 --2- 172.21.15.88:0/1598024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad400047c0 0x7fad40004c40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00c210 tx=0x7fad400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675bec4f6a80afbf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f6b860da640 1 -- 172.21.15.88:0/2051019464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800b8ff0 msgr2=0x7f6b68003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f6b860da640 1 --2- 172.21.15.88:0/2051019464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800b8ff0 0x7f6b68003970 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6b74007fd0 tx=0x7f6b680057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f6b7ffff640 1 -- 172.21.15.88:0/2051019464 reap_dead start 2024-01-22T10:13:08.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f6b860da640 1 -- 172.21.15.88:0/2051019464 shutdown_connections 2024-01-22T10:13:08.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f6b860da640 1 -- 172.21.15.88:0/2051019464 >> 172.21.15.88:0/2051019464 conn(0x7f6b8006a6f0 msgr2=0x7f6b8006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f91e159a640 1 -- 172.21.15.88:0/1525431311 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8030610 con 0x7f91e4153790 2024-01-22T10:13:08.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f91e159a640 1 -- 172.21.15.88:0/1525431311 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d8030770 con 0x7f91e4153790 2024-01-22T10:13:08.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f91e159a640 1 -- 172.21.15.88:0/1525431311 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8030610 con 0x7f91e4153790 2024-01-22T10:13:08.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f1d237fe640 1 -- 172.21.15.88:0/2724939075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d24071af0 msgr2=0x7f1d24071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:08.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f1d237fe640 1 --2- 172.21.15.88:0/2724939075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d24071af0 0x7f1d24071f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f1d237fe640 1 -- 172.21.15.88:0/2724939075 >> v2:172.21.15.119:3300/0 conn(0x7f1d240b8a30 msgr2=0x7f1d240b91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:08.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f1d237fe640 1 --2- 172.21.15.88:0/2724939075 >> v2:172.21.15.119:3300/0 conn(0x7f1d240b8a30 0x7f1d240b91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7f1d237fe640 1 -- 172.21.15.88:0/2724939075 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2406d0a0 con 0x7f1d240b1dd0 2024-01-22T10:13:08.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f6b860da640 1 -- 172.21.15.88:0/2051019464 shutdown_connections 2024-01-22T10:13:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7fb4effff640 1 -- 172.21.15.88:0/3202112373 >> v2:172.21.15.88:3300/0 conn(0x7fb4f00bd550 msgr2=0x7fb4f0153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7fb4effff640 1 --2- 172.21.15.88:0/3202112373 >> v2:172.21.15.88:3300/0 conn(0x7fb4f00bd550 0x7fb4f0153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7fb4effff640 1 -- 172.21.15.88:0/3202112373 >> v1:172.21.15.119:6789/0 conn(0x7fb4f0153bd0 legacy=0x7fb4f00b89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.263+0000 7fb4effff640 1 -- 172.21.15.88:0/3202112373 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f00bb970 con 0x7fb4f00bc1d0 2024-01-22T10:13:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f57301dc640 1 -- 172.21.15.88:0/2297124159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f572003ce30 msgr2=0x7f57200d5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f57301dc640 1 --2- 172.21.15.88:0/2297124159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f572003ce30 0x7f57200d5440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5718009870 tx=0x7f571802ba40 comp rx=0 tx=0).stop 2024-01-22T10:13:08.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7fb4effff640 1 --2- 172.21.15.88:0/3202112373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 0x7fb4f00bc5b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009870 tx=0x7fb4e002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d45d7cc539e28bea server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f6dd5032640 1 --2- 172.21.15.88:0/3411079505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd00b7530 0x7f6dd0147e70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009720 tx=0x7f6dcc02b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5c78efe09de06a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f57301dc640 1 -- 172.21.15.88:0/2297124159 shutdown_connections 2024-01-22T10:13:08.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f57301dc640 1 --2- 172.21.15.88:0/2297124159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f572003ce30 0x7f57200d5440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f57301dc640 1 -- 172.21.15.88:0/2297124159 >> 172.21.15.88:0/2297124159 conn(0x7f5720043220 msgr2=0x7f5720043600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c02cb00 con 0x7fad400047c0 2024-01-22T10:13:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7fad4e7fc640 1 -- 172.21.15.88:0/1598024 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c02cc80 con 0x7fad400047c0 2024-01-22T10:13:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f57301dc640 1 -- 172.21.15.88:0/2297124159 shutdown_connections 2024-01-22T10:13:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7fb4eeffd640 1 -- 172.21.15.88:0/3202112373 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0031640 con 0x7fb4f00bc1d0 2024-01-22T10:13:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f91e8b0f640 1 -- 172.21.15.88:0/1525431311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e4153790 msgr2=0x7f91e415a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7fb4eeffd640 1 -- 172.21.15.88:0/3202112373 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e00317a0 con 0x7fb4f00bc1d0 2024-01-22T10:13:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f91e8b0f640 1 --2- 172.21.15.88:0/1525431311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e4153790 0x7f91e415a320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f91e4150a70 tx=0x7f91d802b960 comp rx=0 tx=0).stop 2024-01-22T10:13:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f1d237fe640 1 --2- 172.21.15.88:0/2724939075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d240b1dd0 0x7f1d24152ea0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d240726e0 tx=0x7f1d1802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6feefa7fa6a953 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f7ef865c640 1 Processor -- start 2024-01-22T10:13:08.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f7ef865c640 1 -- start start 2024-01-22T10:13:08.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7fb4eeffd640 1 -- 172.21.15.88:0/3202112373 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0031b30 con 0x7fb4f00bc1d0 2024-01-22T10:13:08.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f91e8b0f640 1 -- 172.21.15.88:0/1525431311 shutdown_connections 2024-01-22T10:13:08.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f91e8b0f640 1 --2- 172.21.15.88:0/1525431311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e4153790 0x7f91e415a320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f91e8b0f640 1 --2- 172.21.15.88:0/1525431311 >> v2:172.21.15.88:3300/0 conn(0x7f91e40b25b0 0x7f91e4153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f91e8b0f640 1 -- 172.21.15.88:0/1525431311 >> 172.21.15.88:0/1525431311 conn(0x7f91e406acf0 msgr2=0x7f91e40bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f1d22ffd640 1 -- 172.21.15.88:0/2724939075 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1802e070 con 0x7f1d240b1dd0 2024-01-22T10:13:08.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f91e8b0f640 1 -- 172.21.15.88:0/1525431311 shutdown_connections 2024-01-22T10:13:08.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f1d22ffd640 1 -- 172.21.15.88:0/2724939075 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d180315a0 con 0x7f1d240b1dd0 2024-01-22T10:13:08.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f1d22ffd640 1 -- 172.21.15.88:0/2724939075 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18031930 con 0x7f1d240b1dd0 2024-01-22T10:13:08.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f91e8b0f640 1 -- 172.21.15.88:0/1525431311 wait complete. 2024-01-22T10:13:08.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f6dd4831640 1 -- 172.21.15.88:0/3411079505 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc030710 con 0x7f6dd00b7530 2024-01-22T10:13:08.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f6dd4831640 1 -- 172.21.15.88:0/3411079505 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc02e050 con 0x7f6dd00b7530 2024-01-22T10:13:08.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f6dd4831640 1 -- 172.21.15.88:0/3411079505 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc030a90 con 0x7f6dd00b7530 2024-01-22T10:13:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7fad54fcf640 1 -- 172.21.15.88:0/1598024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad400047c0 msgr2=0x7fad40004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7fad54fcf640 1 --2- 172.21.15.88:0/1598024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad400047c0 0x7fad40004c40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00c210 tx=0x7fad400057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7fad4ffff640 1 -- 172.21.15.88:0/1598024 reap_dead start 2024-01-22T10:13:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f7ef865c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ef00b6b60 0x7f7ef0129460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f7ef865c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ef014f900 0x7f7ef01e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f7ef865c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef01ee470 0x7f7ef01e8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f6b860da640 1 -- 172.21.15.88:0/2051019464 wait complete. 2024-01-22T10:13:08.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f6b860da640 1 Processor -- start 2024-01-22T10:13:08.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f7ef865c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef01299a0 con 0x7f7ef00b6b60 2024-01-22T10:13:08.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f7ef865c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef012a960 con 0x7f7ef014f900 2024-01-22T10:13:08.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7f7ef865c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef01eeef0 con 0x7f7ef01ee470 2024-01-22T10:13:08.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3202112373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 msgr2=0x7fb4f00bc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.265+0000 7fb4f64b2640 1 --2- 172.21.15.88:0/3202112373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 0x7fb4f00bc5b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009870 tx=0x7fb4e002b8f0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7fad54fcf640 1 -- 172.21.15.88:0/1598024 shutdown_connections 2024-01-22T10:13:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7fad54fcf640 1 -- 172.21.15.88:0/1598024 >> 172.21.15.88:0/1598024 conn(0x7fad4803ee10 msgr2=0x7fad4803f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f7ef63f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ef00b6b60 0x7f7ef0129460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f7ef63f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ef00b6b60 0x7f7ef0129460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43738/0 (socket says 172.21.15.88:43738) 2024-01-22T10:13:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f7ef63f8640 1 -- 172.21.15.88:0/27856805 learned_addr learned my addr 172.21.15.88:0/27856805 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f7ef6bf9640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef01ee470 0x7f7ef01e8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f7ef5bf7640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ef014f900 0x7f7ef01e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f6dd7a97640 1 -- 172.21.15.88:0/3411079505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd00b7530 msgr2=0x7f6dd0147e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f6dd7a97640 1 --2- 172.21.15.88:0/3411079505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd00b7530 0x7f6dd0147e70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009720 tx=0x7f6dcc02b6a0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f1d2a600640 1 -- 172.21.15.88:0/2724939075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d240b1dd0 msgr2=0x7f1d24152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f1d2a600640 1 --2- 172.21.15.88:0/2724939075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d240b1dd0 0x7f1d24152ea0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d240726e0 tx=0x7f1d1802b840 comp rx=0 tx=0).stop 2024-01-22T10:13:08.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.264+0000 7f57301dc640 1 -- 172.21.15.88:0/2297124159 wait complete. 2024-01-22T10:13:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f1d2a600640 1 -- 172.21.15.88:0/2724939075 shutdown_connections 2024-01-22T10:13:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f1d2a600640 1 --2- 172.21.15.88:0/2724939075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d240b1dd0 0x7f1d24152ea0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f1d2a600640 1 --2- 172.21.15.88:0/2724939075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d24071af0 0x7f1d24071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f1d2a600640 1 --2- 172.21.15.88:0/2724939075 >> v2:172.21.15.119:3300/0 conn(0x7f1d240b8a30 0x7f1d240b91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f57301dc640 1 Processor -- start 2024-01-22T10:13:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f1d2a600640 1 -- 172.21.15.88:0/2724939075 >> 172.21.15.88:0/2724939075 conn(0x7f1d240bcdf0 msgr2=0x7f1d240bd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f6b860da640 1 -- start start 2024-01-22T10:13:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7fad54fcf640 1 -- 172.21.15.88:0/1598024 shutdown_connections 2024-01-22T10:13:08.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7fad54fcf640 1 -- 172.21.15.88:0/1598024 wait complete. 2024-01-22T10:13:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f7ef6bf9640 1 -- 172.21.15.88:0/27856805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ef014f900 msgr2=0x7f7ef01e7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f7ef6bf9640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ef014f900 0x7f7ef01e7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f7ef6bf9640 1 -- 172.21.15.88:0/27856805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ef00b6b60 msgr2=0x7f7ef0129460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f7ef6bf9640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ef00b6b60 0x7f7ef0129460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f7ef6bf9640 1 -- 172.21.15.88:0/27856805 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec009b30 con 0x7f7ef01ee470 2024-01-22T10:13:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f6dd7a97640 1 -- 172.21.15.88:0/3411079505 shutdown_connections 2024-01-22T10:13:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f6dd7a97640 1 --2- 172.21.15.88:0/3411079505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd00b7530 0x7f6dd0147e70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f6dd7a97640 1 -- 172.21.15.88:0/3411079505 >> 172.21.15.88:0/3411079505 conn(0x7f6dd006ab10 msgr2=0x7f6dd006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f6b860da640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b800b8ff0 0x7f6b80141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f7ef6bf9640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef01ee470 0x7f7ef01e8230 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000c410 tx=0x7f7ee000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3202112373 shutdown_connections 2024-01-22T10:13:08.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7fb4f64b2640 1 --2- 172.21.15.88:0/3202112373 >> v2:172.21.15.88:3300/0 conn(0x7fb4f00bd550 0x7fb4f0153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7fb4f64b2640 1 --2- 172.21.15.88:0/3202112373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 0x7fb4f00bc5b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3202112373 >> 172.21.15.88:0/3202112373 conn(0x7fb4f00a2a30 msgr2=0x7fb4f00a2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f1d2a600640 1 -- 172.21.15.88:0/2724939075 shutdown_connections 2024-01-22T10:13:08.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f1d2a600640 1 -- 172.21.15.88:0/2724939075 wait complete. 2024-01-22T10:13:08.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f6dd7a97640 1 -- 172.21.15.88:0/3411079505 shutdown_connections 2024-01-22T10:13:08.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f6b860da640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800bbd80 0x7f6b801dfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3202112373 shutdown_connections 2024-01-22T10:13:08.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3202112373 wait complete. 2024-01-22T10:13:08.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f7ee6ffd640 1 -- 172.21.15.88:0/27856805 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee00035f0 con 0x7f7ef01ee470 2024-01-22T10:13:08.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f7ee6ffd640 1 -- 172.21.15.88:0/27856805 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee0003770 con 0x7f7ef01ee470 2024-01-22T10:13:08.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f7ee6ffd640 1 -- 172.21.15.88:0/27856805 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0003b20 con 0x7f7ef01ee470 2024-01-22T10:13:08.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f7ef865c640 1 -- 172.21.15.88:0/27856805 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef01ee930 con 0x7f7ef01ee470 2024-01-22T10:13:08.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f6b860da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b801402d0 0x7f6b80141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f7ef865c640 1 -- 172.21.15.88:0/27856805 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef01278b0 con 0x7f7ef01ee470 2024-01-22T10:13:08.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.266+0000 7f57301dc640 1 -- start start 2024-01-22T10:13:08.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f6b7f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b800b8ff0 0x7f6b80141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f6b7f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b800b8ff0 0x7f6b80141090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:33896/0 (socket says 172.21.15.88:33896) 2024-01-22T10:13:08.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f6b7effd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800bbd80 0x7f6b801dfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f6b7effd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800bbd80 0x7f6b801dfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49828/0 (socket says 172.21.15.88:49828) 2024-01-22T10:13:08.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f57301dc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5720007410 0x7f5720166150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f6dd7a97640 1 -- 172.21.15.88:0/3411079505 wait complete. 2024-01-22T10:13:08.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f57301dc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f572003ce30 0x7f5720176e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f57301dc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f572003d2a0 0x7f57201773c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f57301dc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5720166690 con 0x7f572003ce30 2024-01-22T10:13:08.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f57301dc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200d4ae0 con 0x7f5720007410 2024-01-22T10:13:08.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f57301dc640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57200d4490 con 0x7f572003d2a0 2024-01-22T10:13:08.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.268+0000 7f572e779640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f572003d2a0 0x7f57201773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.268+0000 7f572e779640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f572003d2a0 0x7f57201773c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49834/0 (socket says 172.21.15.88:49834) 2024-01-22T10:13:08.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.268+0000 7f572e779640 1 -- 172.21.15.88:0/3703209357 learned_addr learned my addr 172.21.15.88:0/3703209357 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:08.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.268+0000 7f572df78640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5720007410 0x7f5720166150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.268+0000 7f6dd7a97640 1 Processor -- start 2024-01-22T10:13:08.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.268+0000 7fb4f64b2640 1 Processor -- start 2024-01-22T10:13:08.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f6b7ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b801402d0 0x7f6b80141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f6dd7a97640 1 -- start start 2024-01-22T10:13:08.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f6b7ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b801402d0 0x7f6b80141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43742/0 (socket says 172.21.15.88:43742) 2024-01-22T10:13:08.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f572e779640 1 -- 172.21.15.88:0/3703209357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5720007410 msgr2=0x7f5720166150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f1d2a600640 1 Processor -- start 2024-01-22T10:13:08.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f6b860da640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b801423a0 con 0x7f6b801402d0 2024-01-22T10:13:08.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f6b860da640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800bb270 con 0x7f6b800b8ff0 2024-01-22T10:13:08.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f6b860da640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800baa60 con 0x7f6b800bbd80 2024-01-22T10:13:08.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f7ef865c640 1 -- 172.21.15.88:0/27856805 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed8005290 con 0x7f7ef01ee470 2024-01-22T10:13:08.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f6b7f7fe640 1 -- 172.21.15.88:0/14363860 learned_addr learned my addr 172.21.15.88:0/14363860 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f91e8b0f640 1 Processor -- start 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.267+0000 7f91e8b0f640 1 -- start start 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.268+0000 7f91e8b0f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40b25b0 0x7f91e4070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.268+0000 7f91e8b0f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91e40b6bc0 0x7f91e413f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.268+0000 7f91e8b0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91e4153790 0x7f91e41e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.268+0000 7f91e259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40b25b0 0x7f91e4070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.268+0000 7f91e259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40b25b0 0x7f91e4070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:33910/0 (socket says 172.21.15.88:33910) 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f91e1d9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91e40b6bc0 0x7f91e413f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f91e1d9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91e40b6bc0 0x7f91e413f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49850/0 (socket says 172.21.15.88:49850) 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f91e259c640 1 -- 172.21.15.88:0/3079704229 learned_addr learned my addr 172.21.15.88:0/3079704229 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f91e2d9d640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91e4153790 0x7f91e41e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f91e8b0f640 1 -- 172.21.15.88:0/3079704229 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40709d0 con 0x7f91e4153790 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f91e8b0f640 1 -- 172.21.15.88:0/3079704229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e4141650 con 0x7f91e40b25b0 2024-01-22T10:13:08.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f91e8b0f640 1 -- 172.21.15.88:0/3079704229 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40717e0 con 0x7f91e40b6bc0 2024-01-22T10:13:08.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.268+0000 7fad54fcf640 1 Processor -- start 2024-01-22T10:13:08.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7fad54fcf640 1 -- start start 2024-01-22T10:13:08.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f1d2a600640 1 -- start start 2024-01-22T10:13:08.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f572e779640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5720007410 0x7f5720166150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f572e779640 1 -- 172.21.15.88:0/3703209357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f572003ce30 msgr2=0x7f5720176e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f572d777640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f572003ce30 0x7f5720176e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7fb4f64b2640 1 -- start start 2024-01-22T10:13:08.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f572e779640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f572003ce30 0x7f5720176e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f572e779640 1 -- 172.21.15.88:0/3703209357 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57180094d0 con 0x7f572003d2a0 2024-01-22T10:13:08.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad54fcf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad480d80a0 0x7fad480d4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad54fcf640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad480d5830 0x7fad4816ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad54fcf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad4816b090 0x7fad480c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f572d777640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f572003ce30 0x7f5720176e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:08.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd7a97640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd006d690 0x7f6dd013b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f6b7effd640 1 -- 172.21.15.88:0/14363860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b800b8ff0 msgr2=0x7f6b80141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f6b7effd640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b800b8ff0 0x7f6b80141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f6b7effd640 1 -- 172.21.15.88:0/14363860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b801402d0 msgr2=0x7f6b80141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f6b7effd640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b801402d0 0x7f6b80141e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f6b7effd640 1 -- 172.21.15.88:0/14363860 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8013fe40 con 0x7f6b800bbd80 2024-01-22T10:13:08.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6b7ffff640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b801402d0 0x7f6b80141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:08.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad54fcf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad480d6380 con 0x7fad480d80a0 2024-01-22T10:13:08.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad54fcf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4816a6c0 con 0x7fad4816b090 2024-01-22T10:13:08.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad54fcf640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad480d5160 con 0x7fad480d5830 2024-01-22T10:13:08.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f91e259c640 1 -- 172.21.15.88:0/3079704229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91e40b6bc0 msgr2=0x7f91e413f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f91e259c640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91e40b6bc0 0x7f91e413f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f91e259c640 1 -- 172.21.15.88:0/3079704229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91e4153790 msgr2=0x7f91e41e8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f91e259c640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91e4153790 0x7f91e41e8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.269+0000 7f91e259c640 1 -- 172.21.15.88:0/3079704229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d8009400 con 0x7f91e40b25b0 2024-01-22T10:13:08.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f572e779640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f572003d2a0 0x7f57201773c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f572400c3f0 tx=0x7f572400c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6b7effd640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800bbd80 0x7f6b801dfae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6b70011990 tx=0x7f6b70011d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad4ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad4816b090 0x7fad480c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad4f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad480d80a0 0x7fad480d4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f1d2a600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d24071af0 0x7f1d2414e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f1d2a600640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d240b1dd0 0x7f1d2414ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad4ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad4816b090 0x7fad480c7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:33916/0 (socket says 172.21.15.88:33916) 2024-01-22T10:13:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad4ffff640 1 -- 172.21.15.88:0/642164422 learned_addr learned my addr 172.21.15.88:0/642164422 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:08.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad4effd640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad480d5830 0x7fad4816ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f1d2a600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d240b8a30 0x7f1d240a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f1d23fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d24071af0 0x7f1d2414e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f1d237fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d240b1dd0 0x7f1d2414ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fb4f64b2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 0x7fb4f01e9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fb4f64b2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4f0153bd0 0x7fb4f00a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f1d237fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d240b1dd0 0x7f1d2414ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43764/0 (socket says 172.21.15.88:43764) 2024-01-22T10:13:08.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f1d23fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d24071af0 0x7f1d2414e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49876/0 (socket says 172.21.15.88:49876) 2024-01-22T10:13:08.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f1d237fe640 1 -- 172.21.15.88:0/2991726002 learned_addr learned my addr 172.21.15.88:0/2991726002 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:08.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2414e300 con 0x7f1d240b1dd0 2024-01-22T10:13:08.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d241e5870 con 0x7f1d240b8a30 2024-01-22T10:13:08.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d241e5b50 con 0x7f1d24071af0 2024-01-22T10:13:08.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fb4f64b2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4f01e5220 0x7fb4f014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f1d28b9d640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d240b8a30 0x7f1d240a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad4ffff640 1 -- 172.21.15.88:0/642164422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad480d5830 msgr2=0x7fad4816ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad4ffff640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad480d5830 0x7fad4816ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad4ffff640 1 -- 172.21.15.88:0/642164422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad480d80a0 msgr2=0x7fad480d4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad4ffff640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad480d80a0 0x7fad480d4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fad4ffff640 1 -- 172.21.15.88:0/642164422 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad480d5dc0 con 0x7fad4816b090 2024-01-22T10:13:08.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7fb4ef7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4f0153bd0 0x7fb4f00a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fad4f7fe640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad480d80a0 0x7fad480d4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:08.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fb4ef7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4f0153bd0 0x7fb4f00a65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43780/0 (socket says 172.21.15.88:43780) 2024-01-22T10:13:08.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fb4effff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 0x7fb4f01e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fb4effff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 0x7fb4f01e9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49890/0 (socket says 172.21.15.88:49890) 2024-01-22T10:13:08.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fad4ffff640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad4816b090 0x7fad480c7810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad5006a160 tx=0x7fad5006bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f1d237fe640 1 -- 172.21.15.88:0/2991726002 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d24071af0 msgr2=0x7f1d2414e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f1d237fe640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d24071af0 0x7f1d2414e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f1d237fe640 1 -- 172.21.15.88:0/2991726002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d240b8a30 msgr2=0x7f1d240a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f1d237fe640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d240b8a30 0x7f1d240a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f1d237fe640 1 -- 172.21.15.88:0/2991726002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d18009400 con 0x7f1d240b1dd0 2024-01-22T10:13:08.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f7ee6ffd640 1 -- 172.21.15.88:0/27856805 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f7ee0003c80 con 0x7f7ef01ee470 2024-01-22T10:13:08.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fb4f64b2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f006f200 con 0x7fb4f0153bd0 2024-01-22T10:13:08.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fb4f64b2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01e8b80 con 0x7fb4f01e5220 2024-01-22T10:13:08.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fb4f64b2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f006e040 con 0x7fb4f00bc1d0 2024-01-22T10:13:08.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f1d237fe640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d240b1dd0 0x7f1d2414ec90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009890 tx=0x7f1d180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fad3bfff640 1 -- 172.21.15.88:0/642164422 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500738e0 con 0x7fad4816b090 2024-01-22T10:13:08.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fad3bfff640 1 -- 172.21.15.88:0/642164422 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50073a40 con 0x7fad4816b090 2024-01-22T10:13:08.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fad3bfff640 1 -- 172.21.15.88:0/642164422 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50073df0 con 0x7fad4816b090 2024-01-22T10:13:08.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fad54fcf640 1 -- 172.21.15.88:0/642164422 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad480d60a0 con 0x7fad4816b090 2024-01-22T10:13:08.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fb4ef7fe640 1 -- 172.21.15.88:0/3804772979 learned_addr learned my addr 172.21.15.88:0/3804772979 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:08.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fb4f4a4f640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4f01e5220 0x7fb4f014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f91e259c640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40b25b0 0x7f91e4070e60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f91dc001460 tx=0x7f91dc00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd7a97640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd00b7530 0x7f6dd01e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd7a97640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6dd00b79c0 0x7f6dd01d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd7a97640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd01452d0 con 0x7f6dd00b79c0 2024-01-22T10:13:08.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd7a97640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd01d5670 con 0x7f6dd00b7530 2024-01-22T10:13:08.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd7a97640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0148ad0 con 0x7f6dd006d690 2024-01-22T10:13:08.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd5833640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd006d690 0x7f6dd013b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd5833640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd006d690 0x7f6dd013b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49866/0 (socket says 172.21.15.88:49866) 2024-01-22T10:13:08.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd5833640 1 -- 172.21.15.88:0/2928216097 learned_addr learned my addr 172.21.15.88:0/2928216097 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:08.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd5833640 1 -- 172.21.15.88:0/2928216097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd00b7530 msgr2=0x7f6dd01e8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd5833640 1 --2- 172.21.15.88:0/2928216097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd00b7530 0x7f6dd01e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd5833640 1 -- 172.21.15.88:0/2928216097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6dd00b79c0 msgr2=0x7f6dd01d5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.270+0000 7f6dd5833640 1 --2- 172.21.15.88:0/2928216097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6dd00b79c0 0x7f6dd01d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fad54fcf640 1 -- 172.21.15.88:0/642164422 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad480d1080 con 0x7fad4816b090 2024-01-22T10:13:08.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f6dd5833640 1 -- 172.21.15.88:0/2928216097 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc009400 con 0x7f6dd006d690 2024-01-22T10:13:08.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f6dd5833640 1 --2- 172.21.15.88:0/2928216097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd006d690 0x7f6dd013b0e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800cbf0 tx=0x7f6dc800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fb4ef7fe640 1 -- 172.21.15.88:0/3804772979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 msgr2=0x7fb4f01e9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7fb4ef7fe640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 0x7fb4f01e9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7fb4ef7fe640 1 -- 172.21.15.88:0/3804772979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4f01e5220 msgr2=0x7fb4f014ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7fb4ef7fe640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4f01e5220 0x7fb4f014ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7fb4ef7fe640 1 -- 172.21.15.88:0/3804772979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e00094d0 con 0x7fb4f0153bd0 2024-01-22T10:13:08.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7fb4f4a4f640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4f01e5220 0x7fb4f014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:08.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f1d20ff9640 1 -- 172.21.15.88:0/2991726002 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18032840 con 0x7f1d240b1dd0 2024-01-22T10:13:08.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f7ee6ffd640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7ed406b380 0x7f7ed406d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7f7ee6ffd640 1 -- 172.21.15.88:0/27856805 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ee0089460 con 0x7f7ef01ee470 2024-01-22T10:13:08.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7f7ef63f8640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7ed406b380 0x7f7ed406d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.271+0000 7f1d20ff9640 1 -- 172.21.15.88:0/2991726002 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d180329c0 con 0x7f1d240b1dd0 2024-01-22T10:13:08.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7fb4ef7fe640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4f0153bd0 0x7fb4f00a65a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400c850 tx=0x7fb4e400cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7f91d2ffd640 1 -- 172.21.15.88:0/3079704229 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc00ace0 con 0x7f91e40b25b0 2024-01-22T10:13:08.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7f91d2ffd640 1 -- 172.21.15.88:0/3079704229 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc00ae60 con 0x7f91e40b25b0 2024-01-22T10:13:08.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7f1d20ff9640 1 -- 172.21.15.88:0/2991726002 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18032d70 con 0x7f1d240b1dd0 2024-01-22T10:13:08.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2409a660 con 0x7f1d240b1dd0 2024-01-22T10:13:08.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7f91e8b0f640 1 -- 172.21.15.88:0/3079704229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e40a2e00 con 0x7f91e40b25b0 2024-01-22T10:13:08.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7fb4ecff9640 1 -- 172.21.15.88:0/3804772979 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4004020 con 0x7fb4f0153bd0 2024-01-22T10:13:08.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7fb4ecff9640 1 -- 172.21.15.88:0/3804772979 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e40041a0 con 0x7fb4f0153bd0 2024-01-22T10:13:08.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7fb4ecff9640 1 -- 172.21.15.88:0/3804772979 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4007830 con 0x7fb4f0153bd0 2024-01-22T10:13:08.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7f91e8b0f640 1 -- 172.21.15.88:0/3079704229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e41e9a70 con 0x7f91e40b25b0 2024-01-22T10:13:08.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d241e54d0 con 0x7f1d240b1dd0 2024-01-22T10:13:08.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7f7ef63f8640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7ed406b380 0x7f7ed406d840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009a40 tx=0x7f7ee80091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.273+0000 7fad54fcf640 1 -- 172.21.15.88:0/642164422 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad48008190 con 0x7fad4816b090 2024-01-22T10:13:08.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.272+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3804772979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f00b5cc0 con 0x7fb4f0153bd0 2024-01-22T10:13:08.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.273+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3804772979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f006e5a0 con 0x7fb4f0153bd0 2024-01-22T10:13:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.273+0000 7fad3bfff640 1 -- 172.21.15.88:0/642164422 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fad50074030 con 0x7fad4816b090 2024-01-22T10:13:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.274+0000 7fad3bfff640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fad3406b400 0x7fad3406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.273+0000 7f91d2ffd640 1 -- 172.21.15.88:0/3079704229 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc012600 con 0x7f91e40b25b0 2024-01-22T10:13:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.274+0000 7f91d0ff9640 1 -- 172.21.15.88:0/3079704229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e4067c40 con 0x7f91e40b25b0 2024-01-22T10:13:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.274+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2414e470 con 0x7f1d240b1dd0 2024-01-22T10:13:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.274+0000 7fad3bfff640 1 -- 172.21.15.88:0/642164422 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad50102cc0 con 0x7fad4816b090 2024-01-22T10:13:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.274+0000 7fad4f7fe640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fad3406b400 0x7fad3406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.274+0000 7f1d20ff9640 1 -- 172.21.15.88:0/2991726002 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f1d1803b3f0 con 0x7f1d240b1dd0 2024-01-22T10:13:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.274+0000 7f91d2ffd640 1 -- 172.21.15.88:0/3079704229 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f91dc007070 con 0x7f91e40b25b0 2024-01-22T10:13:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.274+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3804772979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f004ea30 con 0x7fb4f0153bd0 2024-01-22T10:13:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7fad4f7fe640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fad3406b400 0x7fad3406d8c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad44006fd0 tx=0x7fad44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f1d20ff9640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1d1006b380 0x7f1d1006d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f6b67fff640 1 -- 172.21.15.88:0/14363860 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000fa30 con 0x7f6b800bbd80 2024-01-22T10:13:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f6b67fff640 1 -- 172.21.15.88:0/14363860 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7000fb90 con 0x7f6b800bbd80 2024-01-22T10:13:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f6b67fff640 1 -- 172.21.15.88:0/14363860 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70004030 con 0x7f6b800bbd80 2024-01-22T10:13:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f6b860da640 1 -- 172.21.15.88:0/14363860 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8013fb30 con 0x7f6b800bbd80 2024-01-22T10:13:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f6b860da640 1 -- 172.21.15.88:0/14363860 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b800bc240 con 0x7f6b800bbd80 2024-01-22T10:13:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.276+0000 7fb4ecff9640 1 -- 172.21.15.88:0/3804772979 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fb4e4007990 con 0x7fb4f0153bd0 2024-01-22T10:13:08.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f6dc67fc640 1 -- 172.21.15.88:0/2928216097 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800ad40 con 0x7f6dd006d690 2024-01-22T10:13:08.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f6dc67fc640 1 -- 172.21.15.88:0/2928216097 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc8012400 con 0x7f6dd006d690 2024-01-22T10:13:08.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.276+0000 7f6dc67fc640 1 -- 172.21.15.88:0/2928216097 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800aea0 con 0x7f6dd006d690 2024-01-22T10:13:08.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.276+0000 7f6dd7a97640 1 -- 172.21.15.88:0/2928216097 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd014efb0 con 0x7f6dd006d690 2024-01-22T10:13:08.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.276+0000 7f6dd7a97640 1 -- 172.21.15.88:0/2928216097 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd013b620 con 0x7f6dd006d690 2024-01-22T10:13:08.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f1d20ff9640 1 -- 172.21.15.88:0/2991726002 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d180ab6f0 con 0x7f1d240b1dd0 2024-01-22T10:13:08.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f1d23fff640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1d1006b380 0x7f1d1006d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f571e7fc640 1 -- 172.21.15.88:0/3703209357 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57240052d0 con 0x7f572003d2a0 2024-01-22T10:13:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f571e7fc640 1 -- 172.21.15.88:0/3703209357 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5724005430 con 0x7f572003d2a0 2024-01-22T10:13:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f571e7fc640 1 -- 172.21.15.88:0/3703209357 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724003830 con 0x7f572003d2a0 2024-01-22T10:13:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f57301dc640 1 -- 172.21.15.88:0/3703209357 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57200d4770 con 0x7f572003d2a0 2024-01-22T10:13:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f57301dc640 1 -- 172.21.15.88:0/3703209357 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57200d5850 con 0x7f572003d2a0 2024-01-22T10:13:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.277+0000 7fb4ecff9640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb4dc06b400 0x7fb4dc06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.277+0000 7f570bfff640 1 -- 172.21.15.88:0/3703209357 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5704005290 con 0x7f572003d2a0 2024-01-22T10:13:08.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f7ee6ffd640 1 -- 172.21.15.88:0/27856805 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7ee0054280 con 0x7f7ef01ee470 2024-01-22T10:13:08.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.277+0000 7fb4ecff9640 1 -- 172.21.15.88:0/3804772979 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4e40898e0 con 0x7fb4f0153bd0 2024-01-22T10:13:08.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.277+0000 7fb4effff640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb4dc06b400 0x7fb4dc06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.277+0000 7f6b860da640 1 -- 172.21.15.88:0/14363860 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b80067c40 con 0x7f6b800bbd80 2024-01-22T10:13:08.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.278+0000 7f1d23fff640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1d1006b380 0x7f1d1006d840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009a20 tx=0x7f1d1c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.278+0000 7fb4effff640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb4dc06b400 0x7fb4dc06d8c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0036000 tx=0x7fb4e003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f91d2ffd640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f91c406b430 0x7f91c406d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.275+0000 7f91d2ffd640 1 -- 172.21.15.88:0/3079704229 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91dc089ad0 con 0x7f91e40b25b0 2024-01-22T10:13:08.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.276+0000 7f91e1d9b640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f91c406b430 0x7f91c406d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.278+0000 7f91e1d9b640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f91c406b430 0x7f91c406d8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f91e4147130 tx=0x7f91d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.278+0000 7f571e7fc640 1 -- 172.21.15.88:0/3703209357 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f5724003990 con 0x7f572003d2a0 2024-01-22T10:13:08.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.278+0000 7f6b67fff640 1 -- 172.21.15.88:0/14363860 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f6b70004190 con 0x7f6b800bbd80 2024-01-22T10:13:08.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.278+0000 7f6dd7a97640 1 -- 172.21.15.88:0/2928216097 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd0067c40 con 0x7f6dd006d690 2024-01-22T10:13:08.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.278+0000 7f6dc67fc640 1 -- 172.21.15.88:0/2928216097 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f6dc8007070 con 0x7f6dd006d690 2024-01-22T10:13:08.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.278+0000 7f6b67fff640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6b6c06b430 0x7f6b6c06d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.278+0000 7f571e7fc640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f570c06b330 0x7f570c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.279+0000 7f571e7fc640 1 -- 172.21.15.88:0/3703209357 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57240891d0 con 0x7f572003d2a0 2024-01-22T10:13:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.279+0000 7f6b67fff640 1 -- 172.21.15.88:0/14363860 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b70089e10 con 0x7f6b800bbd80 2024-01-22T10:13:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.279+0000 7f6b7f7fe640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6b6c06b430 0x7f6b6c06d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.279+0000 7f6dc67fc640 1 --2- 172.21.15.88:0/2928216097 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6db406b380 0x7f6db406d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:08.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.279+0000 7f6dc67fc640 1 -- 172.21.15.88:0/2928216097 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dc8089b50 con 0x7f6dd006d690 2024-01-22T10:13:08.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.279+0000 7f572df78640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f570c06b330 0x7f570c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.279+0000 7fad3bfff640 1 -- 172.21.15.88:0/642164422 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fad500cda70 con 0x7fad4816b090 2024-01-22T10:13:08.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.279+0000 7f6dd5032640 1 --2- 172.21.15.88:0/2928216097 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6db406b380 0x7f6db406d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:08.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.279+0000 7f6b7f7fe640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6b6c06b430 0x7f6b6c06d8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6b74001900 tx=0x7f6b74044040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.279+0000 7f572df78640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f570c06b330 0x7f570c06d7f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f572804f7e0 tx=0x7f572806d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.280+0000 7f6dd5032640 1 --2- 172.21.15.88:0/2928216097 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6db406b380 0x7f6db406d840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc034000 tx=0x7f6dcc02f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:08.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.281+0000 7f1d20ff9640 1 -- 172.21.15.88:0/2991726002 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1d2414e470 con 0x7f1d240b1dd0 2024-01-22T10:13:08.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.283+0000 7f571e7fc640 1 -- 172.21.15.88:0/3703209357 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5724053dc0 con 0x7f572003d2a0 2024-01-22T10:13:08.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.285+0000 7f91d2ffd640 1 -- 172.21.15.88:0/3079704229 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f91dc054880 con 0x7f91e40b25b0 2024-01-22T10:13:08.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.286+0000 7fb4ecff9640 1 -- 172.21.15.88:0/3804772979 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb4e4054690 con 0x7fb4f0153bd0 2024-01-22T10:13:08.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.288+0000 7f6b67fff640 1 -- 172.21.15.88:0/14363860 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6b70054bc0 con 0x7f6b800bbd80 2024-01-22T10:13:08.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.291+0000 7f6dc67fc640 1 -- 172.21.15.88:0/2928216097 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6dc80548c0 con 0x7f6dd006d690 2024-01-22T10:13:08.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.683+0000 7f7ef865c640 1 -- 172.21.15.88:0/27856805 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7ed8005810 con 0x7f7ef01ee470 2024-01-22T10:13:08.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.684+0000 7f7ee6ffd640 1 -- 172.21.15.88:0/27856805 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ee00578a0 con 0x7f7ef01ee470 2024-01-22T10:13:08.667 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-01-22T10:13:08.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.686+0000 7f570bfff640 1 -- 172.21.15.88:0/3703209357 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5704005540 con 0x7f572003d2a0 2024-01-22T10:13:08.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.687+0000 7f7ef865c640 1 -- 172.21.15.88:0/27856805 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7ed406b380 msgr2=0x7f7ed406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.687+0000 7f7ef865c640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7ed406b380 0x7f7ed406d840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009a40 tx=0x7f7ee80091c0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.687+0000 7f571e7fc640 1 -- 172.21.15.88:0/3703209357 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57240573e0 con 0x7f572003d2a0 2024-01-22T10:13:08.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.687+0000 7f7ef865c640 1 -- 172.21.15.88:0/27856805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef01ee470 msgr2=0x7f7ef01e8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.687+0000 7f7ef865c640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef01ee470 0x7f7ef01e8230 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000c410 tx=0x7f7ee000c8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.687+0000 7f7ef865c640 1 -- 172.21.15.88:0/27856805 shutdown_connections 2024-01-22T10:13:08.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.687+0000 7f91d0ff9640 1 -- 172.21.15.88:0/3079704229 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f91e40b83c0 con 0x7f91e40b25b0 2024-01-22T10:13:08.671 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-01-22T10:13:08.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.688+0000 7f7ef865c640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7ed406b380 0x7f7ed406d840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.688+0000 7f7ef865c640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef01ee470 0x7f7ef01e8230 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.688+0000 7f7ef865c640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ef014f900 0x7f7ef01e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.688+0000 7f7ef865c640 1 --2- 172.21.15.88:0/27856805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ef00b6b60 0x7f7ef0129460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.688+0000 7f7ef865c640 1 -- 172.21.15.88:0/27856805 >> 172.21.15.88:0/27856805 conn(0x7f7ef006ab10 msgr2=0x7f7ef00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.688+0000 7f7ef865c640 1 -- 172.21.15.88:0/27856805 shutdown_connections 2024-01-22T10:13:08.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.688+0000 7f7ef865c640 1 -- 172.21.15.88:0/27856805 wait complete. 2024-01-22T10:13:08.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.688+0000 7f91d2ffd640 1 -- 172.21.15.88:0/3079704229 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91dc017020 con 0x7f91e40b25b0 2024-01-22T10:13:08.673 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-01-22T10:13:08.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.688+0000 7fad54fcf640 1 -- 172.21.15.88:0/642164422 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad4816a4b0 con 0x7fad4816b090 2024-01-22T10:13:08.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.689+0000 7fad3bfff640 1 -- 172.21.15.88:0/642164422 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad50091070 con 0x7fad4816b090 2024-01-22T10:13:08.674 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-01-22T10:13:08.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.691+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1d2414e440 con 0x7f1d240b1dd0 2024-01-22T10:13:08.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.691+0000 7f91d0ff9640 1 -- 172.21.15.88:0/3079704229 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f91c406b430 msgr2=0x7f91c406d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.691+0000 7f91d0ff9640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f91c406b430 0x7f91c406d8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f91e4147130 tx=0x7f91d4008040 comp rx=0 tx=0).stop 2024-01-22T10:13:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.691+0000 7f91d0ff9640 1 -- 172.21.15.88:0/3079704229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40b25b0 msgr2=0x7f91e4070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.691+0000 7f91d0ff9640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40b25b0 0x7f91e4070e60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f91dc001460 tx=0x7f91dc00a430 comp rx=0 tx=0).stop 2024-01-22T10:13:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.691+0000 7f570bfff640 1 -- 172.21.15.88:0/3703209357 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f570c06b330 msgr2=0x7f570c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.691+0000 7f570bfff640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f570c06b330 0x7f570c06d7f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f572804f7e0 tx=0x7f572806d040 comp rx=0 tx=0).stop 2024-01-22T10:13:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.691+0000 7f570bfff640 1 -- 172.21.15.88:0/3703209357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f572003d2a0 msgr2=0x7f57201773c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.691+0000 7f570bfff640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f572003d2a0 0x7f57201773c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f572400c3f0 tx=0x7f572400c8b0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.691+0000 7f1d20ff9640 1 -- 172.21.15.88:0/2991726002 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d180765a0 con 0x7f1d240b1dd0 2024-01-22T10:13:08.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.691+0000 7f91d0ff9640 1 -- 172.21.15.88:0/3079704229 shutdown_connections 2024-01-22T10:13:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f91d0ff9640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f91c406b430 0x7f91c406d8f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f91d0ff9640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91e40b6bc0 0x7f91e413f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f91d0ff9640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91e4153790 0x7f91e41e8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f91d0ff9640 1 --2- 172.21.15.88:0/3079704229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91e40b25b0 0x7f91e4070e60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.677 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-01-22T10:13:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f91d0ff9640 1 -- 172.21.15.88:0/3079704229 >> 172.21.15.88:0/3079704229 conn(0x7f91e406acf0 msgr2=0x7f91e40b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f91d0ff9640 1 -- 172.21.15.88:0/3079704229 shutdown_connections 2024-01-22T10:13:08.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f91d0ff9640 1 -- 172.21.15.88:0/3079704229 wait complete. 2024-01-22T10:13:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f570bfff640 1 -- 172.21.15.88:0/3703209357 shutdown_connections 2024-01-22T10:13:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f570bfff640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f570c06b330 0x7f570c06d7f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f570bfff640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f572003d2a0 0x7f57201773c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f570bfff640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f572003ce30 0x7f5720176e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f570bfff640 1 --2- 172.21.15.88:0/3703209357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5720007410 0x7f5720166150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f570bfff640 1 -- 172.21.15.88:0/3703209357 >> 172.21.15.88:0/3703209357 conn(0x7f5720043220 msgr2=0x7f57200d7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f570bfff640 1 -- 172.21.15.88:0/3703209357 shutdown_connections 2024-01-22T10:13:08.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7fad54fcf640 1 -- 172.21.15.88:0/642164422 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fad3406b400 msgr2=0x7fad3406d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7fad54fcf640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fad3406b400 0x7fad3406d8c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad44006fd0 tx=0x7fad44008040 comp rx=0 tx=0).stop 2024-01-22T10:13:08.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7fad54fcf640 1 -- 172.21.15.88:0/642164422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad4816b090 msgr2=0x7fad480c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7fad54fcf640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad4816b090 0x7fad480c7810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad5006a160 tx=0x7fad5006bad0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3804772979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb4f00a0680 con 0x7fb4f0153bd0 2024-01-22T10:13:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7fad54fcf640 1 -- 172.21.15.88:0/642164422 shutdown_connections 2024-01-22T10:13:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7fad54fcf640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fad3406b400 0x7fad3406d8c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7fad54fcf640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad480d5830 0x7fad4816ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7fad54fcf640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad4816b090 0x7fad480c7810 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7fad54fcf640 1 --2- 172.21.15.88:0/642164422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad480d80a0 0x7fad480d4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7fad54fcf640 1 -- 172.21.15.88:0/642164422 >> 172.21.15.88:0/642164422 conn(0x7fad4803ee10 msgr2=0x7fad4803c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.693+0000 7fad54fcf640 1 -- 172.21.15.88:0/642164422 shutdown_connections 2024-01-22T10:13:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.693+0000 7fad54fcf640 1 -- 172.21.15.88:0/642164422 wait complete. 2024-01-22T10:13:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.693+0000 7fb4ecff9640 1 -- 172.21.15.88:0/3804772979 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb4e401e090 con 0x7fb4f0153bd0 2024-01-22T10:13:08.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.692+0000 7f570bfff640 1 -- 172.21.15.88:0/3703209357 wait complete. 2024-01-22T10:13:08.681 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-01-22T10:13:08.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.695+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1d1006b380 msgr2=0x7f1d1006d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.695+0000 7f1d2a600640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1d1006b380 0x7f1d1006d840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009a20 tx=0x7f1d1c009190 comp rx=0 tx=0).stop 2024-01-22T10:13:08.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.695+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d240b1dd0 msgr2=0x7f1d2414ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.695+0000 7f1d2a600640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d240b1dd0 0x7f1d2414ec90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009890 tx=0x7f1d180046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.696+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 shutdown_connections 2024-01-22T10:13:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.696+0000 7f1d2a600640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1d1006b380 0x7f1d1006d840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.696+0000 7f1d2a600640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d240b8a30 0x7f1d240a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.696+0000 7f1d2a600640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d240b1dd0 0x7f1d2414ec90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.696+0000 7f1d2a600640 1 --2- 172.21.15.88:0/2991726002 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d24071af0 0x7f1d2414e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.696+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 >> 172.21.15.88:0/2991726002 conn(0x7f1d240bcdf0 msgr2=0x7f1d2406fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.696+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 shutdown_connections 2024-01-22T10:13:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.696+0000 7f1d2a600640 1 -- 172.21.15.88:0/2991726002 wait complete. 2024-01-22T10:13:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.697+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3804772979 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb4dc06b400 msgr2=0x7fb4dc06d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.697+0000 7fb4f64b2640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb4dc06b400 0x7fb4dc06d8c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0036000 tx=0x7fb4e003c040 comp rx=0 tx=0).stop 2024-01-22T10:13:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.697+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3804772979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4f0153bd0 msgr2=0x7fb4f00a65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.697+0000 7fb4f64b2640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4f0153bd0 0x7fb4f00a65a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400c850 tx=0x7fb4e400cd10 comp rx=0 tx=0).stop 2024-01-22T10:13:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.697+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3804772979 shutdown_connections 2024-01-22T10:13:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.698+0000 7fb4f64b2640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb4dc06b400 0x7fb4dc06d8c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.698+0000 7fb4f64b2640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4f01e5220 0x7fb4f014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.698+0000 7fb4f64b2640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4f0153bd0 0x7fb4f00a65a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.698+0000 7fb4f64b2640 1 --2- 172.21.15.88:0/3804772979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4f00bc1d0 0x7fb4f01e9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.698+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3804772979 >> 172.21.15.88:0/3804772979 conn(0x7fb4f00a2a30 msgr2=0x7fb4f01500b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.698+0000 7f6dd7a97640 1 -- 172.21.15.88:0/2928216097 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6dd0148ca0 con 0x7f6dd006d690 2024-01-22T10:13:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.698+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3804772979 shutdown_connections 2024-01-22T10:13:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.698+0000 7fb4f64b2640 1 -- 172.21.15.88:0/3804772979 wait complete. 2024-01-22T10:13:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.699+0000 7f6dc67fc640 1 -- 172.21.15.88:0/2928216097 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6dd0148ca0 con 0x7f6dd006d690 2024-01-22T10:13:08.684 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-01-22T10:13:08.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.700+0000 7f6b860da640 1 -- 172.21.15.88:0/14363860 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6b8013ffd0 con 0x7f6b800bbd80 2024-01-22T10:13:08.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.701+0000 7f6b67fff640 1 -- 172.21.15.88:0/14363860 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b70022020 con 0x7f6b800bbd80 2024-01-22T10:13:08.685 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-01-22T10:13:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.703+0000 7f6dd7a97640 1 -- 172.21.15.88:0/2928216097 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6db406b380 msgr2=0x7f6db406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.703+0000 7f6dd7a97640 1 --2- 172.21.15.88:0/2928216097 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6db406b380 0x7f6db406d840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc034000 tx=0x7f6dcc02f000 comp rx=0 tx=0).stop 2024-01-22T10:13:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.703+0000 7f6dd7a97640 1 -- 172.21.15.88:0/2928216097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd006d690 msgr2=0x7f6dd013b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.703+0000 7f6dd7a97640 1 --2- 172.21.15.88:0/2928216097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd006d690 0x7f6dd013b0e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800cbf0 tx=0x7f6dc800a430 comp rx=0 tx=0).stop 2024-01-22T10:13:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.703+0000 7f6dd7a97640 1 -- 172.21.15.88:0/2928216097 shutdown_connections 2024-01-22T10:13:08.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.703+0000 7f6dd7a97640 1 --2- 172.21.15.88:0/2928216097 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6db406b380 0x7f6db406d840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.703+0000 7f6dd7a97640 1 --2- 172.21.15.88:0/2928216097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6dd00b79c0 0x7f6dd01d5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.703+0000 7f6dd7a97640 1 --2- 172.21.15.88:0/2928216097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd00b7530 0x7f6dd01e8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.703+0000 7f6dd7a97640 1 --2- 172.21.15.88:0/2928216097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd006d690 0x7f6dd013b0e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.703+0000 7f6dd7a97640 1 -- 172.21.15.88:0/2928216097 >> 172.21.15.88:0/2928216097 conn(0x7f6dd006ab10 msgr2=0x7f6dd0140390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.703+0000 7f6dd7a97640 1 -- 172.21.15.88:0/2928216097 shutdown_connections 2024-01-22T10:13:08.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.703+0000 7f6dd7a97640 1 -- 172.21.15.88:0/2928216097 wait complete. 2024-01-22T10:13:08.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.706+0000 7f6b860da640 1 -- 172.21.15.88:0/14363860 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6b6c06b430 msgr2=0x7f6b6c06d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.706+0000 7f6b860da640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6b6c06b430 0x7f6b6c06d8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6b74001900 tx=0x7f6b74044040 comp rx=0 tx=0).stop 2024-01-22T10:13:08.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.706+0000 7f6b860da640 1 -- 172.21.15.88:0/14363860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800bbd80 msgr2=0x7f6b801dfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:08.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.706+0000 7f6b860da640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800bbd80 0x7f6b801dfae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6b70011990 tx=0x7f6b70011d90 comp rx=0 tx=0).stop 2024-01-22T10:13:08.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.707+0000 7f6b860da640 1 -- 172.21.15.88:0/14363860 shutdown_connections 2024-01-22T10:13:08.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.707+0000 7f6b860da640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f6b6c06b430 0x7f6b6c06d8f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.707+0000 7f6b860da640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b800bbd80 0x7f6b801dfae0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.707+0000 7f6b860da640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b801402d0 0x7f6b80141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.707+0000 7f6b860da640 1 --2- 172.21.15.88:0/14363860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b800b8ff0 0x7f6b80141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:08.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.707+0000 7f6b860da640 1 -- 172.21.15.88:0/14363860 >> 172.21.15.88:0/14363860 conn(0x7f6b8006a6f0 msgr2=0x7f6b80143ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:08.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.708+0000 7f6b860da640 1 -- 172.21.15.88:0/14363860 shutdown_connections 2024-01-22T10:13:08.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:08.708+0000 7f6b860da640 1 -- 172.21.15.88:0/14363860 wait complete. 2024-01-22T10:13:08.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-01-22T10:13:08.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-01-22T10:13:08.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-01-22T10:13:08.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-01-22T10:13:08.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-01-22T10:13:08.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-01-22T10:13:08.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-01-22T10:13:08.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-01-22T10:13:09.695 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-22T10:13:09.699 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-22T10:13:09.700 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-22T10:13:09.700 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-22T10:13:09.702 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-22T10:13:09.704 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-22T10:13:09.706 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-22T10:13:09.707 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-22T10:13:09.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.875+0000 7f3706bde640 1 Processor -- start 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.875+0000 7f3706bde640 1 -- start start 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.876+0000 7f3706bde640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37000b9a40 0x7f37000b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.876+0000 7f3706bde640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f37000b39e0 0x7f370015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.876+0000 7f3706bde640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f370015c400 0x7f37000b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.876+0000 7f3706bde640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37000b3050 con 0x7f37000b9a40 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.876+0000 7f3706bde640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37000b2540 con 0x7f37000b39e0 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.876+0000 7f3706bde640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37000b4e70 con 0x7f370015c400 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.876+0000 7f36fffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f37000b39e0 0x7f370015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.877+0000 7f36fffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f37000b39e0 0x7f370015bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:33956/0 (socket says 172.21.15.88:33956) 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.877+0000 7f36fffff640 1 -- 172.21.15.88:0/3119466613 learned_addr learned my addr 172.21.15.88:0/3119466613 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.877+0000 7f370517b640 1 --2- 172.21.15.88:0/3119466613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f370015c400 0x7f37000b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.877+0000 7f370497a640 1 --2- 172.21.15.88:0/3119466613 >> v2:172.21.15.88:3300/0 conn(0x7f37000b9a40 0x7f37000b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.878+0000 7f370497a640 1 -- 172.21.15.88:0/3119466613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f370015c400 msgr2=0x7f37000b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.878+0000 7f370497a640 1 --2- 172.21.15.88:0/3119466613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f370015c400 0x7f37000b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.878+0000 7f370497a640 1 -- 172.21.15.88:0/3119466613 >> v2:172.21.15.119:3300/0 conn(0x7f37000b39e0 msgr2=0x7f370015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.878+0000 7f370497a640 1 --2- 172.21.15.88:0/3119466613 >> v2:172.21.15.119:3300/0 conn(0x7f37000b39e0 0x7f370015bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.878+0000 7f370497a640 1 -- 172.21.15.88:0/3119466613 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37000b2790 con 0x7f37000b9a40 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.879+0000 7f370497a640 1 --2- 172.21.15.88:0/3119466613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000b9a40 0x7f37000b34a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f37000b4250 tx=0x7f36f003d170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869bbf8b1c0bd4cc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.879+0000 7f36ff7fe640 1 -- 172.21.15.88:0/3119466613 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f003dd10 con 0x7f37000b9a40 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.879+0000 7f36ff7fe640 1 -- 172.21.15.88:0/3119466613 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f003de70 con 0x7f37000b9a40 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.879+0000 7f36ff7fe640 1 -- 172.21.15.88:0/3119466613 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0045640 con 0x7f37000b9a40 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.880+0000 7f3706bde640 1 -- 172.21.15.88:0/3119466613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000b9a40 msgr2=0x7f37000b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.880+0000 7f3706bde640 1 --2- 172.21.15.88:0/3119466613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000b9a40 0x7f37000b34a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f37000b4250 tx=0x7f36f003d170 comp rx=0 tx=0).stop 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.880+0000 7f3706bde640 1 -- 172.21.15.88:0/3119466613 shutdown_connections 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.880+0000 7f3706bde640 1 --2- 172.21.15.88:0/3119466613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f370015c400 0x7f37000b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.880+0000 7f3706bde640 1 --2- 172.21.15.88:0/3119466613 >> v2:172.21.15.119:3300/0 conn(0x7f37000b39e0 0x7f370015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.880+0000 7f3706bde640 1 --2- 172.21.15.88:0/3119466613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000b9a40 0x7f37000b34a0 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f37000b4250 tx=0x7f36f003d170 comp rx=0 tx=0).stop 2024-01-22T10:13:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.881+0000 7f3706bde640 1 -- 172.21.15.88:0/3119466613 >> 172.21.15.88:0/3119466613 conn(0x7f370006a8d0 msgr2=0x7f370006ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:09.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.881+0000 7f3706bde640 1 -- 172.21.15.88:0/3119466613 shutdown_connections 2024-01-22T10:13:09.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.881+0000 7f3706bde640 1 -- 172.21.15.88:0/3119466613 wait complete. 2024-01-22T10:13:09.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.883+0000 7f3706bde640 1 Processor -- start 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.883+0000 7f3706bde640 1 -- start start 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.884+0000 7f3706bde640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000b39e0 0x7f370020fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.884+0000 7f3706bde640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f370015c400 0x7f3700070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.884+0000 7f3706bde640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f37000702e0 0x7f3700071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.884+0000 7f3706bde640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370006f370 con 0x7f37000b39e0 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.884+0000 7f3706bde640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700210040 con 0x7f370015c400 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.884+0000 7f3706bde640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3700071070 con 0x7f37000702e0 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.885+0000 7f370517b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f37000702e0 0x7f3700071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.885+0000 7f370517b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f37000702e0 0x7f3700071db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49920/0 (socket says 172.21.15.88:49920) 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.885+0000 7f370517b640 1 -- 172.21.15.88:0/4033265800 learned_addr learned my addr 172.21.15.88:0/4033265800 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.885+0000 7f36fffff640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f370015c400 0x7f3700070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.885+0000 7f370497a640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000b39e0 0x7f370020fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.885+0000 7f36fffff640 1 -- 172.21.15.88:0/4033265800 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f37000702e0 msgr2=0x7f3700071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.885+0000 7f36fffff640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f37000702e0 0x7f3700071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.885+0000 7f36fffff640 1 -- 172.21.15.88:0/4033265800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000b39e0 msgr2=0x7f370020fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.885+0000 7f36fffff640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000b39e0 0x7f370020fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.885+0000 7f36fffff640 1 -- 172.21.15.88:0/4033265800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0009a70 con 0x7f370015c400 2024-01-22T10:13:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.886+0000 7f370497a640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000b39e0 0x7f370020fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.886+0000 7f36fffff640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f370015c400 0x7f3700070b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f36f800f7b0 tx=0x7f36f800fc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.887+0000 7f36fd7fa640 1 -- 172.21.15.88:0/4033265800 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f800bb30 con 0x7f370015c400 2024-01-22T10:13:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.887+0000 7f3706bde640 1 -- 172.21.15.88:0/4033265800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3700156d50 con 0x7f370015c400 2024-01-22T10:13:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.887+0000 7f3706bde640 1 -- 172.21.15.88:0/4033265800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370006fae0 con 0x7f370015c400 2024-01-22T10:13:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.888+0000 7f36fd7fa640 1 -- 172.21.15.88:0/4033265800 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f8010040 con 0x7f370015c400 2024-01-22T10:13:09.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.888+0000 7f36fd7fa640 1 -- 172.21.15.88:0/4033265800 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f800be90 con 0x7f370015c400 2024-01-22T10:13:09.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.889+0000 7f3706bde640 1 -- 172.21.15.88:0/4033265800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e0005290 con 0x7f370015c400 2024-01-22T10:13:09.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.892+0000 7f36fd7fa640 1 -- 172.21.15.88:0/4033265800 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f36f8015480 con 0x7f370015c400 2024-01-22T10:13:09.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.892+0000 7f36fd7fa640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f36e806b540 0x7f36e806da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.892+0000 7f36fd7fa640 1 -- 172.21.15.88:0/4033265800 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36f8089810 con 0x7f370015c400 2024-01-22T10:13:09.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.893+0000 7f370497a640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f36e806b540 0x7f36e806da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.893+0000 7f370497a640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f36e806b540 0x7f36e806da00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f36f0047000 tx=0x7f36f0041000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.897+0000 7f36fd7fa640 1 -- 172.21.15.88:0/4033265800 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f36f80545c0 con 0x7f370015c400 2024-01-22T10:13:09.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.928+0000 7f1f3b506640 1 Processor -- start 2024-01-22T10:13:09.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.928+0000 7f1f3b506640 1 -- start start 2024-01-22T10:13:09.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.929+0000 7f1f3b506640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f2c0cfa30 0x7f1f2c0d8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.929+0000 7f1f3b506640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1f2c0090f0 0x7f1f2c029330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.929+0000 7f1f3b506640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2c0070c0 con 0x7f1f2c008950 2024-01-22T10:13:09.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.929+0000 7f1f3b506640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c03b390 con 0x7f1f2c0cfa30 2024-01-22T10:13:09.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.929+0000 7f1f3b506640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c03a8a0 con 0x7f1f2c0090f0 2024-01-22T10:13:09.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.929+0000 7f1f39d03640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f2c0cfa30 0x7f1f2c0d8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.929+0000 7f1f39d03640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f2c0cfa30 0x7f1f2c0d8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43814/0 (socket says 172.21.15.88:43814) 2024-01-22T10:13:09.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.930+0000 7f1f39d03640 1 -- 172.21.15.88:0/3929967339 learned_addr learned my addr 172.21.15.88:0/3929967339 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:09.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.930+0000 7f1f3ad05640 1 --2- 172.21.15.88:0/3929967339 >> v2:172.21.15.119:3300/0 conn(0x7f1f2c0090f0 0x7f1f2c029330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.930+0000 7f1f39502640 1 -- 172.21.15.88:0/3929967339 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882660513 0 0) 0x7f1f2c0070c0 con 0x7f1f2c008950 2024-01-22T10:13:09.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.930+0000 7f1f3ad05640 1 -- 172.21.15.88:0/3929967339 >> v2:172.21.15.88:3300/0 conn(0x7f1f2c0cfa30 msgr2=0x7f1f2c0d8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:09.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.930+0000 7f1f3ad05640 1 --2- 172.21.15.88:0/3929967339 >> v2:172.21.15.88:3300/0 conn(0x7f1f2c0cfa30 0x7f1f2c0d8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.930+0000 7f1f3ad05640 1 -- 172.21.15.88:0/3929967339 >> v1:172.21.15.119:6789/0 conn(0x7f1f2c008950 legacy=0x7f1f2c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.930+0000 7f1f3ad05640 1 -- 172.21.15.88:0/3929967339 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c03ab10 con 0x7f1f2c0090f0 2024-01-22T10:13:09.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.930+0000 7efc9dc97640 1 Processor -- start 2024-01-22T10:13:09.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.930+0000 7efc9dc97640 1 -- start start 2024-01-22T10:13:09.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.930+0000 7f44a4edc640 1 Processor -- start 2024-01-22T10:13:09.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.931+0000 7f44a4edc640 1 -- start start 2024-01-22T10:13:09.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7efc9dc97640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efc9003d890 0x7efc90006c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7ff256bb3640 1 Processor -- start 2024-01-22T10:13:09.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7efc9dc97640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc900caf50 0x7efc900d7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7f44a4edc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f44980c6ef0 0x7f44980c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7efc977fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efc9003d890 0x7efc90006c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7f44a4edc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449803aff0 con 0x7f4498007110 2024-01-22T10:13:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7f449f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4498007110 0x7f4498039ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41978/0 (socket says 172.21.15.88:41978) 2024-01-22T10:13:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7f449f7fe640 1 -- 172.21.15.88:0/4117315415 learned_addr learned my addr 172.21.15.88:0/4117315415 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7f449effd640 1 --2- 172.21.15.88:0/4117315415 >> v2:172.21.15.119:3300/0 conn(0x7f44980c6ef0 0x7f44980c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7f44a4edc640 1 -- 172.21.15.88:0/4117315415 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449803b290 con 0x7f44980cd270 2024-01-22T10:13:09.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7f44a4edc640 1 -- 172.21.15.88:0/4117315415 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449803b570 con 0x7f44980c6ef0 2024-01-22T10:13:09.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7efc96ffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7efc90007190 0x7efc900ca840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.88:47558/0 (socket says 172.21.15.88:47558) 2024-01-22T10:13:09.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7efc96ffd640 1 -- 172.21.15.88:0/65581292 learned_addr learned my addr 172.21.15.88:0/65581292 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:09.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7efc97fff640 1 --2- 172.21.15.88:0/65581292 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc900caf50 0x7efc900d7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7efc9dc97640 1 -- 172.21.15.88:0/65581292 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc90042280 con 0x7efc90007190 2024-01-22T10:13:09.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7efc9dc97640 1 -- 172.21.15.88:0/65581292 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc90042840 con 0x7efc9003d890 2024-01-22T10:13:09.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.931+0000 7f5117fff640 1 Processor -- start 2024-01-22T10:13:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7efc9dc97640 1 -- 172.21.15.88:0/65581292 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc900075e0 con 0x7efc900caf50 2024-01-22T10:13:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.931+0000 7f5117fff640 1 -- start start 2024-01-22T10:13:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7f5117fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51180b8cf0 0x7f5118153690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7efc967fc640 1 -- 172.21.15.88:0/65581292 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037396973 0 0) 0x7efc90042280 con 0x7efc90007190 2024-01-22T10:13:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7f5117fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f511806b900 0x7f5118153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7f5117fff640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51180bbd40 con 0x7f511806d450 2024-01-22T10:13:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7f5117fff640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511806ca50 con 0x7f51180b8cf0 2024-01-22T10:13:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7f5117fff640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51180b7400 con 0x7f511806b900 2024-01-22T10:13:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f5116ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f511806d450 0x7f51180b85e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41986/0 (socket says 172.21.15.88:41986) 2024-01-22T10:13:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f5116ffd640 1 -- 172.21.15.88:0/283498981 learned_addr learned my addr 172.21.15.88:0/283498981 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:09.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f51177fe640 1 --2- 172.21.15.88:0/283498981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f511806b900 0x7f5118153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7efc967fc640 1 -- 172.21.15.88:0/65581292 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc88003520 con 0x7efc90007190 2024-01-22T10:13:09.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f1f3ad05640 1 --2- 172.21.15.88:0/3929967339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f2c0090f0 0x7f1f2c029330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f3402d030 tx=0x7f1f340a6350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d4e4cd669f54f66 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257580346 0 0) 0x7f449803aff0 con 0x7f4498007110 2024-01-22T10:13:09.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4490003520 con 0x7f4498007110 2024-01-22T10:13:09.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888178287 0 0) 0x7f449803b290 con 0x7f44980cd270 2024-01-22T10:13:09.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f449803aff0 con 0x7f44980cd270 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1141267840 0 0) 0x7f449803aff0 con 0x7f44980cd270 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 >> v2:172.21.15.119:3300/0 conn(0x7f44980c6ef0 msgr2=0x7f44980c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 --2- 172.21.15.88:0/4117315415 >> v2:172.21.15.119:3300/0 conn(0x7f44980c6ef0 0x7f44980c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 >> v1:172.21.15.88:6789/0 conn(0x7f4498007110 legacy=0x7f4498039ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449803b850 con 0x7f44980cd270 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 <== mon.1 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f4494001670 con 0x7f44980cd270 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 >> v1:172.21.15.119:6789/0 conn(0x7f44980cd270 legacy=0x7f44980cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 --2- 172.21.15.88:0/4117315415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4490004ce0 0x7f4490003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 --2- 172.21.15.88:0/4117315415 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4490003ce0 0x7f4490004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 --2- 172.21.15.88:0/4117315415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44900092c0 0x7f4490009770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449803b570 con 0x7f44900092c0 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449000a050 con 0x7f4490004ce0 2024-01-22T10:13:09.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449000a210 con 0x7f4490003ce0 2024-01-22T10:13:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f51167fc640 1 --2- 172.21.15.88:0/283498981 >> v2:172.21.15.88:3300/0 conn(0x7f51180b8cf0 0x7f5118153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7fdb51542640 1 Processor -- start 2024-01-22T10:13:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7efc97fff640 1 -- 172.21.15.88:0/65581292 >> v2:172.21.15.119:3300/0 conn(0x7efc9003d890 msgr2=0x7efc90006c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7efc97fff640 1 --2- 172.21.15.88:0/65581292 >> v2:172.21.15.119:3300/0 conn(0x7efc9003d890 0x7efc90006c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7efc97fff640 1 -- 172.21.15.88:0/65581292 >> v1:172.21.15.119:6789/0 conn(0x7efc90007190 legacy=0x7efc900ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f51177fe640 1 -- 172.21.15.88:0/283498981 >> v2:172.21.15.88:3300/0 conn(0x7f51180b8cf0 msgr2=0x7f5118153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:09.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f51177fe640 1 --2- 172.21.15.88:0/283498981 >> v2:172.21.15.88:3300/0 conn(0x7f51180b8cf0 0x7f5118153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f51177fe640 1 -- 172.21.15.88:0/283498981 >> v1:172.21.15.88:6789/0 conn(0x7f511806d450 legacy=0x7f51180b85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f51177fe640 1 -- 172.21.15.88:0/283498981 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51180bb9d0 con 0x7f511806b900 2024-01-22T10:13:09.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7f449ffff640 1 --2- 172.21.15.88:0/4117315415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44900092c0 0x7f4490009770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.932+0000 7ff256bb3640 1 -- start start 2024-01-22T10:13:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7efc97fff640 1 -- 172.21.15.88:0/65581292 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9003efc0 con 0x7efc900caf50 2024-01-22T10:13:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7f449effd640 1 --2- 172.21.15.88:0/4117315415 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4490003ce0 0x7f4490004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7ff256bb3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff250149c50 0x7ff250066620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7ff256bb3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff2500b30c0 0x7ff250150000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7ff256bb3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25014a030 con 0x7ff2500b2c80 2024-01-22T10:13:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7ff256bb3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2500b9a20 con 0x7ff2500b30c0 2024-01-22T10:13:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7ff256bb3640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff250150700 con 0x7ff250149c50 2024-01-22T10:13:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7ff255bb1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff250149c50 0x7ff250066620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7ff255bb1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff250149c50 0x7ff250066620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:33982/0 (socket says 172.21.15.88:33982) 2024-01-22T10:13:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7f449ffff640 1 -- 172.21.15.88:0/4117315415 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4490003ce0 msgr2=0x7f4490004160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7f1f39502640 1 -- 172.21.15.88:0/3929967339 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34073ae0 con 0x7f1f2c0090f0 2024-01-22T10:13:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7f1f39502640 1 -- 172.21.15.88:0/3929967339 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f34073c40 con 0x7f1f2c0090f0 2024-01-22T10:13:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7f1f39502640 1 -- 172.21.15.88:0/3929967339 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34074220 con 0x7f1f2c0090f0 2024-01-22T10:13:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7f449ffff640 1 --2- 172.21.15.88:0/4117315415 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4490003ce0 0x7f4490004160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7f449ffff640 1 -- 172.21.15.88:0/4117315415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4490004ce0 msgr2=0x7f4490003760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-22T10:13:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7f449ffff640 1 --2- 172.21.15.88:0/4117315415 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4490004ce0 0x7f4490003760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7f449ffff640 1 -- 172.21.15.88:0/4117315415 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449803aff0 con 0x7f44900092c0 2024-01-22T10:13:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7f449effd640 1 --2- 172.21.15.88:0/4117315415 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4490003ce0 0x7f4490004160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7ff255bb1640 1 -- 172.21.15.88:0/3049325949 learned_addr learned my addr 172.21.15.88:0/3049325949 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7ff255bb1640 1 -- 172.21.15.88:0/3049325949 >> v2:172.21.15.88:3300/0 conn(0x7ff2500b30c0 msgr2=0x7ff250150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7ff2563b2640 1 --2- 172.21.15.88:0/3049325949 >> v2:172.21.15.88:3300/0 conn(0x7ff2500b30c0 0x7ff250150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7ff255bb1640 1 --2- 172.21.15.88:0/3049325949 >> v2:172.21.15.88:3300/0 conn(0x7ff2500b30c0 0x7ff250150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7ff255bb1640 1 -- 172.21.15.88:0/3049325949 >> v1:172.21.15.119:6789/0 conn(0x7ff2500b2c80 legacy=0x7ff25014f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7ff255bb1640 1 -- 172.21.15.88:0/3049325949 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2500b21a0 con 0x7ff250149c50 2024-01-22T10:13:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.933+0000 7fdb51542640 1 -- start start 2024-01-22T10:13:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7fdb51542640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb4c0baf10 0x7fdb4c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7fdb51542640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4c0a0480 con 0x7fdb4c0bc380 2024-01-22T10:13:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7fdb51542640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4c0b8170 con 0x7fdb4c06b900 2024-01-22T10:13:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.934+0000 7fdb51542640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4c0bffd0 con 0x7fdb4c0baf10 2024-01-22T10:13:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb50d41640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb4c0baf10 0x7fdb4c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdb4c0bc380 0x7fdb4c157db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41992/0 (socket says 172.21.15.88:41992) 2024-01-22T10:13:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4b7fe640 1 -- 172.21.15.88:0/3440538226 learned_addr learned my addr 172.21.15.88:0/3440538226 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:09.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7f51177fe640 1 --2- 172.21.15.88:0/283498981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f511806b900 0x7f5118153bd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f51080097a0 tx=0x7f510802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90d72c1c79c7b5da server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008809685 0 0) 0x7fdb4c0b8170 con 0x7fdb4c06b900 2024-01-22T10:13:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb34003520 con 0x7fdb4c06b900 2024-01-22T10:13:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936205688 0 0) 0x7fdb4c0a0480 con 0x7fdb4c0bc380 2024-01-22T10:13:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb4c0b8170 con 0x7fdb4c0bc380 2024-01-22T10:13:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7ff255bb1640 1 --2- 172.21.15.88:0/3049325949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff250149c50 0x7ff250066620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff25006f2e0 tx=0x7ff24802bde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=736bdeb91028cb1d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7f449ffff640 1 -- 172.21.15.88:0/4117315415 reap_dead start 2024-01-22T10:13:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7f449ffff640 1 --2- 172.21.15.88:0/4117315415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44900092c0 0x7f4490009770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f449400c110 tx=0x7f44900047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d47c617511dfb0a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7efc97fff640 1 --2- 172.21.15.88:0/65581292 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc900caf50 0x7efc900d7ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efc98050330 tx=0x7efc980a5fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cba7895b99bfc7b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7efc967fc640 1 -- 172.21.15.88:0/65581292 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84001670 con 0x7efc900caf50 2024-01-22T10:13:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7efc967fc640 1 -- 172.21.15.88:0/65581292 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc980a6880 con 0x7efc900caf50 2024-01-22T10:13:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7efc967fc640 1 -- 172.21.15.88:0/65581292 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc980a6cd0 con 0x7efc900caf50 2024-01-22T10:13:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7ff254baf640 1 -- 172.21.15.88:0/3049325949 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24802c900 con 0x7ff250149c50 2024-01-22T10:13:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7ff254baf640 1 -- 172.21.15.88:0/3049325949 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24802ca60 con 0x7ff250149c50 2024-01-22T10:13:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7f5115ffb640 1 -- 172.21.15.88:0/283498981 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108030800 con 0x7f511806b900 2024-01-22T10:13:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7f5115ffb640 1 -- 172.21.15.88:0/283498981 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5108030960 con 0x7f511806b900 2024-01-22T10:13:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7f5115ffb640 1 -- 172.21.15.88:0/283498981 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108030cf0 con 0x7f511806b900 2024-01-22T10:13:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1782071385 0 0) 0x7fdb4c0b8170 con 0x7fdb4c0bc380 2024-01-22T10:13:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 >> v2:172.21.15.88:3300/0 conn(0x7fdb4c0baf10 msgr2=0x7fdb4c15b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 --2- 172.21.15.88:0/3440538226 >> v2:172.21.15.88:3300/0 conn(0x7fdb4c0baf10 0x7fdb4c15b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 >> v1:172.21.15.119:6789/0 conn(0x7fdb4c06b900 legacy=0x7fdb4c0bbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c0c02b0 con 0x7fdb4c0bc380 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fdb400015f0 con 0x7fdb4c0bc380 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 >> v1:172.21.15.88:6789/0 conn(0x7fdb4c0bc380 legacy=0x7fdb4c157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 --2- 172.21.15.88:0/3440538226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb34004b90 0x7fdb34004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 --2- 172.21.15.88:0/3440538226 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb34003760 0x7fdb34003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 --2- 172.21.15.88:0/3440538226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb34004120 0x7fdb3400ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c001160 con 0x7fdb34004b90 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0bffd0 con 0x7fdb34004120 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3400c1b0 con 0x7fdb34003760 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7fdb4bfff640 1 --2- 172.21.15.88:0/3440538226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb34004b90 0x7fdb34004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7fdb4bfff640 1 -- 172.21.15.88:0/3440538226 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb34003760 msgr2=0x7fdb34003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7fdb4bfff640 1 --2- 172.21.15.88:0/3440538226 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb34003760 0x7fdb34003be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7fdb4bfff640 1 -- 172.21.15.88:0/3440538226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb34004120 msgr2=0x7fdb3400ba00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-22T10:13:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7fdb4bfff640 1 --2- 172.21.15.88:0/3440538226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb34004120 0x7fdb3400ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7fdb4bfff640 1 -- 172.21.15.88:0/3440538226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c0c02b0 con 0x7fdb34004b90 2024-01-22T10:13:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7f1f3b506640 1 -- 172.21.15.88:0/3929967339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f2c0090f0 msgr2=0x7f1f2c029330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.935+0000 7f1f3b506640 1 --2- 172.21.15.88:0/3929967339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f2c0090f0 0x7f1f2c029330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f3402d030 tx=0x7f1f340a6350 comp rx=0 tx=0).stop 2024-01-22T10:13:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f1f3b506640 1 -- 172.21.15.88:0/3929967339 shutdown_connections 2024-01-22T10:13:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f1f3b506640 1 --2- 172.21.15.88:0/3929967339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f2c0090f0 0x7f1f2c029330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f1f3b506640 1 --2- 172.21.15.88:0/3929967339 >> v2:172.21.15.88:3300/0 conn(0x7f1f2c0cfa30 0x7f1f2c0d8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f1f3b506640 1 -- 172.21.15.88:0/3929967339 >> 172.21.15.88:0/3929967339 conn(0x7f1f2c007bf0 msgr2=0x7f1f2c007fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7ff254baf640 1 -- 172.21.15.88:0/3049325949 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24802cdd0 con 0x7ff250149c50 2024-01-22T10:13:09.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f5117fff640 1 -- 172.21.15.88:0/283498981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f511806b900 msgr2=0x7f5118153bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f5117fff640 1 --2- 172.21.15.88:0/283498981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f511806b900 0x7f5118153bd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f51080097a0 tx=0x7f510802b940 comp rx=0 tx=0).stop 2024-01-22T10:13:09.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7ff256bb3640 1 -- 172.21.15.88:0/3049325949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff250149c50 msgr2=0x7ff250066620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7ff256bb3640 1 --2- 172.21.15.88:0/3049325949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff250149c50 0x7ff250066620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff25006f2e0 tx=0x7ff24802bde0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f5117fff640 1 -- 172.21.15.88:0/283498981 shutdown_connections 2024-01-22T10:13:09.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f5117fff640 1 --2- 172.21.15.88:0/283498981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f511806b900 0x7f5118153bd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f5117fff640 1 --2- 172.21.15.88:0/283498981 >> v2:172.21.15.88:3300/0 conn(0x7f51180b8cf0 0x7f5118153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f5117fff640 1 -- 172.21.15.88:0/283498981 >> 172.21.15.88:0/283498981 conn(0x7f51180bc8e0 msgr2=0x7f51180bccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:09.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449402ca30 con 0x7f44900092c0 2024-01-22T10:13:09.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7fdb50d41640 1 -- 172.21.15.88:0/3440538226 reap_dead start 2024-01-22T10:13:09.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7efc9dc97640 1 -- 172.21.15.88:0/65581292 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc900caf50 msgr2=0x7efc900d7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7efc9dc97640 1 --2- 172.21.15.88:0/65581292 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc900caf50 0x7efc900d7ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efc98050330 tx=0x7efc980a5fe0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7f5117fff640 1 -- 172.21.15.88:0/283498981 shutdown_connections 2024-01-22T10:13:09.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449402cb90 con 0x7f44900092c0 2024-01-22T10:13:09.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.936+0000 7f449e7fc640 1 -- 172.21.15.88:0/4117315415 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449402ca30 con 0x7f44900092c0 2024-01-22T10:13:09.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7efc9dc97640 1 -- 172.21.15.88:0/65581292 shutdown_connections 2024-01-22T10:13:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7ff256bb3640 1 -- 172.21.15.88:0/3049325949 shutdown_connections 2024-01-22T10:13:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7ff256bb3640 1 --2- 172.21.15.88:0/3049325949 >> v2:172.21.15.88:3300/0 conn(0x7ff2500b30c0 0x7ff250150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7ff256bb3640 1 --2- 172.21.15.88:0/3049325949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff250149c50 0x7ff250066620 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7ff256bb3640 1 -- 172.21.15.88:0/3049325949 >> 172.21.15.88:0/3049325949 conn(0x7ff2500bd1a0 msgr2=0x7ff2500bd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7efc9dc97640 1 --2- 172.21.15.88:0/65581292 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc900caf50 0x7efc900d7ed0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7efc9dc97640 1 --2- 172.21.15.88:0/65581292 >> v2:172.21.15.119:3300/0 conn(0x7efc9003d890 0x7efc90006c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7efc9dc97640 1 -- 172.21.15.88:0/65581292 >> 172.21.15.88:0/65581292 conn(0x7efc9003f720 msgr2=0x7efc9003fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:09.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7f5117fff640 1 -- 172.21.15.88:0/283498981 wait complete. 2024-01-22T10:13:09.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7f1f3b506640 1 -- 172.21.15.88:0/3929967339 shutdown_connections 2024-01-22T10:13:09.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7f44a4edc640 1 -- 172.21.15.88:0/4117315415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44900092c0 msgr2=0x7f4490009770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7f1f3b506640 1 -- 172.21.15.88:0/3929967339 wait complete. 2024-01-22T10:13:09.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7f44a4edc640 1 --2- 172.21.15.88:0/4117315415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44900092c0 0x7f4490009770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f449400c110 tx=0x7f44900047e0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7efc9dc97640 1 -- 172.21.15.88:0/65581292 shutdown_connections 2024-01-22T10:13:09.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7efc9dc97640 1 -- 172.21.15.88:0/65581292 wait complete. 2024-01-22T10:13:09.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7ff256bb3640 1 -- 172.21.15.88:0/3049325949 shutdown_connections 2024-01-22T10:13:09.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7fdb4bfff640 1 --2- 172.21.15.88:0/3440538226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb34004b90 0x7fdb34004f70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c007e30 tx=0x7fdb340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88ae5a4abad3f4e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7f44a4edc640 1 -- 172.21.15.88:0/4117315415 shutdown_connections 2024-01-22T10:13:09.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7f44a4edc640 1 --2- 172.21.15.88:0/4117315415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44900092c0 0x7f4490009770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.938+0000 7f44a4edc640 1 -- 172.21.15.88:0/4117315415 >> 172.21.15.88:0/4117315415 conn(0x7f449803ee20 msgr2=0x7f449803f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.938+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c005330 con 0x7fdb34004b90 2024-01-22T10:13:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.938+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c005490 con 0x7fdb34004b90 2024-01-22T10:13:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.938+0000 7fdb4affd640 1 -- 172.21.15.88:0/3440538226 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0037f0 con 0x7fdb34004b90 2024-01-22T10:13:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.937+0000 7ff256bb3640 1 -- 172.21.15.88:0/3049325949 wait complete. 2024-01-22T10:13:09.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.938+0000 7f5117fff640 1 Processor -- start 2024-01-22T10:13:09.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.938+0000 7f1f3b506640 1 Processor -- start 2024-01-22T10:13:09.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.938+0000 7f655645d640 1 Processor -- start 2024-01-22T10:13:09.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7f655645d640 1 -- start start 2024-01-22T10:13:09.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.938+0000 7f44a4edc640 1 -- 172.21.15.88:0/4117315415 shutdown_connections 2024-01-22T10:13:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7f44a4edc640 1 -- 172.21.15.88:0/4117315415 wait complete. 2024-01-22T10:13:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7ff256bb3640 1 Processor -- start 2024-01-22T10:13:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7efc9dc97640 1 Processor -- start 2024-01-22T10:13:09.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7ff256bb3640 1 -- start start 2024-01-22T10:13:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7fdb51542640 1 -- 172.21.15.88:0/3440538226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb34004b90 msgr2=0x7fdb34004f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7fdb51542640 1 --2- 172.21.15.88:0/3440538226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb34004b90 0x7fdb34004f70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c007e30 tx=0x7fdb340057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7efc9dc97640 1 -- start start 2024-01-22T10:13:09.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7fdb51542640 1 -- 172.21.15.88:0/3440538226 shutdown_connections 2024-01-22T10:13:09.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7fdb51542640 1 --2- 172.21.15.88:0/3440538226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb34004b90 0x7fdb34004f70 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c007e30 tx=0x7fdb340057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.938+0000 7f1f3b506640 1 -- start start 2024-01-22T10:13:09.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7f1f3b506640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f2c008950 0x7f1f2c036bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7f1f3b506640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f2c0090f0 0x7f1f2c0d2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7fdb51542640 1 -- 172.21.15.88:0/3440538226 >> 172.21.15.88:0/3440538226 conn(0x7fdb4c0bd7f0 msgr2=0x7fdb4c0bdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:09.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7f1f3b506640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2c0cfa30 0x7f1f2c0d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.939+0000 7f655645d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b25b0 0x7f6550153250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f1f3b506640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c03a140 con 0x7f1f2c0cfa30 2024-01-22T10:13:09.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f654ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f65500b6bc0 0x7f65500bd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41994/0 (socket says 172.21.15.88:41994) 2024-01-22T10:13:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f655645d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6550153790 0x7f655015a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7fdb51542640 1 -- 172.21.15.88:0/3440538226 shutdown_connections 2024-01-22T10:13:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f654f7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b25b0 0x7f6550153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f655645d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65500b6fa0 con 0x7f65500b6bc0 2024-01-22T10:13:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f655645d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65500b29f0 con 0x7f6550153790 2024-01-22T10:13:09.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f655645d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65500bd930 con 0x7f65500b25b0 2024-01-22T10:13:09.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f654f7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b25b0 0x7f6550153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:49958/0 (socket says 172.21.15.88:49958) 2024-01-22T10:13:09.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f654f7fe640 1 -- 172.21.15.88:0/4290094457 learned_addr learned my addr 172.21.15.88:0/4290094457 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f1f39d03640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f2c0090f0 0x7f1f2c0d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f1f39d03640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f2c0090f0 0x7f1f2c0d2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:33994/0 (socket says 172.21.15.88:33994) 2024-01-22T10:13:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f1f39d03640 1 -- 172.21.15.88:0/1222417112 learned_addr learned my addr 172.21.15.88:0/1222417112 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:09.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f1f3ad05640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2c0cfa30 0x7f1f2c0d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7ff256bb3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2500b2c80 0x7ff2500a2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7ff256bb3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2500b30c0 0x7ff25014eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7ff255bb1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2500b2c80 0x7ff2500a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7ff255bb1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2500b2c80 0x7ff2500a2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43890/0 (socket says 172.21.15.88:43890) 2024-01-22T10:13:09.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f65549fa640 1 --2- 172.21.15.88:0/4290094457 >> v2:172.21.15.119:3300/0 conn(0x7f6550153790 0x7f655015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f1f3b506640 1 -- 172.21.15.88:0/1222417112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0d2670 con 0x7f1f2c0090f0 2024-01-22T10:13:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7ff256bb3640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff250149c50 0x7ff25014c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7ff256bb3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2500a2e40 con 0x7ff2500b2c80 2024-01-22T10:13:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7ff255bb1640 1 -- 172.21.15.88:0/3946517952 learned_addr learned my addr 172.21.15.88:0/3946517952 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:09.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7efc9dc97640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc90007190 0x7efc90163b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f654f7fe640 1 -- 172.21.15.88:0/4290094457 >> v2:172.21.15.119:3300/0 conn(0x7f6550153790 msgr2=0x7f655015a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f654f7fe640 1 --2- 172.21.15.88:0/4290094457 >> v2:172.21.15.119:3300/0 conn(0x7f6550153790 0x7f655015a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f654f7fe640 1 -- 172.21.15.88:0/4290094457 >> v1:172.21.15.88:6789/0 conn(0x7f65500b6bc0 legacy=0x7f65500bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f1f3b506640 1 -- 172.21.15.88:0/1222417112 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0d0590 con 0x7f1f2c008950 2024-01-22T10:13:09.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7efc9dc97640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9003d890 0x7efc9003c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f654f7fe640 1 -- 172.21.15.88:0/4290094457 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6550153be0 con 0x7f65500b25b0 2024-01-22T10:13:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7f44a4edc640 1 Processor -- start 2024-01-22T10:13:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7fdb51542640 1 -- 172.21.15.88:0/3440538226 wait complete. 2024-01-22T10:13:09.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc9dc97640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc900caf50 0x7efc900cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7f44a4edc640 1 -- start start 2024-01-22T10:13:09.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc9dc97640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9003c660 con 0x7efc9003d890 2024-01-22T10:13:09.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc9dc97640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc900cf2f0 con 0x7efc900caf50 2024-01-22T10:13:09.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc9dc97640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc900cfff0 con 0x7efc90007190 2024-01-22T10:13:09.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc97fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc900caf50 0x7efc900cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc97fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc900caf50 0x7efc900cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:34032/0 (socket says 172.21.15.88:34032) 2024-01-22T10:13:09.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc97fff640 1 -- 172.21.15.88:0/1632980736 learned_addr learned my addr 172.21.15.88:0/1632980736 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:09.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc96ffd640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9003d890 0x7efc9003c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc977fe640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc90007190 0x7efc90163b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7ff256bb3640 1 -- 172.21.15.88:0/3946517952 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25009fbe0 con 0x7ff2500b30c0 2024-01-22T10:13:09.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7ff256bb3640 1 -- 172.21.15.88:0/3946517952 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25014f0c0 con 0x7ff250149c50 2024-01-22T10:13:09.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.940+0000 7ff2553b0640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2500b30c0 0x7ff25014eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7ff2563b2640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff250149c50 0x7ff25014c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7ff255bb1640 1 -- 172.21.15.88:0/3946517952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff250149c50 msgr2=0x7ff25014c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7ff255bb1640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff250149c50 0x7ff25014c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7ff255bb1640 1 -- 172.21.15.88:0/3946517952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2500b30c0 msgr2=0x7ff25014eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7ff255bb1640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2500b30c0 0x7ff25014eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7ff255bb1640 1 -- 172.21.15.88:0/3946517952 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff248009b30 con 0x7ff2500b2c80 2024-01-22T10:13:09.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7f1f39d03640 1 -- 172.21.15.88:0/1222417112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f2c008950 msgr2=0x7f1f2c036bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-22T10:13:09.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7f1f39d03640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f2c008950 0x7f1f2c036bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7f1f39d03640 1 -- 172.21.15.88:0/1222417112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2c0cfa30 msgr2=0x7f1f2c0d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7f1f39d03640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2c0cfa30 0x7f1f2c0d09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7f1f39d03640 1 -- 172.21.15.88:0/1222417112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c037270 con 0x7f1f2c0090f0 2024-01-22T10:13:09.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc97fff640 1 -- 172.21.15.88:0/1632980736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc90007190 msgr2=0x7efc90163b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc97fff640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc90007190 0x7efc90163b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc97fff640 1 -- 172.21.15.88:0/1632980736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9003d890 msgr2=0x7efc9003c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc97fff640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9003d890 0x7efc9003c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7efc97fff640 1 -- 172.21.15.88:0/1632980736 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc900d0260 con 0x7efc900caf50 2024-01-22T10:13:09.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7fdb51542640 1 Processor -- start 2024-01-22T10:13:09.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f1f39d03640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f2c0090f0 0x7f1f2c0d2130 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000e870 tx=0x7f1f3000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7ff255bb1640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2500b2c80 0x7ff2500a2900 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff248036040 tx=0x7ff248004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7ff2467fc640 1 -- 172.21.15.88:0/3946517952 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2480040c0 con 0x7ff2500b2c80 2024-01-22T10:13:09.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f654f7fe640 1 --2- 172.21.15.88:0/4290094457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b25b0 0x7f6550153250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6544009870 tx=0x7f654402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbd7597c7f0d615b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7ff256bb3640 1 -- 172.21.15.88:0/3946517952 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25014bf20 con 0x7ff2500b2c80 2024-01-22T10:13:09.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7ff2467fc640 1 -- 172.21.15.88:0/3946517952 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff248004220 con 0x7ff2500b2c80 2024-01-22T10:13:09.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f44a4edc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44900092c0 0x7f44981621e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f44a4edc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44980c9df0 0x7f4498037490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f1f2affd640 1 -- 172.21.15.88:0/1222417112 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000c8e0 con 0x7f1f2c0090f0 2024-01-22T10:13:09.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f1f2affd640 1 -- 172.21.15.88:0/1222417112 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3000ca40 con 0x7f1f2c0090f0 2024-01-22T10:13:09.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f1f2affd640 1 -- 172.21.15.88:0/1222417112 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000cdf0 con 0x7f1f2c0090f0 2024-01-22T10:13:09.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f449f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44900092c0 0x7f44981621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f449f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44900092c0 0x7f44981621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:34036/0 (socket says 172.21.15.88:34036) 2024-01-22T10:13:09.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f449f7fe640 1 -- 172.21.15.88:0/3607371470 learned_addr learned my addr 172.21.15.88:0/3607371470 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:09.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f1f3b506640 1 -- 172.21.15.88:0/1222417112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2c16b470 con 0x7f1f2c0090f0 2024-01-22T10:13:09.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f1f3b506640 1 -- 172.21.15.88:0/1222417112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c0d5f40 con 0x7f1f2c0090f0 2024-01-22T10:13:09.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f44a4edc640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4498030ab0 0x7f4498030f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7fdb51542640 1 -- start start 2024-01-22T10:13:09.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f449effd640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44980c9df0 0x7f4498037490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.941+0000 7f5117fff640 1 -- start start 2024-01-22T10:13:09.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7ff2467fc640 1 -- 172.21.15.88:0/3946517952 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff248004390 con 0x7ff2500b2c80 2024-01-22T10:13:09.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f449ffff640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4498030ab0 0x7f4498030f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7ff256bb3640 1 -- 172.21.15.88:0/3946517952 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25014b290 con 0x7ff2500b2c80 2024-01-22T10:13:09.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44980c8190 con 0x7f44980c9df0 2024-01-22T10:13:09.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44980379d0 con 0x7f44900092c0 2024-01-22T10:13:09.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44980c9650 con 0x7f4498030ab0 2024-01-22T10:13:09.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f5117fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511806b900 0x7f511809fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7f5117fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f511806d450 0x7f511806f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f5117fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51180708a0 0x7f5118070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7fdb51542640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb4c1dc640 0x7fdb4c1d8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f654effd640 1 -- 172.21.15.88:0/4290094457 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544031740 con 0x7f65500b25b0 2024-01-22T10:13:09.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f5117fff640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51180a0210 con 0x7f511806b900 2024-01-22T10:13:09.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f5117fff640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511809b890 con 0x7f51180708a0 2024-01-22T10:13:09.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f5117fff640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5118071960 con 0x7f511806d450 2024-01-22T10:13:09.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.942+0000 7efc97fff640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc900caf50 0x7efc900cbcd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efc9806a570 tx=0x7efc980757b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7fdb51542640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb4c06feb0 0x7fdb4c1d8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f654effd640 1 -- 172.21.15.88:0/4290094457 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65440318a0 con 0x7f65500b25b0 2024-01-22T10:13:09.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7fdb51542640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb4c070d50 0x7fdb4c0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f654effd640 1 -- 172.21.15.88:0/4290094457 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544031c30 con 0x7f65500b25b0 2024-01-22T10:13:09.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7fdb4bfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb4c1dc640 0x7fdb4c1d8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7fdb4bfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb4c1dc640 0x7fdb4c1d8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:50000/0 (socket says 172.21.15.88:50000) 2024-01-22T10:13:09.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7fdb50d41640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb4c070d50 0x7fdb4c0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f449f7fe640 1 -- 172.21.15.88:0/3607371470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4498030ab0 msgr2=0x7f4498030f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f449f7fe640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4498030ab0 0x7f4498030f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f449f7fe640 1 -- 172.21.15.88:0/3607371470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44980c9df0 msgr2=0x7f4498037490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f449f7fe640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44980c9df0 0x7f4498037490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7f449f7fe640 1 -- 172.21.15.88:0/3607371470 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44980382e0 con 0x7f44900092c0 2024-01-22T10:13:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7efc83fff640 1 -- 172.21.15.88:0/1632980736 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc980b9470 con 0x7efc900caf50 2024-01-22T10:13:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7efc83fff640 1 -- 172.21.15.88:0/1632980736 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc980b95d0 con 0x7efc900caf50 2024-01-22T10:13:09.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7efc83fff640 1 -- 172.21.15.88:0/1632980736 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc980b9960 con 0x7efc900caf50 2024-01-22T10:13:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.943+0000 7fdb50d41640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb4c070d50 0x7fdb4c0711d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43926/0 (socket says 172.21.15.88:43926) 2024-01-22T10:13:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7fdb4bfff640 1 -- 172.21.15.88:0/3203660766 learned_addr learned my addr 172.21.15.88:0/3203660766 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c06e1b0 con 0x7fdb4c070d50 2024-01-22T10:13:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c071710 con 0x7fdb4c06feb0 2024-01-22T10:13:09.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0703e0 con 0x7fdb4c1dc640 2024-01-22T10:13:09.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f449f7fe640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44900092c0 0x7f44981621e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f44a00641c0 tx=0x7f44a006bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7efc9dc97640 1 -- 172.21.15.88:0/1632980736 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc90164160 con 0x7efc900caf50 2024-01-22T10:13:09.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7efc9dc97640 1 -- 172.21.15.88:0/1632980736 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc900cb4d0 con 0x7efc900caf50 2024-01-22T10:13:09.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f5116ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511806b900 0x7f511809fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f5116ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511806b900 0x7f511809fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43930/0 (socket says 172.21.15.88:43930) 2024-01-22T10:13:09.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f5116ffd640 1 -- 172.21.15.88:0/744826091 learned_addr learned my addr 172.21.15.88:0/744826091 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:09.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f448bfff640 1 -- 172.21.15.88:0/3607371470 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0073ae0 con 0x7f44900092c0 2024-01-22T10:13:09.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f448bfff640 1 -- 172.21.15.88:0/3607371470 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a0073ca0 con 0x7f44900092c0 2024-01-22T10:13:09.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f448bfff640 1 -- 172.21.15.88:0/3607371470 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0074270 con 0x7f44900092c0 2024-01-22T10:13:09.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f655645d640 1 -- 172.21.15.88:0/4290094457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b25b0 msgr2=0x7f6550153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f655645d640 1 --2- 172.21.15.88:0/4290094457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b25b0 0x7f6550153250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6544009870 tx=0x7f654402b860 comp rx=0 tx=0).stop 2024-01-22T10:13:09.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f51177fe640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51180708a0 0x7f5118070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f51167fc640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f511806d450 0x7f511806f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44980c7930 con 0x7f44900092c0 2024-01-22T10:13:09.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44980c7eb0 con 0x7f44900092c0 2024-01-22T10:13:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7ff2467fc640 1 -- 172.21.15.88:0/3946517952 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7ff2480044f0 con 0x7ff2500b2c80 2024-01-22T10:13:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f5116ffd640 1 -- 172.21.15.88:0/744826091 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f511806d450 msgr2=0x7f511806f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f5116ffd640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f511806d450 0x7f511806f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f5116ffd640 1 -- 172.21.15.88:0/744826091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51180708a0 msgr2=0x7f5118070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f5116ffd640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51180708a0 0x7f5118070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f5116ffd640 1 -- 172.21.15.88:0/744826091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5108009400 con 0x7f511806b900 2024-01-22T10:13:09.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f655645d640 1 -- 172.21.15.88:0/4290094457 shutdown_connections 2024-01-22T10:13:09.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f655645d640 1 --2- 172.21.15.88:0/4290094457 >> v2:172.21.15.119:3300/0 conn(0x7f6550153790 0x7f655015a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7f655645d640 1 --2- 172.21.15.88:0/4290094457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b25b0 0x7f6550153250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7f655645d640 1 -- 172.21.15.88:0/4290094457 >> 172.21.15.88:0/4290094457 conn(0x7f655006acf0 msgr2=0x7f65500bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:09.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.944+0000 7f1f3b506640 1 -- 172.21.15.88:0/1222417112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c006890 con 0x7f1f2c0090f0 2024-01-22T10:13:09.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7ff2467fc640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff23406b330 0x7ff23406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7f5116ffd640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511806b900 0x7f511809fcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f511000cba0 tx=0x7f511000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7ff256bb3640 1 -- 172.21.15.88:0/3946517952 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff250074b30 con 0x7ff2500b2c80 2024-01-22T10:13:09.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7ff2467fc640 1 -- 172.21.15.88:0/3946517952 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2480ab8b0 con 0x7ff2500b2c80 2024-01-22T10:13:09.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7ff2553b0640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff23406b330 0x7ff23406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7f50ff7fe640 1 -- 172.21.15.88:0/744826091 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000ad40 con 0x7f511806b900 2024-01-22T10:13:09.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7f655645d640 1 -- 172.21.15.88:0/4290094457 shutdown_connections 2024-01-22T10:13:09.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7f655645d640 1 -- 172.21.15.88:0/4290094457 wait complete. 2024-01-22T10:13:09.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7fdb4b7fe640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb4c06feb0 0x7fdb4c1d8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.946+0000 7ff2553b0640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff23406b330 0x7ff23406d7f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff250068050 tx=0x7ff240009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.946+0000 7fdb4bfff640 1 -- 172.21.15.88:0/3203660766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb4c06feb0 msgr2=0x7fdb4c1d8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.946+0000 7fdb4bfff640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb4c06feb0 0x7fdb4c1d8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.946+0000 7fdb4bfff640 1 -- 172.21.15.88:0/3203660766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb4c070d50 msgr2=0x7fdb4c0711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.946+0000 7fdb4bfff640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb4c070d50 0x7fdb4c0711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.946+0000 7fdb4bfff640 1 -- 172.21.15.88:0/3203660766 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c0b6a70 con 0x7fdb4c1dc640 2024-01-22T10:13:09.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.946+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44980081a0 con 0x7f44900092c0 2024-01-22T10:13:09.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.946+0000 7efc9dc97640 1 -- 172.21.15.88:0/1632980736 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc900057d0 con 0x7efc900caf50 2024-01-22T10:13:09.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.946+0000 7efc83fff640 1 -- 172.21.15.88:0/1632980736 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7efc980b9ac0 con 0x7efc900caf50 2024-01-22T10:13:09.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.946+0000 7fdb4bfff640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb4c1dc640 0x7fdb4c1d8510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c007e30 tx=0x7fdb3c001680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7f5117fff640 1 -- 172.21.15.88:0/744826091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5118071af0 con 0x7f511806b900 2024-01-22T10:13:09.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.945+0000 7f5117fff640 1 -- 172.21.15.88:0/744826091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51180712d0 con 0x7f511806b900 2024-01-22T10:13:09.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.946+0000 7f50ff7fe640 1 -- 172.21.15.88:0/744826091 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5110012400 con 0x7f511806b900 2024-01-22T10:13:09.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.946+0000 7f50ff7fe640 1 -- 172.21.15.88:0/744826091 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000aea0 con 0x7f511806b900 2024-01-22T10:13:09.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.947+0000 7efc83fff640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7efc7c06b380 0x7efc7c06d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.947+0000 7efc83fff640 1 -- 172.21.15.88:0/1632980736 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc98126670 con 0x7efc900caf50 2024-01-22T10:13:09.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.947+0000 7fdb50d41640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb4c070d50 0x7fdb4c0711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:09.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.947+0000 7fdb48ff9640 1 -- 172.21.15.88:0/3203660766 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c001520 con 0x7fdb4c1dc640 2024-01-22T10:13:09.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.947+0000 7fdb48ff9640 1 -- 172.21.15.88:0/3203660766 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c03a070 con 0x7fdb4c1dc640 2024-01-22T10:13:09.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.947+0000 7fdb48ff9640 1 -- 172.21.15.88:0/3203660766 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0037f0 con 0x7fdb4c1dc640 2024-01-22T10:13:09.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.947+0000 7f655645d640 1 Processor -- start 2024-01-22T10:13:09.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.947+0000 7efc977fe640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7efc7c06b380 0x7efc7c06d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.947+0000 7f448bfff640 1 -- 172.21.15.88:0/3607371470 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f44a00743d0 con 0x7f44900092c0 2024-01-22T10:13:09.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.948+0000 7f448bfff640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f448406b3b0 0x7f448406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.948+0000 7f448bfff640 1 -- 172.21.15.88:0/3607371470 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44a01047e0 con 0x7f44900092c0 2024-01-22T10:13:09.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.948+0000 7f449effd640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f448406b3b0 0x7f448406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7efc977fe640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7efc7c06b380 0x7efc7c06d840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc8c006fd0 tx=0x7efc8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.948+0000 7f5117fff640 1 -- 172.21.15.88:0/744826091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f8005290 con 0x7f511806b900 2024-01-22T10:13:09.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.948+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c0b7640 con 0x7fdb4c1dc640 2024-01-22T10:13:09.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.948+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c06db60 con 0x7fdb4c1dc640 2024-01-22T10:13:09.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.948+0000 7f655645d640 1 -- start start 2024-01-22T10:13:09.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.948+0000 7f1f2affd640 1 -- 172.21.15.88:0/1222417112 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f1f30013470 con 0x7f1f2c0090f0 2024-01-22T10:13:09.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f449effd640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f448406b3b0 0x7f448406d870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4498005aa0 tx=0x7f448c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f655645d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65500b25b0 0x7f65500708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f655645d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b6bc0 0x7f6550071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f655645d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6550153790 0x7f655006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f655645d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65501d9040 con 0x7f65500b25b0 2024-01-22T10:13:09.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f655645d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65500710e0 con 0x7f6550153790 2024-01-22T10:13:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f1f2affd640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1f1806b400 0x7f1f1806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f1f2affd640 1 -- 172.21.15.88:0/1222417112 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f3008a4d0 con 0x7f1f2c0090f0 2024-01-22T10:13:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f1f3a504640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1f1806b400 0x7f1f1806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4c06e320 con 0x7fdb4c1dc640 2024-01-22T10:13:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f655645d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655006f370 con 0x7f65500b6bc0 2024-01-22T10:13:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f654ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65500b25b0 0x7f65500708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f654ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65500b25b0 0x7f65500708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43934/0 (socket says 172.21.15.88:43934) 2024-01-22T10:13:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f654ffff640 1 -- 172.21.15.88:0/203004408 learned_addr learned my addr 172.21.15.88:0/203004408 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f654f7fe640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b6bc0 0x7f6550071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f65549fa640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6550153790 0x7f655006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f654f7fe640 1 -- 172.21.15.88:0/203004408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6550153790 msgr2=0x7f655006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f654f7fe640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6550153790 0x7f655006fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f654f7fe640 1 -- 172.21.15.88:0/203004408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65500b25b0 msgr2=0x7f65500708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:09.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f654f7fe640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65500b25b0 0x7f65500708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:09.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.949+0000 7f654f7fe640 1 -- 172.21.15.88:0/203004408 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440094d0 con 0x7f65500b6bc0 2024-01-22T10:13:09.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.950+0000 7f1f3a504640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1f1806b400 0x7f1f1806d8c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1f24000f60 tx=0x7f1f24007880 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.950+0000 7f654f7fe640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b6bc0 0x7f6550071b10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6544033000 tx=0x7f65440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.950+0000 7fdb48ff9640 1 -- 172.21.15.88:0/3203660766 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fdb3c032070 con 0x7fdb4c1dc640 2024-01-22T10:13:09.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.950+0000 7fdb48ff9640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fdb3806b400 0x7fdb3806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.950+0000 7fdb4b7fe640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fdb3806b400 0x7fdb3806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.950+0000 7fdb48ff9640 1 -- 172.21.15.88:0/3203660766 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb3c0aab50 con 0x7fdb4c1dc640 2024-01-22T10:13:09.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.950+0000 7fdb4b7fe640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fdb3806b400 0x7fdb3806d8c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb40001eb0 tx=0x7fdb40001c30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.951+0000 7f1f2affd640 1 -- 172.21.15.88:0/1222417112 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1f30055220 con 0x7f1f2c0090f0 2024-01-22T10:13:09.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.954+0000 7f654cff9640 1 -- 172.21.15.88:0/203004408 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544033bf0 con 0x7f65500b6bc0 2024-01-22T10:13:09.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.955+0000 7f654cff9640 1 -- 172.21.15.88:0/203004408 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6544033d90 con 0x7f65500b6bc0 2024-01-22T10:13:09.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.955+0000 7f654cff9640 1 -- 172.21.15.88:0/203004408 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654403c640 con 0x7f65500b6bc0 2024-01-22T10:13:09.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.955+0000 7f655645d640 1 -- 172.21.15.88:0/203004408 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655006f650 con 0x7f65500b6bc0 2024-01-22T10:13:09.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.955+0000 7f655645d640 1 -- 172.21.15.88:0/203004408 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6550072050 con 0x7f65500b6bc0 2024-01-22T10:13:09.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.955+0000 7fdb48ff9640 1 -- 172.21.15.88:0/3203660766 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdb3c075880 con 0x7fdb4c1dc640 2024-01-22T10:13:09.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.955+0000 7f448bfff640 1 -- 172.21.15.88:0/3607371470 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f44a00cf510 con 0x7f44900092c0 2024-01-22T10:13:09.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.955+0000 7ff2467fc640 1 -- 172.21.15.88:0/3946517952 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff248080070 con 0x7ff2500b2c80 2024-01-22T10:13:09.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.956+0000 7f655645d640 1 -- 172.21.15.88:0/203004408 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655006f840 con 0x7f65500b6bc0 2024-01-22T10:13:09.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.958+0000 7f50ff7fe640 1 -- 172.21.15.88:0/744826091 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f5110007070 con 0x7f511806b900 2024-01-22T10:13:09.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.957+0000 7f654cff9640 1 -- 172.21.15.88:0/203004408 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f654403a040 con 0x7f65500b6bc0 2024-01-22T10:13:09.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.957+0000 7f654cff9640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f653c06b330 0x7f653c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.957+0000 7f654cff9640 1 -- 172.21.15.88:0/203004408 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65440ab6b0 con 0x7f65500b6bc0 2024-01-22T10:13:09.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.958+0000 7f654ffff640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f653c06b330 0x7f653c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.959+0000 7f50ff7fe640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f510406b400 0x7f510406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:09.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.958+0000 7f654ffff640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f653c06b330 0x7f653c06d7f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6540000f60 tx=0x7f6540007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.959+0000 7f50ff7fe640 1 -- 172.21.15.88:0/744826091 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5110089f60 con 0x7f511806b900 2024-01-22T10:13:09.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.959+0000 7f51167fc640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f510406b400 0x7f510406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:09.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.960+0000 7efc83fff640 1 -- 172.21.15.88:0/1632980736 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7efc980f1500 con 0x7efc900caf50 2024-01-22T10:13:09.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.960+0000 7f51167fc640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f510406b400 0x7f510406d8c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f510c006fd0 tx=0x7f510c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:09.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.965+0000 7f50ff7fe640 1 -- 172.21.15.88:0/744826091 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f51100b70d0 con 0x7f511806b900 2024-01-22T10:13:09.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:09.964+0000 7f654cff9640 1 -- 172.21.15.88:0/203004408 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6544076450 con 0x7f65500b6bc0 2024-01-22T10:13:10.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.292+0000 7f3706bde640 1 -- 172.21.15.88:0/4033265800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f36e0005540 con 0x7f370015c400 2024-01-22T10:13:10.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.293+0000 7f36fd7fa640 1 -- 172.21.15.88:0/4033265800 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36f8057be0 con 0x7f370015c400 2024-01-22T10:13:10.275 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-01-22T10:13:10.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.296+0000 7f36e6ffd640 1 -- 172.21.15.88:0/4033265800 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f36e806b540 msgr2=0x7f36e806da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.296+0000 7f36e6ffd640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f36e806b540 0x7f36e806da00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f36f0047000 tx=0x7f36f0041000 comp rx=0 tx=0).stop 2024-01-22T10:13:10.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.296+0000 7f36e6ffd640 1 -- 172.21.15.88:0/4033265800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f370015c400 msgr2=0x7f3700070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.296+0000 7f36e6ffd640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f370015c400 0x7f3700070b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f36f800f7b0 tx=0x7f36f800fc70 comp rx=0 tx=0).stop 2024-01-22T10:13:10.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.296+0000 7f36e6ffd640 1 -- 172.21.15.88:0/4033265800 shutdown_connections 2024-01-22T10:13:10.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.296+0000 7f36e6ffd640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f36e806b540 0x7f36e806da00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.297+0000 7f36e6ffd640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f37000702e0 0x7f3700071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.297+0000 7f36e6ffd640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f370015c400 0x7f3700070b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.297+0000 7f36e6ffd640 1 --2- 172.21.15.88:0/4033265800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37000b39e0 0x7f370020fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.297+0000 7f36e6ffd640 1 -- 172.21.15.88:0/4033265800 >> 172.21.15.88:0/4033265800 conn(0x7f370006a8d0 msgr2=0x7f37000bb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:10.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.297+0000 7f36e6ffd640 1 -- 172.21.15.88:0/4033265800 shutdown_connections 2024-01-22T10:13:10.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.297+0000 7f36e6ffd640 1 -- 172.21.15.88:0/4033265800 wait complete. 2024-01-22T10:13:10.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-01-22T10:13:10.296 DEBUG:teuthology.parallel:result is None 2024-01-22T10:13:10.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.335+0000 7f5117fff640 1 -- 172.21.15.88:0/744826091 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f50f8005810 con 0x7f511806b900 2024-01-22T10:13:10.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.335+0000 7f50ff7fe640 1 -- 172.21.15.88:0/744826091 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5110017090 con 0x7f511806b900 2024-01-22T10:13:10.318 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-01-22T10:13:10.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.337+0000 7f5117fff640 1 -- 172.21.15.88:0/744826091 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f510406b400 msgr2=0x7f510406d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.337+0000 7f5117fff640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f510406b400 0x7f510406d8c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f510c006fd0 tx=0x7f510c008040 comp rx=0 tx=0).stop 2024-01-22T10:13:10.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.337+0000 7f5117fff640 1 -- 172.21.15.88:0/744826091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511806b900 msgr2=0x7f511809fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.337+0000 7f5117fff640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511806b900 0x7f511809fcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f511000cba0 tx=0x7f511000a430 comp rx=0 tx=0).stop 2024-01-22T10:13:10.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.337+0000 7f5117fff640 1 -- 172.21.15.88:0/744826091 shutdown_connections 2024-01-22T10:13:10.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.337+0000 7f5117fff640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f510406b400 0x7f510406d8c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.337+0000 7f5117fff640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f511806d450 0x7f511806f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.337+0000 7f5117fff640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51180708a0 0x7f5118070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.337+0000 7f5117fff640 1 --2- 172.21.15.88:0/744826091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511806b900 0x7f511809fcd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.337+0000 7f5117fff640 1 -- 172.21.15.88:0/744826091 >> 172.21.15.88:0/744826091 conn(0x7f51180bc8e0 msgr2=0x7f511809d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:10.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.337+0000 7f5117fff640 1 -- 172.21.15.88:0/744826091 shutdown_connections 2024-01-22T10:13:10.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.337+0000 7f5117fff640 1 -- 172.21.15.88:0/744826091 wait complete. 2024-01-22T10:13:10.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-01-22T10:13:10.331 DEBUG:teuthology.parallel:result is None 2024-01-22T10:13:10.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.355+0000 7f1f3b506640 1 -- 172.21.15.88:0/1222417112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1f2c0057d0 con 0x7f1f2c0090f0 2024-01-22T10:13:10.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.355+0000 7f1f2affd640 1 -- 172.21.15.88:0/1222417112 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f30017090 con 0x7f1f2c0090f0 2024-01-22T10:13:10.338 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-01-22T10:13:10.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb4c070ae0 con 0x7fdb4c1dc640 2024-01-22T10:13:10.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f1f3b506640 1 -- 172.21.15.88:0/1222417112 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1f1806b400 msgr2=0x7f1f1806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4498005390 con 0x7f44900092c0 2024-01-22T10:13:10.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f1f3b506640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1f1806b400 0x7f1f1806d8c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1f24000f60 tx=0x7f1f24007880 comp rx=0 tx=0).stop 2024-01-22T10:13:10.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f1f3b506640 1 -- 172.21.15.88:0/1222417112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f2c0090f0 msgr2=0x7f1f2c0d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f1f3b506640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f2c0090f0 0x7f1f2c0d2130 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000e870 tx=0x7f1f3000ed30 comp rx=0 tx=0).stop 2024-01-22T10:13:10.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f1f3b506640 1 -- 172.21.15.88:0/1222417112 shutdown_connections 2024-01-22T10:13:10.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f1f3b506640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1f1806b400 0x7f1f1806d8c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f1f3b506640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2c0cfa30 0x7f1f2c0d09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f1f3b506640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f2c0090f0 0x7f1f2c0d2130 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.359+0000 7fdb48ff9640 1 -- 172.21.15.88:0/3203660766 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb3c045070 con 0x7fdb4c1dc640 2024-01-22T10:13:10.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f1f3b506640 1 --2- 172.21.15.88:0/1222417112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f2c008950 0x7f1f2c036bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f1f3b506640 1 -- 172.21.15.88:0/1222417112 >> 172.21.15.88:0/1222417112 conn(0x7f1f2c007bf0 msgr2=0x7f1f2c03ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:10.343 INFO:teuthology.orchestra.run.smithi088.stdout:55834574854 2024-01-22T10:13:10.344 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-01-22T10:13:10.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.359+0000 7f448bfff640 1 -- 172.21.15.88:0/3607371470 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44a0097020 con 0x7f44900092c0 2024-01-22T10:13:10.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f1f3b506640 1 -- 172.21.15.88:0/1222417112 shutdown_connections 2024-01-22T10:13:10.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.358+0000 7f1f3b506640 1 -- 172.21.15.88:0/1222417112 wait complete. 2024-01-22T10:13:10.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f448406b3b0 msgr2=0x7f448406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7f44a4edc640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f448406b3b0 0x7f448406d870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4498005aa0 tx=0x7f448c008040 comp rx=0 tx=0).stop 2024-01-22T10:13:10.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44900092c0 msgr2=0x7f44981621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7f44a4edc640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44900092c0 0x7f44981621e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f44a00641c0 tx=0x7f44a006bad0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7ff256bb3640 1 -- 172.21.15.88:0/3946517952 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff2500bbc70 con 0x7ff2500b2c80 2024-01-22T10:13:10.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fdb3806b400 msgr2=0x7fdb3806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7fdb51542640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fdb3806b400 0x7fdb3806d8c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb40001eb0 tx=0x7fdb40001c30 comp rx=0 tx=0).stop 2024-01-22T10:13:10.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb4c1dc640 msgr2=0x7fdb4c1d8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7fdb51542640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb4c1dc640 0x7fdb4c1d8510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c007e30 tx=0x7fdb3c001680 comp rx=0 tx=0).stop 2024-01-22T10:13:10.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 shutdown_connections 2024-01-22T10:13:10.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7fdb51542640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fdb3806b400 0x7fdb3806d8c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7fdb51542640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb4c070d50 0x7fdb4c0711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7fdb51542640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb4c06feb0 0x7fdb4c1d8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7fdb51542640 1 --2- 172.21.15.88:0/3203660766 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb4c1dc640 0x7fdb4c1d8510 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 >> 172.21.15.88:0/3203660766 conn(0x7fdb4c0bd7f0 msgr2=0x7fdb4c0b9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:10.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 shutdown_connections 2024-01-22T10:13:10.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7f44a4edc640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f448406b3b0 0x7f448406d870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7f44a4edc640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4498030ab0 0x7f4498030f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7f44a4edc640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44980c9df0 0x7f4498037490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7f44a4edc640 1 --2- 172.21.15.88:0/3607371470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44900092c0 0x7f44981621e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 >> 172.21.15.88:0/3607371470 conn(0x7f449803ee20 msgr2=0x7f4498033de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:10.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 shutdown_connections 2024-01-22T10:13:10.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7fdb51542640 1 -- 172.21.15.88:0/3203660766 wait complete. 2024-01-22T10:13:10.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.362+0000 7ff2467fc640 1 -- 172.21.15.88:0/3946517952 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff248043070 con 0x7ff2500b2c80 2024-01-22T10:13:10.349 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-01-22T10:13:10.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.363+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 shutdown_connections 2024-01-22T10:13:10.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.363+0000 7f44a4edc640 1 -- 172.21.15.88:0/3607371470 wait complete. 2024-01-22T10:13:10.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.364+0000 7efc9dc97640 1 -- 172.21.15.88:0/1632980736 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efc90028c20 con 0x7efc900caf50 2024-01-22T10:13:10.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.365+0000 7efc83fff640 1 -- 172.21.15.88:0/1632980736 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc980f4b20 con 0x7efc900caf50 2024-01-22T10:13:10.350 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-01-22T10:13:10.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.366+0000 7ff256bb3640 1 -- 172.21.15.88:0/3946517952 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff23406b330 msgr2=0x7ff23406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.366+0000 7ff256bb3640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff23406b330 0x7ff23406d7f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff250068050 tx=0x7ff240009040 comp rx=0 tx=0).stop 2024-01-22T10:13:10.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.366+0000 7ff256bb3640 1 -- 172.21.15.88:0/3946517952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2500b2c80 msgr2=0x7ff2500a2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.366+0000 7ff256bb3640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2500b2c80 0x7ff2500a2900 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff248036040 tx=0x7ff248004a40 comp rx=0 tx=0).stop 2024-01-22T10:13:10.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.367+0000 7ff256bb3640 1 -- 172.21.15.88:0/3946517952 shutdown_connections 2024-01-22T10:13:10.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.367+0000 7ff256bb3640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff23406b330 0x7ff23406d7f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.367+0000 7ff256bb3640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff250149c50 0x7ff25014c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.367+0000 7ff256bb3640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2500b30c0 0x7ff25014eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.367+0000 7ff256bb3640 1 --2- 172.21.15.88:0/3946517952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2500b2c80 0x7ff2500a2900 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.367+0000 7ff256bb3640 1 -- 172.21.15.88:0/3946517952 >> 172.21.15.88:0/3946517952 conn(0x7ff2500bd1a0 msgr2=0x7ff250071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:10.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.367+0000 7ff256bb3640 1 -- 172.21.15.88:0/3946517952 shutdown_connections 2024-01-22T10:13:10.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.367+0000 7ff256bb3640 1 -- 172.21.15.88:0/3946517952 wait complete. 2024-01-22T10:13:10.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.368+0000 7f655645d640 1 -- 172.21.15.88:0/203004408 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f655004ea30 con 0x7f65500b6bc0 2024-01-22T10:13:10.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.368+0000 7efc9dc97640 1 -- 172.21.15.88:0/1632980736 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7efc7c06b380 msgr2=0x7efc7c06d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.369+0000 7efc9dc97640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7efc7c06b380 0x7efc7c06d840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc8c006fd0 tx=0x7efc8c008040 comp rx=0 tx=0).stop 2024-01-22T10:13:10.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.369+0000 7efc9dc97640 1 -- 172.21.15.88:0/1632980736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc900caf50 msgr2=0x7efc900cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.369+0000 7efc9dc97640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc900caf50 0x7efc900cbcd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efc9806a570 tx=0x7efc980757b0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.369+0000 7efc9dc97640 1 -- 172.21.15.88:0/1632980736 shutdown_connections 2024-01-22T10:13:10.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.369+0000 7efc9dc97640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7efc7c06b380 0x7efc7c06d840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.369+0000 7efc9dc97640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc900caf50 0x7efc900cbcd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.369+0000 7efc9dc97640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9003d890 0x7efc9003c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.369+0000 7efc9dc97640 1 --2- 172.21.15.88:0/1632980736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc90007190 0x7efc90163b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.369+0000 7efc9dc97640 1 -- 172.21.15.88:0/1632980736 >> 172.21.15.88:0/1632980736 conn(0x7efc9003f720 msgr2=0x7efc90025bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:10.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.369+0000 7efc9dc97640 1 -- 172.21.15.88:0/1632980736 shutdown_connections 2024-01-22T10:13:10.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.369+0000 7efc9dc97640 1 -- 172.21.15.88:0/1632980736 wait complete. 2024-01-22T10:13:10.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.369+0000 7f654cff9640 1 -- 172.21.15.88:0/203004408 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6544079a70 con 0x7f65500b6bc0 2024-01-22T10:13:10.354 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-01-22T10:13:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.371+0000 7f655645d640 1 -- 172.21.15.88:0/203004408 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f653c06b330 msgr2=0x7f653c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.371+0000 7f655645d640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f653c06b330 0x7f653c06d7f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6540000f60 tx=0x7f6540007ec0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.371+0000 7f655645d640 1 -- 172.21.15.88:0/203004408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b6bc0 msgr2=0x7f6550071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.371+0000 7f655645d640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b6bc0 0x7f6550071b10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6544033000 tx=0x7f65440046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.371+0000 7f655645d640 1 -- 172.21.15.88:0/203004408 shutdown_connections 2024-01-22T10:13:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.371+0000 7f655645d640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f653c06b330 0x7f653c06d7f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.372+0000 7f655645d640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65500b6bc0 0x7f6550071b10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.372+0000 7f655645d640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6550153790 0x7f655006fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.372+0000 7f655645d640 1 --2- 172.21.15.88:0/203004408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65500b25b0 0x7f65500708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.372+0000 7f655645d640 1 -- 172.21.15.88:0/203004408 >> 172.21.15.88:0/203004408 conn(0x7f655006acf0 msgr2=0x7f65500b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:10.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.372+0000 7f655645d640 1 -- 172.21.15.88:0/203004408 shutdown_connections 2024-01-22T10:13:10.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.372+0000 7f655645d640 1 -- 172.21.15.88:0/203004408 wait complete. 2024-01-22T10:13:10.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-01-22T10:13:10.360 DEBUG:teuthology.parallel:result is None 2024-01-22T10:13:10.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-01-22T10:13:10.362 DEBUG:teuthology.parallel:result is None 2024-01-22T10:13:10.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-01-22T10:13:10.364 DEBUG:teuthology.parallel:result is None 2024-01-22T10:13:10.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-01-22T10:13:10.366 DEBUG:teuthology.parallel:result is None 2024-01-22T10:13:10.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-01-22T10:13:10.369 DEBUG:teuthology.parallel:result is None 2024-01-22T10:13:10.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-01-22T10:13:10.370 DEBUG:teuthology.parallel:result is None 2024-01-22T10:13:10.370 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-22T10:13:10.370 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T10:13:10.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.528+0000 7fb00a65c640 1 Processor -- start 2024-01-22T10:13:10.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.528+0000 7fb00a65c640 1 -- start start 2024-01-22T10:13:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.528+0000 7fb00a65c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0040b3630 0x7fb0040bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.528+0000 7fb00a65c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb00414c070 0x7fb004152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.528+0000 7fb00a65c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0040b4e80 con 0x7fb0040b49c0 2024-01-22T10:13:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.528+0000 7fb00a65c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0040b5370 con 0x7fb00414c070 2024-01-22T10:13:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.528+0000 7fb00a65c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040b5fd0 con 0x7fb0040b3630 2024-01-22T10:13:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.528+0000 7fb0037fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb0040b49c0 0x7fb00414b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41996/0 (socket says 172.21.15.88:41996) 2024-01-22T10:13:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.528+0000 7fb0037fe640 1 -- 172.21.15.88:0/1175096921 learned_addr learned my addr 172.21.15.88:0/1175096921 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:10.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb008bf9640 1 --2- 172.21.15.88:0/1175096921 >> v2:172.21.15.119:3300/0 conn(0x7fb00414c070 0x7fb004152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb003fff640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0040b3630 0x7fb0040bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601669940 0 0) 0x7fb0040b4e80 con 0x7fb0040b49c0 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafec003520 con 0x7fb0040b49c0 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2185403347 0 0) 0x7fafec003520 con 0x7fb0040b49c0 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0040b3630 msgr2=0x7fb0040bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0040b3630 0x7fb0040bd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 >> v2:172.21.15.119:3300/0 conn(0x7fb00414c070 msgr2=0x7fb004152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 --2- 172.21.15.88:0/1175096921 >> v2:172.21.15.119:3300/0 conn(0x7fb00414c070 0x7fb004152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040b6590 con 0x7fb0040b49c0 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7faff4001670 con 0x7fb0040b49c0 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb008bf9640 1 --2- 172.21.15.88:0/1175096921 >> v2:172.21.15.119:3300/0 conn(0x7fb00414c070 0x7fb004152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 >> v1:172.21.15.88:6789/0 conn(0x7fb0040b49c0 legacy=0x7fb00414b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafec003a50 0x7fafec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0040b3630 0x7fafec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafec004d00 0x7fafec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040b5fd0 con 0x7fafec003a50 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec00b980 con 0x7fafec004d00 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec00baf0 con 0x7fb0040b3630 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb003fff640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafec003a50 0x7fafec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb0037fe640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0040b3630 0x7fafec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb008bf9640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafec004d00 0x7fafec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb003fff640 1 -- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0040b3630 msgr2=0x7fafec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb003fff640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0040b3630 0x7fafec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb003fff640 1 -- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafec004d00 msgr2=0x7fafec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb003fff640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafec004d00 0x7fafec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb003fff640 1 -- 172.21.15.88:0/1175096921 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec003520 con 0x7fafec003a50 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb0037fe640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0040b3630 0x7fafec0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:10.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.529+0000 7fb008bf9640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafec004d00 0x7fafec005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:10.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.530+0000 7fb003fff640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafec003a50 0x7fafec003e70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faff8009ac0 tx=0x7fafec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6c212c023de828 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:10.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.530+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff802c6b0 con 0x7fafec003a50 2024-01-22T10:13:10.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.530+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff802c810 con 0x7fafec003a50 2024-01-22T10:13:10.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.530+0000 7fb002ffd640 1 -- 172.21.15.88:0/1175096921 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff802cba0 con 0x7fafec003a50 2024-01-22T10:13:10.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.531+0000 7fb00a65c640 1 -- 172.21.15.88:0/1175096921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafec003a50 msgr2=0x7fafec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.531+0000 7fb00a65c640 1 --2- 172.21.15.88:0/1175096921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafec003a50 0x7fafec003e70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faff8009ac0 tx=0x7fafec0057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.531+0000 7fb008bf9640 1 -- 172.21.15.88:0/1175096921 reap_dead start 2024-01-22T10:13:10.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.531+0000 7fb00a65c640 1 -- 172.21.15.88:0/1175096921 shutdown_connections 2024-01-22T10:13:10.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.531+0000 7fb00a65c640 1 -- 172.21.15.88:0/1175096921 >> 172.21.15.88:0/1175096921 conn(0x7fb00406acf0 msgr2=0x7fb0040bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:10.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.531+0000 7fb00a65c640 1 -- 172.21.15.88:0/1175096921 shutdown_connections 2024-01-22T10:13:10.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.531+0000 7fb00a65c640 1 -- 172.21.15.88:0/1175096921 wait complete. 2024-01-22T10:13:10.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.532+0000 7fb00a65c640 1 Processor -- start 2024-01-22T10:13:10.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.532+0000 7fb00a65c640 1 -- start start 2024-01-22T10:13:10.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb00a65c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafec003a50 0x7fb004147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb00a65c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0040bc340 0x7fb0040bb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb00a65c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb00413c040 0x7fb00413c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb00a65c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb004147e40 con 0x7fb00413c040 2024-01-22T10:13:10.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb00a65c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040baf50 con 0x7fb0040bc340 2024-01-22T10:13:10.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb00a65c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040bca90 con 0x7fafec003a50 2024-01-22T10:13:10.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb008bf9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb00413c040 0x7fb00413c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb008bf9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb00413c040 0x7fb00413c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43952/0 (socket says 172.21.15.88:43952) 2024-01-22T10:13:10.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb008bf9640 1 -- 172.21.15.88:0/148100303 learned_addr learned my addr 172.21.15.88:0/148100303 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb0037fe640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0040bc340 0x7fb0040bb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb003fff640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafec003a50 0x7fb004147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb008bf9640 1 -- 172.21.15.88:0/148100303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafec003a50 msgr2=0x7fb004147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb008bf9640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafec003a50 0x7fb004147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb008bf9640 1 -- 172.21.15.88:0/148100303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0040bc340 msgr2=0x7fb0040bb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb008bf9640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0040bc340 0x7fb0040bb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb008bf9640 1 -- 172.21.15.88:0/148100303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040bd290 con 0x7fb00413c040 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb008bf9640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb00413c040 0x7fb00413c4c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb004142cd0 tx=0x7faffc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb000ff9640 1 -- 172.21.15.88:0/148100303 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc00e070 con 0x7fb00413c040 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb000ff9640 1 -- 172.21.15.88:0/148100303 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc011ed0 con 0x7fb00413c040 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb00a65c640 1 -- 172.21.15.88:0/148100303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0040bd570 con 0x7fb00413c040 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb000ff9640 1 -- 172.21.15.88:0/148100303 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc003990 con 0x7fb00413c040 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.533+0000 7fb00a65c640 1 -- 172.21.15.88:0/148100303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0041d29d0 con 0x7fb00413c040 2024-01-22T10:13:10.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.534+0000 7fb00a65c640 1 -- 172.21.15.88:0/148100303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00404ea30 con 0x7fb00413c040 2024-01-22T10:13:10.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.535+0000 7fb000ff9640 1 -- 172.21.15.88:0/148100303 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7faffc003af0 con 0x7fb00413c040 2024-01-22T10:13:10.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.535+0000 7fb000ff9640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7faff006b330 0x7faff006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.535+0000 7fb000ff9640 1 -- 172.21.15.88:0/148100303 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faffc08a1b0 con 0x7fb00413c040 2024-01-22T10:13:10.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.535+0000 7fb003fff640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7faff006b330 0x7faff006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.536+0000 7fb003fff640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7faff006b330 0x7faff006d7f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faff8009ac0 tx=0x7faff8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:10.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.539+0000 7fb000ff9640 1 -- 172.21.15.88:0/148100303 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7faffc054f80 con 0x7fb00413c040 2024-01-22T10:13:10.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.707+0000 7fb00a65c640 1 -- 172.21.15.88:0/148100303 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0040b2e70 con 0x7faff006b330 2024-01-22T10:13:10.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.713+0000 7fb000ff9640 1 -- 172.21.15.88:0/148100303 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264591 (secure 0 0 0) 0x7fb0040b2e70 con 0x7faff006b330 2024-01-22T10:13:10.699 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:10.700 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-01-22T10:13:10.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.716+0000 7fb00a65c640 1 -- 172.21.15.88:0/148100303 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7faff006b330 msgr2=0x7faff006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.716+0000 7fb00a65c640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7faff006b330 0x7faff006d7f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faff8009ac0 tx=0x7faff8030000 comp rx=0 tx=0).stop 2024-01-22T10:13:10.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.716+0000 7fb00a65c640 1 -- 172.21.15.88:0/148100303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb00413c040 msgr2=0x7fb00413c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.716+0000 7fb00a65c640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb00413c040 0x7fb00413c4c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb004142cd0 tx=0x7faffc0115a0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.716+0000 7fb00a65c640 1 -- 172.21.15.88:0/148100303 shutdown_connections 2024-01-22T10:13:10.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.716+0000 7fb00a65c640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7faff006b330 0x7faff006d7f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.716+0000 7fb00a65c640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb00413c040 0x7fb00413c4c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.716+0000 7fb00a65c640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0040bc340 0x7fb0040bb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.716+0000 7fb00a65c640 1 --2- 172.21.15.88:0/148100303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fafec003a50 0x7fb004147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.716+0000 7fb00a65c640 1 -- 172.21.15.88:0/148100303 >> 172.21.15.88:0/148100303 conn(0x7fb00406acf0 msgr2=0x7fb004149740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:10.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.716+0000 7fb00a65c640 1 -- 172.21.15.88:0/148100303 shutdown_connections 2024-01-22T10:13:10.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.716+0000 7fb00a65c640 1 -- 172.21.15.88:0/148100303 wait complete. 2024-01-22T10:13:10.709 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-01-22T10:13:10.706900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001772"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483437+0000","last_change":"2024-01-22T10:13:03.492920+0000","last_active":"2024-01-22T10:13:04.483437+0000","last_peered":"2024-01-22T10:13:04.483437+0000","last_clean":"2024-01-22T10:13:04.483437+0000","last_became_active":"2024-01-22T10:13:03.492631+0000","last_became_peered":"2024-01-22T10:13:03.492631+0000","last_unstale":"2024-01-22T10:13:04.483437+0000","last_undegraded":"2024-01-22T10:13:04.483437+0000","last_fullsized":"2024-01-22T10:13:04.483437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:32:21.868617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484560+0000","last_change":"2024-01-22T10:13:03.495752+0000","last_active":"2024-01-22T10:13:04.484560+0000","last_peered":"2024-01-22T10:13:04.484560+0000","last_clean":"2024-01-22T10:13:04.484560+0000","last_became_active":"2024-01-22T10:13:03.495494+0000","last_became_peered":"2024-01-22T10:13:03.495494+0000","last_unstale":"2024-01-22T10:13:04.484560+0000","last_undegraded":"2024-01-22T10:13:04.484560+0000","last_fullsized":"2024-01-22T10:13:04.484560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652381+0000","last_change":"2024-01-22T10:13:03.493655+0000","last_active":"2024-01-22T10:13:04.652381+0000","last_peered":"2024-01-22T10:13:04.652381+0000","last_clean":"2024-01-22T10:13:04.652381+0000","last_became_active":"2024-01-22T10:13:03.493392+0000","last_became_peered":"2024-01-22T10:13:03.493392+0000","last_unstale":"2024-01-22T10:13:04.652381+0000","last_undegraded":"2024-01-22T10:13:04.652381+0000","last_fullsized":"2024-01-22T10:13:04.652381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:14:37.672922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509717+0000","last_change":"2024-01-22T10:13:03.499002+0000","last_active":"2024-01-22T10:13:04.509717+0000","last_peered":"2024-01-22T10:13:04.509717+0000","last_clean":"2024-01-22T10:13:04.509717+0000","last_became_active":"2024-01-22T10:13:03.498671+0000","last_became_peered":"2024-01-22T10:13:03.498671+0000","last_unstale":"2024-01-22T10:13:04.509717+0000","last_undegraded":"2024-01-22T10:13:04.509717+0000","last_fullsized":"2024-01-22T10:13:04.509717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:23.433091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483030+0000","last_change":"2024-01-22T10:13:03.491947+0000","last_active":"2024-01-22T10:13:04.483030+0000","last_peered":"2024-01-22T10:13:04.483030+0000","last_clean":"2024-01-22T10:13:04.483030+0000","last_became_active":"2024-01-22T10:13:03.491661+0000","last_became_peered":"2024-01-22T10:13:03.491661+0000","last_unstale":"2024-01-22T10:13:04.483030+0000","last_undegraded":"2024-01-22T10:13:04.483030+0000","last_fullsized":"2024-01-22T10:13:04.483030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:01:27.029405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509675+0000","last_change":"2024-01-22T10:13:03.499247+0000","last_active":"2024-01-22T10:13:04.509675+0000","last_peered":"2024-01-22T10:13:04.509675+0000","last_clean":"2024-01-22T10:13:04.509675+0000","last_became_active":"2024-01-22T10:13:03.498924+0000","last_became_peered":"2024-01-22T10:13:03.498924+0000","last_unstale":"2024-01-22T10:13:04.509675+0000","last_undegraded":"2024-01-22T10:13:04.509675+0000","last_fullsized":"2024-01-22T10:13:04.509675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:28:38.011831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482686+0000","last_change":"2024-01-22T10:13:03.493236+0000","last_active":"2024-01-22T10:13:04.482686+0000","last_peered":"2024-01-22T10:13:04.482686+0000","last_clean":"2024-01-22T10:13:04.482686+0000","last_became_active":"2024-01-22T10:13:03.492833+0000","last_became_peered":"2024-01-22T10:13:03.492833+0000","last_unstale":"2024-01-22T10:13:04.482686+0000","last_undegraded":"2024-01-22T10:13:04.482686+0000","last_fullsized":"2024-01-22T10:13:04.482686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:18:49.293366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483516+0000","last_change":"2024-01-22T10:13:03.492762+0000","last_active":"2024-01-22T10:13:04.483516+0000","last_peered":"2024-01-22T10:13:04.483516+0000","last_clean":"2024-01-22T10:13:04.483516+0000","last_became_active":"2024-01-22T10:13:03.492488+0000","last_became_peered":"2024-01-22T10:13:03.492488+0000","last_unstale":"2024-01-22T10:13:04.483516+0000","last_undegraded":"2024-01-22T10:13:04.483516+0000","last_fullsized":"2024-01-22T10:13:04.483516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:43:22.787729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483554+0000","last_change":"2024-01-22T10:13:03.497140+0000","last_active":"2024-01-22T10:13:04.483554+0000","last_peered":"2024-01-22T10:13:04.483554+0000","last_clean":"2024-01-22T10:13:04.483554+0000","last_became_active":"2024-01-22T10:13:03.496752+0000","last_became_peered":"2024-01-22T10:13:03.496752+0000","last_unstale":"2024-01-22T10:13:04.483554+0000","last_undegraded":"2024-01-22T10:13:04.483554+0000","last_fullsized":"2024-01-22T10:13:04.483554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:23:47.110078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652900+0000","last_change":"2024-01-22T10:13:03.495067+0000","last_active":"2024-01-22T10:13:04.652900+0000","last_peered":"2024-01-22T10:13:04.652900+0000","last_clean":"2024-01-22T10:13:04.652900+0000","last_became_active":"2024-01-22T10:13:03.494818+0000","last_became_peered":"2024-01-22T10:13:03.494818+0000","last_unstale":"2024-01-22T10:13:04.652900+0000","last_undegraded":"2024-01-22T10:13:04.652900+0000","last_fullsized":"2024-01-22T10:13:04.652900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:08:01.408684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652679+0000","last_change":"2024-01-22T10:13:03.495113+0000","last_active":"2024-01-22T10:13:04.652679+0000","last_peered":"2024-01-22T10:13:04.652679+0000","last_clean":"2024-01-22T10:13:04.652679+0000","last_became_active":"2024-01-22T10:13:03.494856+0000","last_became_peered":"2024-01-22T10:13:03.494856+0000","last_unstale":"2024-01-22T10:13:04.652679+0000","last_undegraded":"2024-01-22T10:13:04.652679+0000","last_fullsized":"2024-01-22T10:13:04.652679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:33:39.926559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653345+0000","last_change":"2024-01-22T10:13:03.501906+0000","last_active":"2024-01-22T10:13:04.653345+0000","last_peered":"2024-01-22T10:13:04.653345+0000","last_clean":"2024-01-22T10:13:04.653345+0000","last_became_active":"2024-01-22T10:13:03.501078+0000","last_became_peered":"2024-01-22T10:13:03.501078+0000","last_unstale":"2024-01-22T10:13:04.653345+0000","last_undegraded":"2024-01-22T10:13:04.653345+0000","last_fullsized":"2024-01-22T10:13:04.653345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:26:13.650219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483870+0000","last_change":"2024-01-22T10:13:03.494825+0000","last_active":"2024-01-22T10:13:04.483870+0000","last_peered":"2024-01-22T10:13:04.483870+0000","last_clean":"2024-01-22T10:13:04.483870+0000","last_became_active":"2024-01-22T10:13:03.494556+0000","last_became_peered":"2024-01-22T10:13:03.494556+0000","last_unstale":"2024-01-22T10:13:04.483870+0000","last_undegraded":"2024-01-22T10:13:04.483870+0000","last_fullsized":"2024-01-22T10:13:04.483870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:28:38.011831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652251+0000","last_change":"2024-01-22T10:13:03.492859+0000","last_active":"2024-01-22T10:13:04.652251+0000","last_peered":"2024-01-22T10:13:04.652251+0000","last_clean":"2024-01-22T10:13:04.652251+0000","last_became_active":"2024-01-22T10:13:03.492628+0000","last_became_peered":"2024-01-22T10:13:03.492628+0000","last_unstale":"2024-01-22T10:13:04.652251+0000","last_undegraded":"2024-01-22T10:13:04.652251+0000","last_fullsized":"2024-01-22T10:13:04.652251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:20:16.627504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484299+0000","last_change":"2024-01-22T10:13:03.503667+0000","last_active":"2024-01-22T10:13:04.484299+0000","last_peered":"2024-01-22T10:13:04.484299+0000","last_clean":"2024-01-22T10:13:04.484299+0000","last_became_active":"2024-01-22T10:13:03.503409+0000","last_became_peered":"2024-01-22T10:13:03.503409+0000","last_unstale":"2024-01-22T10:13:04.484299+0000","last_undegraded":"2024-01-22T10:13:04.484299+0000","last_fullsized":"2024-01-22T10:13:04.484299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:33:39.926559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509589+0000","last_change":"2024-01-22T10:13:03.500155+0000","last_active":"2024-01-22T10:13:04.509589+0000","last_peered":"2024-01-22T10:13:04.509589+0000","last_clean":"2024-01-22T10:13:04.509589+0000","last_became_active":"2024-01-22T10:13:03.499892+0000","last_became_peered":"2024-01-22T10:13:03.499892+0000","last_unstale":"2024-01-22T10:13:04.509589+0000","last_undegraded":"2024-01-22T10:13:04.509589+0000","last_fullsized":"2024-01-22T10:13:04.509589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.510149+0000","last_change":"2024-01-22T10:13:03.501001+0000","last_active":"2024-01-22T10:13:04.510149+0000","last_peered":"2024-01-22T10:13:04.510149+0000","last_clean":"2024-01-22T10:13:04.510149+0000","last_became_active":"2024-01-22T10:13:03.500767+0000","last_became_peered":"2024-01-22T10:13:03.500767+0000","last_unstale":"2024-01-22T10:13:04.510149+0000","last_undegraded":"2024-01-22T10:13:04.510149+0000","last_fullsized":"2024-01-22T10:13:04.510149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:05:11.277521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652376+0000","last_change":"2024-01-22T10:13:03.492397+0000","last_active":"2024-01-22T10:13:04.652376+0000","last_peered":"2024-01-22T10:13:04.652376+0000","last_clean":"2024-01-22T10:13:04.652376+0000","last_became_active":"2024-01-22T10:13:03.492127+0000","last_became_peered":"2024-01-22T10:13:03.492127+0000","last_unstale":"2024-01-22T10:13:04.652376+0000","last_undegraded":"2024-01-22T10:13:04.652376+0000","last_fullsized":"2024-01-22T10:13:04.652376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:26:13.650219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483270+0000","last_change":"2024-01-22T10:13:03.491259+0000","last_active":"2024-01-22T10:13:04.483270+0000","last_peered":"2024-01-22T10:13:04.483270+0000","last_clean":"2024-01-22T10:13:04.483270+0000","last_became_active":"2024-01-22T10:13:03.489580+0000","last_became_peered":"2024-01-22T10:13:03.489580+0000","last_unstale":"2024-01-22T10:13:04.483270+0000","last_undegraded":"2024-01-22T10:13:04.483270+0000","last_fullsized":"2024-01-22T10:13:04.483270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:43:40.855210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652921+0000","last_change":"2024-01-22T10:13:03.506931+0000","last_active":"2024-01-22T10:13:04.652921+0000","last_peered":"2024-01-22T10:13:04.652921+0000","last_clean":"2024-01-22T10:13:04.652921+0000","last_became_active":"2024-01-22T10:13:03.505686+0000","last_became_peered":"2024-01-22T10:13:03.505686+0000","last_unstale":"2024-01-22T10:13:04.652921+0000","last_undegraded":"2024-01-22T10:13:04.652921+0000","last_fullsized":"2024-01-22T10:13:04.652921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652496+0000","last_change":"2024-01-22T10:13:03.496832+0000","last_active":"2024-01-22T10:13:04.652496+0000","last_peered":"2024-01-22T10:13:04.652496+0000","last_clean":"2024-01-22T10:13:04.652496+0000","last_became_active":"2024-01-22T10:13:03.496550+0000","last_became_peered":"2024-01-22T10:13:03.496550+0000","last_unstale":"2024-01-22T10:13:04.652496+0000","last_undegraded":"2024-01-22T10:13:04.652496+0000","last_fullsized":"2024-01-22T10:13:04.652496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:43:22.787729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509734+0000","last_change":"2024-01-22T10:13:03.503279+0000","last_active":"2024-01-22T10:13:04.509734+0000","last_peered":"2024-01-22T10:13:04.509734+0000","last_clean":"2024-01-22T10:13:04.509734+0000","last_became_active":"2024-01-22T10:13:03.502324+0000","last_became_peered":"2024-01-22T10:13:03.502324+0000","last_unstale":"2024-01-22T10:13:04.509734+0000","last_undegraded":"2024-01-22T10:13:04.509734+0000","last_fullsized":"2024-01-22T10:13:04.509734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:52:13.153249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483600+0000","last_change":"2024-01-22T10:13:03.504327+0000","last_active":"2024-01-22T10:13:04.483600+0000","last_peered":"2024-01-22T10:13:04.483600+0000","last_clean":"2024-01-22T10:13:04.483600+0000","last_became_active":"2024-01-22T10:13:03.504047+0000","last_became_peered":"2024-01-22T10:13:03.504047+0000","last_unstale":"2024-01-22T10:13:04.483600+0000","last_undegraded":"2024-01-22T10:13:04.483600+0000","last_fullsized":"2024-01-22T10:13:04.483600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:10:02.956052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509658+0000","last_change":"2024-01-22T10:13:03.499696+0000","last_active":"2024-01-22T10:13:04.509658+0000","last_peered":"2024-01-22T10:13:04.509658+0000","last_clean":"2024-01-22T10:13:04.509658+0000","last_became_active":"2024-01-22T10:13:03.499363+0000","last_became_peered":"2024-01-22T10:13:03.499363+0000","last_unstale":"2024-01-22T10:13:04.509658+0000","last_undegraded":"2024-01-22T10:13:04.509658+0000","last_fullsized":"2024-01-22T10:13:04.509658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483902+0000","last_change":"2024-01-22T10:13:03.504284+0000","last_active":"2024-01-22T10:13:04.483902+0000","last_peered":"2024-01-22T10:13:04.483902+0000","last_clean":"2024-01-22T10:13:04.483902+0000","last_became_active":"2024-01-22T10:13:03.504024+0000","last_became_peered":"2024-01-22T10:13:03.504024+0000","last_unstale":"2024-01-22T10:13:04.483902+0000","last_undegraded":"2024-01-22T10:13:04.483902+0000","last_fullsized":"2024-01-22T10:13:04.483902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:52:13.153249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653011+0000","last_change":"2024-01-22T10:13:03.496717+0000","last_active":"2024-01-22T10:13:04.653011+0000","last_peered":"2024-01-22T10:13:04.653011+0000","last_clean":"2024-01-22T10:13:04.653011+0000","last_became_active":"2024-01-22T10:13:03.496422+0000","last_became_peered":"2024-01-22T10:13:03.496422+0000","last_unstale":"2024-01-22T10:13:04.653011+0000","last_undegraded":"2024-01-22T10:13:04.653011+0000","last_fullsized":"2024-01-22T10:13:04.653011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484458+0000","last_change":"2024-01-22T10:13:03.491265+0000","last_active":"2024-01-22T10:13:04.484458+0000","last_peered":"2024-01-22T10:13:04.484458+0000","last_clean":"2024-01-22T10:13:04.484458+0000","last_became_active":"2024-01-22T10:13:03.490993+0000","last_became_peered":"2024-01-22T10:13:03.490993+0000","last_unstale":"2024-01-22T10:13:04.484458+0000","last_undegraded":"2024-01-22T10:13:04.484458+0000","last_fullsized":"2024-01-22T10:13:04.484458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483894+0000","last_change":"2024-01-22T10:13:03.504160+0000","last_active":"2024-01-22T10:13:04.483894+0000","last_peered":"2024-01-22T10:13:04.483894+0000","last_clean":"2024-01-22T10:13:04.483894+0000","last_became_active":"2024-01-22T10:13:03.503946+0000","last_became_peered":"2024-01-22T10:13:03.503946+0000","last_unstale":"2024-01-22T10:13:04.483894+0000","last_undegraded":"2024-01-22T10:13:04.483894+0000","last_fullsized":"2024-01-22T10:13:04.483894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:23.433091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652533+0000","last_change":"2024-01-22T10:13:03.497065+0000","last_active":"2024-01-22T10:13:04.652533+0000","last_peered":"2024-01-22T10:13:04.652533+0000","last_clean":"2024-01-22T10:13:04.652533+0000","last_became_active":"2024-01-22T10:13:03.496805+0000","last_became_peered":"2024-01-22T10:13:03.496805+0000","last_unstale":"2024-01-22T10:13:04.652533+0000","last_undegraded":"2024-01-22T10:13:04.652533+0000","last_fullsized":"2024-01-22T10:13:04.652533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:33:39.926559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509854+0000","last_change":"2024-01-22T10:13:03.499866+0000","last_active":"2024-01-22T10:13:04.509854+0000","last_peered":"2024-01-22T10:13:04.509854+0000","last_clean":"2024-01-22T10:13:04.509854+0000","last_became_active":"2024-01-22T10:13:03.499534+0000","last_became_peered":"2024-01-22T10:13:03.499534+0000","last_unstale":"2024-01-22T10:13:04.509854+0000","last_undegraded":"2024-01-22T10:13:04.509854+0000","last_fullsized":"2024-01-22T10:13:04.509854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:59:10.835472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652166+0000","last_change":"2024-01-22T10:13:03.495017+0000","last_active":"2024-01-22T10:13:04.652166+0000","last_peered":"2024-01-22T10:13:04.652166+0000","last_clean":"2024-01-22T10:13:04.652166+0000","last_became_active":"2024-01-22T10:13:03.494765+0000","last_became_peered":"2024-01-22T10:13:03.494765+0000","last_unstale":"2024-01-22T10:13:04.652166+0000","last_undegraded":"2024-01-22T10:13:04.652166+0000","last_fullsized":"2024-01-22T10:13:04.652166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:28:12.828318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652480+0000","last_change":"2024-01-22T10:13:03.496343+0000","last_active":"2024-01-22T10:13:04.652480+0000","last_peered":"2024-01-22T10:13:04.652480+0000","last_clean":"2024-01-22T10:13:04.652480+0000","last_became_active":"2024-01-22T10:13:03.496071+0000","last_became_peered":"2024-01-22T10:13:03.496071+0000","last_unstale":"2024-01-22T10:13:04.652480+0000","last_undegraded":"2024-01-22T10:13:04.652480+0000","last_fullsized":"2024-01-22T10:13:04.652480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:14:37.672922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652604+0000","last_change":"2024-01-22T10:13:03.499195+0000","last_active":"2024-01-22T10:13:04.652604+0000","last_peered":"2024-01-22T10:13:04.652604+0000","last_clean":"2024-01-22T10:13:04.652604+0000","last_became_active":"2024-01-22T10:13:03.498657+0000","last_became_peered":"2024-01-22T10:13:03.498657+0000","last_unstale":"2024-01-22T10:13:04.652604+0000","last_undegraded":"2024-01-22T10:13:04.652604+0000","last_fullsized":"2024-01-22T10:13:04.652604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:52:50.082332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483961+0000","last_change":"2024-01-22T10:13:02.508626+0000","last_active":"2024-01-22T10:13:04.483961+0000","last_peered":"2024-01-22T10:13:04.483961+0000","last_clean":"2024-01-22T10:13:04.483961+0000","last_became_active":"2024-01-22T10:13:02.508377+0000","last_became_peered":"2024-01-22T10:13:02.508377+0000","last_unstale":"2024-01-22T10:13:04.483961+0000","last_undegraded":"2024-01-22T10:13:04.483961+0000","last_fullsized":"2024-01-22T10:13:04.483961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:55:15.314732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652615+0000","last_change":"2024-01-22T10:13:03.501315+0000","last_active":"2024-01-22T10:13:04.652615+0000","last_peered":"2024-01-22T10:13:04.652615+0000","last_clean":"2024-01-22T10:13:04.652615+0000","last_became_active":"2024-01-22T10:13:03.501151+0000","last_became_peered":"2024-01-22T10:13:03.501151+0000","last_unstale":"2024-01-22T10:13:04.652615+0000","last_undegraded":"2024-01-22T10:13:04.652615+0000","last_fullsized":"2024-01-22T10:13:04.652615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652770+0000","last_change":"2024-01-22T10:13:02.517526+0000","last_active":"2024-01-22T10:13:04.652770+0000","last_peered":"2024-01-22T10:13:04.652770+0000","last_clean":"2024-01-22T10:13:04.652770+0000","last_became_active":"2024-01-22T10:13:02.517235+0000","last_became_peered":"2024-01-22T10:13:02.517235+0000","last_unstale":"2024-01-22T10:13:04.652770+0000","last_undegraded":"2024-01-22T10:13:04.652770+0000","last_fullsized":"2024-01-22T10:13:04.652770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:53:07.743815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483581+0000","last_change":"2024-01-22T10:13:02.510486+0000","last_active":"2024-01-22T10:13:04.483581+0000","last_peered":"2024-01-22T10:13:04.483581+0000","last_clean":"2024-01-22T10:13:04.483581+0000","last_became_active":"2024-01-22T10:13:02.510213+0000","last_became_peered":"2024-01-22T10:13:02.510213+0000","last_unstale":"2024-01-22T10:13:04.483581+0000","last_undegraded":"2024-01-22T10:13:04.483581+0000","last_fullsized":"2024-01-22T10:13:04.483581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:12.080022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483938+0000","last_change":"2024-01-22T10:13:03.495558+0000","last_active":"2024-01-22T10:13:04.483938+0000","last_peered":"2024-01-22T10:13:04.483938+0000","last_clean":"2024-01-22T10:13:04.483938+0000","last_became_active":"2024-01-22T10:13:03.495279+0000","last_became_peered":"2024-01-22T10:13:03.495279+0000","last_unstale":"2024-01-22T10:13:04.483938+0000","last_undegraded":"2024-01-22T10:13:04.483938+0000","last_fullsized":"2024-01-22T10:13:04.483938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:33:39.926559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509710+0000","last_change":"2024-01-22T10:13:02.518247+0000","last_active":"2024-01-22T10:13:04.509710+0000","last_peered":"2024-01-22T10:13:04.509710+0000","last_clean":"2024-01-22T10:13:04.509710+0000","last_became_active":"2024-01-22T10:13:02.517891+0000","last_became_peered":"2024-01-22T10:13:02.517891+0000","last_unstale":"2024-01-22T10:13:04.509710+0000","last_undegraded":"2024-01-22T10:13:04.509710+0000","last_fullsized":"2024-01-22T10:13:04.509710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:52:49.078163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484290+0000","last_change":"2024-01-22T10:13:03.491458+0000","last_active":"2024-01-22T10:13:04.484290+0000","last_peered":"2024-01-22T10:13:04.484290+0000","last_clean":"2024-01-22T10:13:04.484290+0000","last_became_active":"2024-01-22T10:13:03.490965+0000","last_became_peered":"2024-01-22T10:13:03.490965+0000","last_unstale":"2024-01-22T10:13:04.484290+0000","last_undegraded":"2024-01-22T10:13:04.484290+0000","last_fullsized":"2024-01-22T10:13:04.484290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:43:22.787729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652631+0000","last_change":"2024-01-22T10:13:02.520405+0000","last_active":"2024-01-22T10:13:04.652631+0000","last_peered":"2024-01-22T10:13:04.652631+0000","last_clean":"2024-01-22T10:13:04.652631+0000","last_became_active":"2024-01-22T10:13:02.520031+0000","last_became_peered":"2024-01-22T10:13:02.520031+0000","last_unstale":"2024-01-22T10:13:04.652631+0000","last_undegraded":"2024-01-22T10:13:04.652631+0000","last_fullsized":"2024-01-22T10:13:04.652631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:52:49.078163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.510021+0000","last_change":"2024-01-22T10:13:03.501651+0000","last_active":"2024-01-22T10:13:04.510021+0000","last_peered":"2024-01-22T10:13:04.510021+0000","last_clean":"2024-01-22T10:13:04.510021+0000","last_became_active":"2024-01-22T10:13:03.501327+0000","last_became_peered":"2024-01-22T10:13:03.501327+0000","last_unstale":"2024-01-22T10:13:04.510021+0000","last_undegraded":"2024-01-22T10:13:04.510021+0000","last_fullsized":"2024-01-22T10:13:04.510021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:14:51.613418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.510024+0000","last_change":"2024-01-22T10:13:02.520696+0000","last_active":"2024-01-22T10:13:04.510024+0000","last_peered":"2024-01-22T10:13:04.510024+0000","last_clean":"2024-01-22T10:13:04.510024+0000","last_became_active":"2024-01-22T10:13:02.519608+0000","last_became_peered":"2024-01-22T10:13:02.519608+0000","last_unstale":"2024-01-22T10:13:04.510024+0000","last_undegraded":"2024-01-22T10:13:04.510024+0000","last_fullsized":"2024-01-22T10:13:04.510024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:55:15.314732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652656+0000","last_change":"2024-01-22T10:13:03.495561+0000","last_active":"2024-01-22T10:13:04.652656+0000","last_peered":"2024-01-22T10:13:04.652656+0000","last_clean":"2024-01-22T10:13:04.652656+0000","last_became_active":"2024-01-22T10:13:03.495046+0000","last_became_peered":"2024-01-22T10:13:03.495046+0000","last_unstale":"2024-01-22T10:13:04.652656+0000","last_undegraded":"2024-01-22T10:13:04.652656+0000","last_fullsized":"2024-01-22T10:13:04.652656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484426+0000","last_change":"2024-01-22T10:13:02.520255+0000","last_active":"2024-01-22T10:13:04.484426+0000","last_peered":"2024-01-22T10:13:04.484426+0000","last_clean":"2024-01-22T10:13:04.484426+0000","last_became_active":"2024-01-22T10:13:02.519958+0000","last_became_peered":"2024-01-22T10:13:02.519958+0000","last_unstale":"2024-01-22T10:13:04.484426+0000","last_undegraded":"2024-01-22T10:13:04.484426+0000","last_fullsized":"2024-01-22T10:13:04.484426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:26:12.646050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653423+0000","last_change":"2024-01-22T10:13:03.501610+0000","last_active":"2024-01-22T10:13:04.653423+0000","last_peered":"2024-01-22T10:13:04.653423+0000","last_clean":"2024-01-22T10:13:04.653423+0000","last_became_active":"2024-01-22T10:13:03.500770+0000","last_became_peered":"2024-01-22T10:13:03.500770+0000","last_unstale":"2024-01-22T10:13:04.653423+0000","last_undegraded":"2024-01-22T10:13:04.653423+0000","last_fullsized":"2024-01-22T10:13:04.653423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:46:21.339741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652911+0000","last_change":"2024-01-22T10:13:02.515746+0000","last_active":"2024-01-22T10:13:04.652911+0000","last_peered":"2024-01-22T10:13:04.652911+0000","last_clean":"2024-01-22T10:13:04.652911+0000","last_became_active":"2024-01-22T10:13:02.515480+0000","last_became_peered":"2024-01-22T10:13:02.515480+0000","last_unstale":"2024-01-22T10:13:04.652911+0000","last_undegraded":"2024-01-22T10:13:04.652911+0000","last_fullsized":"2024-01-22T10:13:04.652911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483017+0000","last_change":"2024-01-22T10:13:03.497330+0000","last_active":"2024-01-22T10:13:04.483017+0000","last_peered":"2024-01-22T10:13:04.483017+0000","last_clean":"2024-01-22T10:13:04.483017+0000","last_became_active":"2024-01-22T10:13:03.497059+0000","last_became_peered":"2024-01-22T10:13:03.497059+0000","last_unstale":"2024-01-22T10:13:04.483017+0000","last_undegraded":"2024-01-22T10:13:04.483017+0000","last_fullsized":"2024-01-22T10:13:04.483017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:14:51.613418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652626+0000","last_change":"2024-01-22T10:13:02.517370+0000","last_active":"2024-01-22T10:13:04.652626+0000","last_peered":"2024-01-22T10:13:04.652626+0000","last_clean":"2024-01-22T10:13:04.652626+0000","last_became_active":"2024-01-22T10:13:02.517049+0000","last_became_peered":"2024-01-22T10:13:02.517049+0000","last_unstale":"2024-01-22T10:13:04.652626+0000","last_undegraded":"2024-01-22T10:13:04.652626+0000","last_fullsized":"2024-01-22T10:13:04.652626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:33.688072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652365+0000","last_change":"2024-01-22T10:13:03.499203+0000","last_active":"2024-01-22T10:13:04.652365+0000","last_peered":"2024-01-22T10:13:04.652365+0000","last_clean":"2024-01-22T10:13:04.652365+0000","last_became_active":"2024-01-22T10:13:03.498882+0000","last_became_peered":"2024-01-22T10:13:03.498882+0000","last_unstale":"2024-01-22T10:13:04.652365+0000","last_undegraded":"2024-01-22T10:13:04.652365+0000","last_fullsized":"2024-01-22T10:13:04.652365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:26:02.561919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509844+0000","last_change":"2024-01-22T10:13:02.521514+0000","last_active":"2024-01-22T10:13:04.509844+0000","last_peered":"2024-01-22T10:13:04.509844+0000","last_clean":"2024-01-22T10:13:04.509844+0000","last_became_active":"2024-01-22T10:13:02.521145+0000","last_became_peered":"2024-01-22T10:13:02.521145+0000","last_unstale":"2024-01-22T10:13:04.509844+0000","last_undegraded":"2024-01-22T10:13:04.509844+0000","last_fullsized":"2024-01-22T10:13:04.509844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482950+0000","last_change":"2024-01-22T10:13:03.505052+0000","last_active":"2024-01-22T10:13:04.482950+0000","last_peered":"2024-01-22T10:13:04.482950+0000","last_clean":"2024-01-22T10:13:04.482950+0000","last_became_active":"2024-01-22T10:13:03.504265+0000","last_became_peered":"2024-01-22T10:13:03.504265+0000","last_unstale":"2024-01-22T10:13:04.482950+0000","last_undegraded":"2024-01-22T10:13:04.482950+0000","last_fullsized":"2024-01-22T10:13:04.482950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:25:05.310085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652525+0000","last_change":"2024-01-22T10:13:02.518658+0000","last_active":"2024-01-22T10:13:04.652525+0000","last_peered":"2024-01-22T10:13:04.652525+0000","last_clean":"2024-01-22T10:13:04.652525+0000","last_became_active":"2024-01-22T10:13:02.518390+0000","last_became_peered":"2024-01-22T10:13:02.518390+0000","last_unstale":"2024-01-22T10:13:04.652525+0000","last_undegraded":"2024-01-22T10:13:04.652525+0000","last_fullsized":"2024-01-22T10:13:04.652525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:12.080022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652570+0000","last_change":"2024-01-22T10:13:03.497378+0000","last_active":"2024-01-22T10:13:04.652570+0000","last_peered":"2024-01-22T10:13:04.652570+0000","last_clean":"2024-01-22T10:13:04.652570+0000","last_became_active":"2024-01-22T10:13:03.497000+0000","last_became_peered":"2024-01-22T10:13:03.497000+0000","last_unstale":"2024-01-22T10:13:04.652570+0000","last_undegraded":"2024-01-22T10:13:04.652570+0000","last_fullsized":"2024-01-22T10:13:04.652570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:43:22.787729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652033+0000","last_change":"2024-01-22T10:13:02.510852+0000","last_active":"2024-01-22T10:13:04.652033+0000","last_peered":"2024-01-22T10:13:04.652033+0000","last_clean":"2024-01-22T10:13:04.652033+0000","last_became_active":"2024-01-22T10:13:02.510574+0000","last_became_peered":"2024-01-22T10:13:02.510574+0000","last_unstale":"2024-01-22T10:13:04.652033+0000","last_undegraded":"2024-01-22T10:13:04.652033+0000","last_fullsized":"2024-01-22T10:13:04.652033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:55:15.314732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482713+0000","last_change":"2024-01-22T10:13:03.504783+0000","last_active":"2024-01-22T10:13:04.482713+0000","last_peered":"2024-01-22T10:13:04.482713+0000","last_clean":"2024-01-22T10:13:04.482713+0000","last_became_active":"2024-01-22T10:13:03.504479+0000","last_became_peered":"2024-01-22T10:13:03.504479+0000","last_unstale":"2024-01-22T10:13:04.482713+0000","last_undegraded":"2024-01-22T10:13:04.482713+0000","last_fullsized":"2024-01-22T10:13:04.482713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:24:59.153525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653388+0000","last_change":"2024-01-22T10:13:02.515839+0000","last_active":"2024-01-22T10:13:04.653388+0000","last_peered":"2024-01-22T10:13:04.653388+0000","last_clean":"2024-01-22T10:13:04.653388+0000","last_became_active":"2024-01-22T10:13:02.515570+0000","last_became_peered":"2024-01-22T10:13:02.515570+0000","last_unstale":"2024-01-22T10:13:04.653388+0000","last_undegraded":"2024-01-22T10:13:04.653388+0000","last_fullsized":"2024-01-22T10:13:04.653388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:53:07.456362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483233+0000","last_change":"2024-01-22T10:13:03.504368+0000","last_active":"2024-01-22T10:13:04.483233+0000","last_peered":"2024-01-22T10:13:04.483233+0000","last_clean":"2024-01-22T10:13:04.483233+0000","last_became_active":"2024-01-22T10:13:03.504085+0000","last_became_peered":"2024-01-22T10:13:03.504085+0000","last_unstale":"2024-01-22T10:13:04.483233+0000","last_undegraded":"2024-01-22T10:13:04.483233+0000","last_fullsized":"2024-01-22T10:13:04.483233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:42:23.812565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652462+0000","last_change":"2024-01-22T10:13:02.508413+0000","last_active":"2024-01-22T10:13:04.652462+0000","last_peered":"2024-01-22T10:13:04.652462+0000","last_clean":"2024-01-22T10:13:04.652462+0000","last_became_active":"2024-01-22T10:13:02.508164+0000","last_became_peered":"2024-01-22T10:13:02.508164+0000","last_unstale":"2024-01-22T10:13:04.652462+0000","last_undegraded":"2024-01-22T10:13:04.652462+0000","last_fullsized":"2024-01-22T10:13:04.652462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483520+0000","last_change":"2024-01-22T10:13:03.501288+0000","last_active":"2024-01-22T10:13:04.483520+0000","last_peered":"2024-01-22T10:13:04.483520+0000","last_clean":"2024-01-22T10:13:04.483520+0000","last_became_active":"2024-01-22T10:13:03.501009+0000","last_became_peered":"2024-01-22T10:13:03.501009+0000","last_unstale":"2024-01-22T10:13:04.483520+0000","last_undegraded":"2024-01-22T10:13:04.483520+0000","last_fullsized":"2024-01-22T10:13:04.483520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:06.156461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484504+0000","last_change":"2024-01-22T10:13:02.517585+0000","last_active":"2024-01-22T10:13:04.484504+0000","last_peered":"2024-01-22T10:13:04.484504+0000","last_clean":"2024-01-22T10:13:04.484504+0000","last_became_active":"2024-01-22T10:13:02.517264+0000","last_became_peered":"2024-01-22T10:13:02.517264+0000","last_unstale":"2024-01-22T10:13:04.484504+0000","last_undegraded":"2024-01-22T10:13:04.484504+0000","last_fullsized":"2024-01-22T10:13:04.484504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:28:11.824149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509907+0000","last_change":"2024-01-22T10:13:03.494074+0000","last_active":"2024-01-22T10:13:04.509907+0000","last_peered":"2024-01-22T10:13:04.509907+0000","last_clean":"2024-01-22T10:13:04.509907+0000","last_became_active":"2024-01-22T10:13:03.493813+0000","last_became_peered":"2024-01-22T10:13:03.493813+0000","last_unstale":"2024-01-22T10:13:04.509907+0000","last_undegraded":"2024-01-22T10:13:04.509907+0000","last_fullsized":"2024-01-22T10:13:04.509907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:24:59.153525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652344+0000","last_change":"2024-01-22T10:13:02.520256+0000","last_active":"2024-01-22T10:13:04.652344+0000","last_peered":"2024-01-22T10:13:04.652344+0000","last_clean":"2024-01-22T10:13:04.652344+0000","last_became_active":"2024-01-22T10:13:02.519958+0000","last_became_peered":"2024-01-22T10:13:02.519958+0000","last_unstale":"2024-01-22T10:13:04.652344+0000","last_undegraded":"2024-01-22T10:13:04.652344+0000","last_fullsized":"2024-01-22T10:13:04.652344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:53:07.743815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483076+0000","last_change":"2024-01-22T10:13:03.496747+0000","last_active":"2024-01-22T10:13:04.483076+0000","last_peered":"2024-01-22T10:13:04.483076+0000","last_clean":"2024-01-22T10:13:04.483076+0000","last_became_active":"2024-01-22T10:13:03.496101+0000","last_became_peered":"2024-01-22T10:13:03.496101+0000","last_unstale":"2024-01-22T10:13:04.483076+0000","last_undegraded":"2024-01-22T10:13:04.483076+0000","last_fullsized":"2024-01-22T10:13:04.483076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:05:11.277521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-22T10:13:03.481850+0000","last_change":"2024-01-22T10:12:52.033359+0000","last_active":"2024-01-22T10:13:03.481850+0000","last_peered":"2024-01-22T10:13:03.481850+0000","last_clean":"2024-01-22T10:13:03.481850+0000","last_became_active":"2024-01-22T10:12:52.033101+0000","last_became_peered":"2024-01-22T10:12:52.033101+0000","last_unstale":"2024-01-22T10:13:03.481850+0000","last_undegraded":"2024-01-22T10:13:03.481850+0000","last_fullsized":"2024-01-22T10:13:03.481850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_clean_scrub_stamp":"2024-01-22T10:12:51.022957+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:45:37.023233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509648+0000","last_change":"2024-01-22T10:13:02.520393+0000","last_active":"2024-01-22T10:13:04.509648+0000","last_peered":"2024-01-22T10:13:04.509648+0000","last_clean":"2024-01-22T10:13:04.509648+0000","last_became_active":"2024-01-22T10:13:02.519136+0000","last_became_peered":"2024-01-22T10:13:02.519136+0000","last_unstale":"2024-01-22T10:13:04.509648+0000","last_undegraded":"2024-01-22T10:13:04.509648+0000","last_fullsized":"2024-01-22T10:13:04.509648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:12.080022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483783+0000","last_change":"2024-01-22T10:13:03.492656+0000","last_active":"2024-01-22T10:13:04.483783+0000","last_peered":"2024-01-22T10:13:04.483783+0000","last_clean":"2024-01-22T10:13:04.483783+0000","last_became_active":"2024-01-22T10:13:03.492384+0000","last_became_peered":"2024-01-22T10:13:03.492384+0000","last_unstale":"2024-01-22T10:13:04.483783+0000","last_undegraded":"2024-01-22T10:13:04.483783+0000","last_fullsized":"2024-01-22T10:13:04.483783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482591+0000","last_change":"2024-01-22T10:13:02.516696+0000","last_active":"2024-01-22T10:13:04.482591+0000","last_peered":"2024-01-22T10:13:04.482591+0000","last_clean":"2024-01-22T10:13:04.482591+0000","last_became_active":"2024-01-22T10:13:02.515332+0000","last_became_peered":"2024-01-22T10:13:02.515332+0000","last_unstale":"2024-01-22T10:13:04.482591+0000","last_undegraded":"2024-01-22T10:13:04.482591+0000","last_fullsized":"2024-01-22T10:13:04.482591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:27:12.120129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652280+0000","last_change":"2024-01-22T10:13:03.503310+0000","last_active":"2024-01-22T10:13:04.652280+0000","last_peered":"2024-01-22T10:13:04.652280+0000","last_clean":"2024-01-22T10:13:04.652280+0000","last_became_active":"2024-01-22T10:13:03.503035+0000","last_became_peered":"2024-01-22T10:13:03.503035+0000","last_unstale":"2024-01-22T10:13:04.652280+0000","last_undegraded":"2024-01-22T10:13:04.652280+0000","last_fullsized":"2024-01-22T10:13:04.652280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:19:02.332837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652246+0000","last_change":"2024-01-22T10:13:02.515616+0000","last_active":"2024-01-22T10:13:04.652246+0000","last_peered":"2024-01-22T10:13:04.652246+0000","last_clean":"2024-01-22T10:13:04.652246+0000","last_became_active":"2024-01-22T10:13:02.515305+0000","last_became_peered":"2024-01-22T10:13:02.515305+0000","last_unstale":"2024-01-22T10:13:04.652246+0000","last_undegraded":"2024-01-22T10:13:04.652246+0000","last_fullsized":"2024-01-22T10:13:04.652246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:12.080022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484326+0000","last_change":"2024-01-22T10:13:03.488752+0000","last_active":"2024-01-22T10:13:04.484326+0000","last_peered":"2024-01-22T10:13:04.484326+0000","last_clean":"2024-01-22T10:13:04.484326+0000","last_became_active":"2024-01-22T10:13:03.488507+0000","last_became_peered":"2024-01-22T10:13:03.488507+0000","last_unstale":"2024-01-22T10:13:04.484326+0000","last_undegraded":"2024-01-22T10:13:04.484326+0000","last_fullsized":"2024-01-22T10:13:04.484326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:10:02.956052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509999+0000","last_change":"2024-01-22T10:13:02.519467+0000","last_active":"2024-01-22T10:13:04.509999+0000","last_peered":"2024-01-22T10:13:04.509999+0000","last_clean":"2024-01-22T10:13:04.509999+0000","last_became_active":"2024-01-22T10:13:02.518703+0000","last_became_peered":"2024-01-22T10:13:02.518703+0000","last_unstale":"2024-01-22T10:13:04.509999+0000","last_undegraded":"2024-01-22T10:13:04.509999+0000","last_fullsized":"2024-01-22T10:13:04.509999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:53:07.743815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653092+0000","last_change":"2024-01-22T10:13:03.502386+0000","last_active":"2024-01-22T10:13:04.653092+0000","last_peered":"2024-01-22T10:13:04.653092+0000","last_clean":"2024-01-22T10:13:04.653092+0000","last_became_active":"2024-01-22T10:13:03.501769+0000","last_became_peered":"2024-01-22T10:13:03.501769+0000","last_unstale":"2024-01-22T10:13:04.653092+0000","last_undegraded":"2024-01-22T10:13:04.653092+0000","last_fullsized":"2024-01-22T10:13:04.653092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:28:12.828318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484433+0000","last_change":"2024-01-22T10:13:02.513770+0000","last_active":"2024-01-22T10:13:04.484433+0000","last_peered":"2024-01-22T10:13:04.484433+0000","last_clean":"2024-01-22T10:13:04.484433+0000","last_became_active":"2024-01-22T10:13:02.513467+0000","last_became_peered":"2024-01-22T10:13:02.513467+0000","last_unstale":"2024-01-22T10:13:04.484433+0000","last_undegraded":"2024-01-22T10:13:04.484433+0000","last_fullsized":"2024-01-22T10:13:04.484433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:27:12.120129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.510030+0000","last_change":"2024-01-22T10:13:03.494128+0000","last_active":"2024-01-22T10:13:04.510030+0000","last_peered":"2024-01-22T10:13:04.510030+0000","last_clean":"2024-01-22T10:13:04.510030+0000","last_became_active":"2024-01-22T10:13:03.493896+0000","last_became_peered":"2024-01-22T10:13:03.493896+0000","last_unstale":"2024-01-22T10:13:04.510030+0000","last_undegraded":"2024-01-22T10:13:04.510030+0000","last_fullsized":"2024-01-22T10:13:04.510030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:01:27.029405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483336+0000","last_change":"2024-01-22T10:13:02.516338+0000","last_active":"2024-01-22T10:13:04.483336+0000","last_peered":"2024-01-22T10:13:04.483336+0000","last_clean":"2024-01-22T10:13:04.483336+0000","last_became_active":"2024-01-22T10:13:02.516078+0000","last_became_peered":"2024-01-22T10:13:02.516078+0000","last_unstale":"2024-01-22T10:13:04.483336+0000","last_undegraded":"2024-01-22T10:13:04.483336+0000","last_fullsized":"2024-01-22T10:13:04.483336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:20:15.623335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484425+0000","last_change":"2024-01-22T10:13:03.489431+0000","last_active":"2024-01-22T10:13:04.484425+0000","last_peered":"2024-01-22T10:13:04.484425+0000","last_clean":"2024-01-22T10:13:04.484425+0000","last_became_active":"2024-01-22T10:13:03.489087+0000","last_became_peered":"2024-01-22T10:13:03.489087+0000","last_unstale":"2024-01-22T10:13:04.484425+0000","last_undegraded":"2024-01-22T10:13:04.484425+0000","last_fullsized":"2024-01-22T10:13:04.484425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:08:01.408684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:05.520945+0000","last_change":"2024-01-22T10:13:02.511112+0000","last_active":"2024-01-22T10:13:05.520945+0000","last_peered":"2024-01-22T10:13:05.520945+0000","last_clean":"2024-01-22T10:13:05.520945+0000","last_became_active":"2024-01-22T10:13:02.510787+0000","last_became_peered":"2024-01-22T10:13:02.510787+0000","last_unstale":"2024-01-22T10:13:05.520945+0000","last_undegraded":"2024-01-22T10:13:05.520945+0000","last_fullsized":"2024-01-22T10:13:05.520945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:52:49.078163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483990+0000","last_change":"2024-01-22T10:13:03.493410+0000","last_active":"2024-01-22T10:13:04.483990+0000","last_peered":"2024-01-22T10:13:04.483990+0000","last_clean":"2024-01-22T10:13:04.483990+0000","last_became_active":"2024-01-22T10:13:03.493143+0000","last_became_peered":"2024-01-22T10:13:03.493143+0000","last_unstale":"2024-01-22T10:13:04.483990+0000","last_undegraded":"2024-01-22T10:13:04.483990+0000","last_fullsized":"2024-01-22T10:13:04.483990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:18:49.293366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652802+0000","last_change":"2024-01-22T10:13:02.513484+0000","last_active":"2024-01-22T10:13:04.652802+0000","last_peered":"2024-01-22T10:13:04.652802+0000","last_clean":"2024-01-22T10:13:04.652802+0000","last_became_active":"2024-01-22T10:13:02.513171+0000","last_became_peered":"2024-01-22T10:13:02.513171+0000","last_unstale":"2024-01-22T10:13:04.652802+0000","last_undegraded":"2024-01-22T10:13:04.652802+0000","last_fullsized":"2024-01-22T10:13:04.652802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:27:12.120129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652593+0000","last_change":"2024-01-22T10:13:03.495046+0000","last_active":"2024-01-22T10:13:04.652593+0000","last_peered":"2024-01-22T10:13:04.652593+0000","last_clean":"2024-01-22T10:13:04.652593+0000","last_became_active":"2024-01-22T10:13:03.494817+0000","last_became_peered":"2024-01-22T10:13:03.494817+0000","last_unstale":"2024-01-22T10:13:04.652593+0000","last_undegraded":"2024-01-22T10:13:04.652593+0000","last_fullsized":"2024-01-22T10:13:04.652593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:08:01.408684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482603+0000","last_change":"2024-01-22T10:13:02.516259+0000","last_active":"2024-01-22T10:13:04.482603+0000","last_peered":"2024-01-22T10:13:04.482603+0000","last_clean":"2024-01-22T10:13:04.482603+0000","last_became_active":"2024-01-22T10:13:02.515672+0000","last_became_peered":"2024-01-22T10:13:02.515672+0000","last_unstale":"2024-01-22T10:13:04.482603+0000","last_undegraded":"2024-01-22T10:13:04.482603+0000","last_fullsized":"2024-01-22T10:13:04.482603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:28:11.824149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653012+0000","last_change":"2024-01-22T10:13:03.501480+0000","last_active":"2024-01-22T10:13:04.653012+0000","last_peered":"2024-01-22T10:13:04.653012+0000","last_clean":"2024-01-22T10:13:04.653012+0000","last_became_active":"2024-01-22T10:13:03.500884+0000","last_became_peered":"2024-01-22T10:13:03.500884+0000","last_unstale":"2024-01-22T10:13:04.653012+0000","last_undegraded":"2024-01-22T10:13:04.653012+0000","last_fullsized":"2024-01-22T10:13:04.653012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:27:13.124298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484380+0000","last_change":"2024-01-22T10:13:02.507443+0000","last_active":"2024-01-22T10:13:04.484380+0000","last_peered":"2024-01-22T10:13:04.484380+0000","last_clean":"2024-01-22T10:13:04.484380+0000","last_became_active":"2024-01-22T10:13:02.507186+0000","last_became_peered":"2024-01-22T10:13:02.507186+0000","last_unstale":"2024-01-22T10:13:04.484380+0000","last_undegraded":"2024-01-22T10:13:04.484380+0000","last_fullsized":"2024-01-22T10:13:04.484380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:53:07.743815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483642+0000","last_change":"2024-01-22T10:13:03.487955+0000","last_active":"2024-01-22T10:13:04.483642+0000","last_peered":"2024-01-22T10:13:04.483642+0000","last_clean":"2024-01-22T10:13:04.483642+0000","last_became_active":"2024-01-22T10:13:03.487676+0000","last_became_peered":"2024-01-22T10:13:03.487676+0000","last_unstale":"2024-01-22T10:13:04.483642+0000","last_undegraded":"2024-01-22T10:13:04.483642+0000","last_fullsized":"2024-01-22T10:13:04.483642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:08:01.408684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484589+0000","last_change":"2024-01-22T10:13:02.507207+0000","last_active":"2024-01-22T10:13:04.484589+0000","last_peered":"2024-01-22T10:13:04.484589+0000","last_clean":"2024-01-22T10:13:04.484589+0000","last_became_active":"2024-01-22T10:13:02.506859+0000","last_became_peered":"2024-01-22T10:13:02.506859+0000","last_unstale":"2024-01-22T10:13:04.484589+0000","last_undegraded":"2024-01-22T10:13:04.484589+0000","last_fullsized":"2024-01-22T10:13:04.484589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483733+0000","last_change":"2024-01-22T10:13:03.495441+0000","last_active":"2024-01-22T10:13:04.483733+0000","last_peered":"2024-01-22T10:13:04.483733+0000","last_clean":"2024-01-22T10:13:04.483733+0000","last_became_active":"2024-01-22T10:13:03.495161+0000","last_became_peered":"2024-01-22T10:13:03.495161+0000","last_unstale":"2024-01-22T10:13:04.483733+0000","last_undegraded":"2024-01-22T10:13:04.483733+0000","last_fullsized":"2024-01-22T10:13:04.483733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483100+0000","last_change":"2024-01-22T10:13:02.519141+0000","last_active":"2024-01-22T10:13:04.483100+0000","last_peered":"2024-01-22T10:13:04.483100+0000","last_clean":"2024-01-22T10:13:04.483100+0000","last_became_active":"2024-01-22T10:13:02.518879+0000","last_became_peered":"2024-01-22T10:13:02.518879+0000","last_unstale":"2024-01-22T10:13:04.483100+0000","last_undegraded":"2024-01-22T10:13:04.483100+0000","last_fullsized":"2024-01-22T10:13:04.483100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:23:06.376125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652801+0000","last_change":"2024-01-22T10:13:03.505053+0000","last_active":"2024-01-22T10:13:04.652801+0000","last_peered":"2024-01-22T10:13:04.652801+0000","last_clean":"2024-01-22T10:13:04.652801+0000","last_became_active":"2024-01-22T10:13:03.504770+0000","last_became_peered":"2024-01-22T10:13:03.504770+0000","last_unstale":"2024-01-22T10:13:04.652801+0000","last_undegraded":"2024-01-22T10:13:04.652801+0000","last_fullsized":"2024-01-22T10:13:04.652801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:10:02.956052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509948+0000","last_change":"2024-01-22T10:13:03.503528+0000","last_active":"2024-01-22T10:13:04.509948+0000","last_peered":"2024-01-22T10:13:04.509948+0000","last_clean":"2024-01-22T10:13:04.509948+0000","last_became_active":"2024-01-22T10:13:03.503272+0000","last_became_peered":"2024-01-22T10:13:03.503272+0000","last_unstale":"2024-01-22T10:13:04.509948+0000","last_undegraded":"2024-01-22T10:13:04.509948+0000","last_fullsized":"2024-01-22T10:13:04.509948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:25:05.310085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482933+0000","last_change":"2024-01-22T10:13:02.521399+0000","last_active":"2024-01-22T10:13:04.482933+0000","last_peered":"2024-01-22T10:13:04.482933+0000","last_clean":"2024-01-22T10:13:04.482933+0000","last_became_active":"2024-01-22T10:13:02.521125+0000","last_became_peered":"2024-01-22T10:13:02.521125+0000","last_unstale":"2024-01-22T10:13:04.482933+0000","last_undegraded":"2024-01-22T10:13:04.482933+0000","last_fullsized":"2024-01-22T10:13:04.482933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:26:12.646050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509872+0000","last_change":"2024-01-22T10:13:03.503608+0000","last_active":"2024-01-22T10:13:04.509872+0000","last_peered":"2024-01-22T10:13:04.509872+0000","last_clean":"2024-01-22T10:13:04.509872+0000","last_became_active":"2024-01-22T10:13:03.503334+0000","last_became_peered":"2024-01-22T10:13:03.503334+0000","last_unstale":"2024-01-22T10:13:04.509872+0000","last_undegraded":"2024-01-22T10:13:04.509872+0000","last_fullsized":"2024-01-22T10:13:04.509872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:18:49.293366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483210+0000","last_change":"2024-01-22T10:13:02.511844+0000","last_active":"2024-01-22T10:13:04.483210+0000","last_peered":"2024-01-22T10:13:04.483210+0000","last_clean":"2024-01-22T10:13:04.483210+0000","last_became_active":"2024-01-22T10:13:02.510702+0000","last_became_peered":"2024-01-22T10:13:02.510702+0000","last_unstale":"2024-01-22T10:13:04.483210+0000","last_undegraded":"2024-01-22T10:13:04.483210+0000","last_fullsized":"2024-01-22T10:13:04.483210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:46:20.335572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652546+0000","last_change":"2024-01-22T10:13:03.495676+0000","last_active":"2024-01-22T10:13:04.652546+0000","last_peered":"2024-01-22T10:13:04.652546+0000","last_clean":"2024-01-22T10:13:04.652546+0000","last_became_active":"2024-01-22T10:13:03.495309+0000","last_became_peered":"2024-01-22T10:13:03.495309+0000","last_unstale":"2024-01-22T10:13:04.652546+0000","last_undegraded":"2024-01-22T10:13:04.652546+0000","last_fullsized":"2024-01-22T10:13:04.652546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:10:02.956052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483976+0000","last_change":"2024-01-22T10:13:02.513564+0000","last_active":"2024-01-22T10:13:04.483976+0000","last_peered":"2024-01-22T10:13:04.483976+0000","last_clean":"2024-01-22T10:13:04.483976+0000","last_became_active":"2024-01-22T10:13:02.513272+0000","last_became_peered":"2024-01-22T10:13:02.513272+0000","last_unstale":"2024-01-22T10:13:04.483976+0000","last_undegraded":"2024-01-22T10:13:04.483976+0000","last_fullsized":"2024-01-22T10:13:04.483976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483925+0000","last_change":"2024-01-22T10:13:03.492530+0000","last_active":"2024-01-22T10:13:04.483925+0000","last_peered":"2024-01-22T10:13:04.483925+0000","last_clean":"2024-01-22T10:13:04.483925+0000","last_became_active":"2024-01-22T10:13:03.492265+0000","last_became_peered":"2024-01-22T10:13:03.492265+0000","last_unstale":"2024-01-22T10:13:04.483925+0000","last_undegraded":"2024-01-22T10:13:04.483925+0000","last_fullsized":"2024-01-22T10:13:04.483925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:59:10.835472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652704+0000","last_change":"2024-01-22T10:13:02.519858+0000","last_active":"2024-01-22T10:13:04.652704+0000","last_peered":"2024-01-22T10:13:04.652704+0000","last_clean":"2024-01-22T10:13:04.652704+0000","last_became_active":"2024-01-22T10:13:02.519559+0000","last_became_peered":"2024-01-22T10:13:02.519559+0000","last_unstale":"2024-01-22T10:13:04.652704+0000","last_undegraded":"2024-01-22T10:13:04.652704+0000","last_fullsized":"2024-01-22T10:13:04.652704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:53:07.456362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T10:13:10.713 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T10:13:10.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.866+0000 7f5ebcda4640 1 Processor -- start 2024-01-22T10:13:10.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.866+0000 7f5ebcda4640 1 -- start start 2024-01-22T10:13:10.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.867+0000 7f5ebcda4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eb806f6b0 0x7f5eb8149530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.867+0000 7f5ebcda4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5eb80bad30 0x7f5eb80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.867+0000 7f5ebcda4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5eb806fa90 0x7f5eb814ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.867+0000 7f5ebcda4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb80b4bc0 con 0x7f5eb806fa90 2024-01-22T10:13:10.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.867+0000 7f5ebcda4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb8149a70 con 0x7f5eb80bad30 2024-01-22T10:13:10.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.867+0000 7f5ebcda4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80b4450 con 0x7f5eb806f6b0 2024-01-22T10:13:10.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.867+0000 7f5eb6d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5eb806fa90 0x7f5eb814ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.867+0000 7f5eb6d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5eb806fa90 0x7f5eb814ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43964/0 (socket says 172.21.15.88:43964) 2024-01-22T10:13:10.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.867+0000 7f5eb6d9d640 1 -- 172.21.15.88:0/3289149442 learned_addr learned my addr 172.21.15.88:0/3289149442 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:10.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.867+0000 7f5eb5d9b640 1 --2- 172.21.15.88:0/3289149442 >> v2:172.21.15.119:3300/0 conn(0x7f5eb80bad30 0x7f5eb80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.867+0000 7f5eb659c640 1 --2- 172.21.15.88:0/3289149442 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eb806f6b0 0x7f5eb8149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.868+0000 7f5eb6d9d640 1 -- 172.21.15.88:0/3289149442 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eb806f6b0 msgr2=0x7f5eb8149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:10.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.868+0000 7f5eb6d9d640 1 --2- 172.21.15.88:0/3289149442 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eb806f6b0 0x7f5eb8149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.868+0000 7f5eb6d9d640 1 -- 172.21.15.88:0/3289149442 >> v2:172.21.15.119:3300/0 conn(0x7f5eb80bad30 msgr2=0x7f5eb80b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:10.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.868+0000 7f5eb6d9d640 1 --2- 172.21.15.88:0/3289149442 >> v2:172.21.15.119:3300/0 conn(0x7f5eb80bad30 0x7f5eb80b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.868+0000 7f5eb6d9d640 1 -- 172.21.15.88:0/3289149442 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb8143cb0 con 0x7f5eb806fa90 2024-01-22T10:13:10.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.868+0000 7f5eb5d9b640 1 --2- 172.21.15.88:0/3289149442 >> v2:172.21.15.119:3300/0 conn(0x7f5eb80bad30 0x7f5eb80b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:10.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.868+0000 7f5eb6d9d640 1 --2- 172.21.15.88:0/3289149442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb806fa90 0x7f5eb814ca80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5eb806dac0 tx=0x7f5ea802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68064ff7ccc076fd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:10.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.868+0000 7f5eb559a640 1 -- 172.21.15.88:0/3289149442 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea802c950 con 0x7f5eb806fa90 2024-01-22T10:13:10.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.868+0000 7f5eb559a640 1 -- 172.21.15.88:0/3289149442 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea802cab0 con 0x7f5eb806fa90 2024-01-22T10:13:10.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.868+0000 7f5eb559a640 1 -- 172.21.15.88:0/3289149442 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea802ce40 con 0x7f5eb806fa90 2024-01-22T10:13:10.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.869+0000 7f5ebcda4640 1 -- 172.21.15.88:0/3289149442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb806fa90 msgr2=0x7f5eb814ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.869+0000 7f5ebcda4640 1 --2- 172.21.15.88:0/3289149442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb806fa90 0x7f5eb814ca80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5eb806dac0 tx=0x7f5ea802bdb0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.869+0000 7f5ebcda4640 1 -- 172.21.15.88:0/3289149442 shutdown_connections 2024-01-22T10:13:10.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.869+0000 7f5ebcda4640 1 --2- 172.21.15.88:0/3289149442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb806fa90 0x7f5eb814ca80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.869+0000 7f5ebcda4640 1 --2- 172.21.15.88:0/3289149442 >> v2:172.21.15.119:3300/0 conn(0x7f5eb80bad30 0x7f5eb80b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.869+0000 7f5ebcda4640 1 --2- 172.21.15.88:0/3289149442 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eb806f6b0 0x7f5eb8149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.869+0000 7f5ebcda4640 1 -- 172.21.15.88:0/3289149442 >> 172.21.15.88:0/3289149442 conn(0x7f5eb8071500 msgr2=0x7f5eb8071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:10.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.869+0000 7f5ebcda4640 1 -- 172.21.15.88:0/3289149442 shutdown_connections 2024-01-22T10:13:10.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.869+0000 7f5ebcda4640 1 -- 172.21.15.88:0/3289149442 wait complete. 2024-01-22T10:13:10.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.870+0000 7f5ebcda4640 1 Processor -- start 2024-01-22T10:13:10.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.870+0000 7f5ebcda4640 1 -- start start 2024-01-22T10:13:10.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5ebcda4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb806f6b0 0x7f5eb8140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5ebcda4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eb806fa90 0x7f5eb814c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5ebcda4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eb80bad30 0x7f5eb814b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5ebcda4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8140c70 con 0x7f5eb806f6b0 2024-01-22T10:13:10.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5ebcda4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80b7920 con 0x7f5eb80bad30 2024-01-22T10:13:10.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5ebcda4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb814aee0 con 0x7f5eb806fa90 2024-01-22T10:13:10.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eb659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb806f6b0 0x7f5eb8140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eb659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb806f6b0 0x7f5eb8140730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43970/0 (socket says 172.21.15.88:43970) 2024-01-22T10:13:10.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eb659c640 1 -- 172.21.15.88:0/551712321 learned_addr learned my addr 172.21.15.88:0/551712321 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:10.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eb5d9b640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eb806fa90 0x7f5eb814c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eb6d9d640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eb80bad30 0x7f5eb814b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eb659c640 1 -- 172.21.15.88:0/551712321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eb806fa90 msgr2=0x7f5eb814c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eb659c640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eb806fa90 0x7f5eb814c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eb659c640 1 -- 172.21.15.88:0/551712321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eb80bad30 msgr2=0x7f5eb814b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eb659c640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eb80bad30 0x7f5eb814b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eb659c640 1 -- 172.21.15.88:0/551712321 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea8009b30 con 0x7f5eb806f6b0 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eb6d9d640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eb80bad30 0x7f5eb814b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eb659c640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb806f6b0 0x7f5eb8140730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000c820 tx=0x7f5eb000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.871+0000 7f5eaeffd640 1 -- 172.21.15.88:0/551712321 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0004020 con 0x7f5eb806f6b0 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.872+0000 7f5eaeffd640 1 -- 172.21.15.88:0/551712321 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb0004180 con 0x7f5eb806f6b0 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.872+0000 7f5eaeffd640 1 -- 172.21.15.88:0/551712321 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0007830 con 0x7f5eb806f6b0 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.872+0000 7f5ebcda4640 1 -- 172.21.15.88:0/551712321 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb814d180 con 0x7f5eb806f6b0 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.872+0000 7f5ebcda4640 1 -- 172.21.15.88:0/551712321 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb814d6d0 con 0x7f5eb806f6b0 2024-01-22T10:13:10.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.872+0000 7f5ebcda4640 1 -- 172.21.15.88:0/551712321 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb814c9f0 con 0x7f5eb806f6b0 2024-01-22T10:13:10.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.873+0000 7f5eaeffd640 1 -- 172.21.15.88:0/551712321 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f5eb0007990 con 0x7f5eb806f6b0 2024-01-22T10:13:10.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.873+0000 7f5eaeffd640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5e9806b330 0x7f5e9806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:10.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.873+0000 7f5eaeffd640 1 -- 172.21.15.88:0/551712321 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5eb0089880 con 0x7f5eb806f6b0 2024-01-22T10:13:10.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.873+0000 7f5eb5d9b640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5e9806b330 0x7f5e9806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:10.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.874+0000 7f5eb5d9b640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5e9806b330 0x7f5e9806d7f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5eb81dfdc0 tx=0x7f5ea0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:10.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:10.877+0000 7f5eaeffd640 1 -- 172.21.15.88:0/551712321 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5eb00545a0 con 0x7f5eb806f6b0 2024-01-22T10:13:11.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.043+0000 7f5ebcda4640 1 -- 172.21.15.88:0/551712321 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5eb80b5bd0 con 0x7f5e9806b330 2024-01-22T10:13:11.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.050+0000 7f5eaeffd640 1 -- 172.21.15.88:0/551712321 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264591 (secure 0 0 0) 0x7f5eb80b5bd0 con 0x7f5e9806b330 2024-01-22T10:13:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:11.036 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-01-22T10:13:11.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.053+0000 7f5ebcda4640 1 -- 172.21.15.88:0/551712321 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5e9806b330 msgr2=0x7f5e9806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.053+0000 7f5ebcda4640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5e9806b330 0x7f5e9806d7f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5eb81dfdc0 tx=0x7f5ea0008040 comp rx=0 tx=0).stop 2024-01-22T10:13:11.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.053+0000 7f5ebcda4640 1 -- 172.21.15.88:0/551712321 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb806f6b0 msgr2=0x7f5eb8140730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.053+0000 7f5ebcda4640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb806f6b0 0x7f5eb8140730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000c820 tx=0x7f5eb000cce0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.053+0000 7f5ebcda4640 1 -- 172.21.15.88:0/551712321 shutdown_connections 2024-01-22T10:13:11.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.053+0000 7f5ebcda4640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5e9806b330 0x7f5e9806d7f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.053+0000 7f5ebcda4640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eb806fa90 0x7f5eb814c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.053+0000 7f5ebcda4640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eb80bad30 0x7f5eb814b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.053+0000 7f5ebcda4640 1 --2- 172.21.15.88:0/551712321 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5eb806f6b0 0x7f5eb8140730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.053+0000 7f5ebcda4640 1 -- 172.21.15.88:0/551712321 >> 172.21.15.88:0/551712321 conn(0x7f5eb8071500 msgr2=0x7f5eb806e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:11.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.053+0000 7f5ebcda4640 1 -- 172.21.15.88:0/551712321 shutdown_connections 2024-01-22T10:13:11.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.053+0000 7f5ebcda4640 1 -- 172.21.15.88:0/551712321 wait complete. 2024-01-22T10:13:11.046 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-01-22T10:13:10.706900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001772"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483437+0000","last_change":"2024-01-22T10:13:03.492920+0000","last_active":"2024-01-22T10:13:04.483437+0000","last_peered":"2024-01-22T10:13:04.483437+0000","last_clean":"2024-01-22T10:13:04.483437+0000","last_became_active":"2024-01-22T10:13:03.492631+0000","last_became_peered":"2024-01-22T10:13:03.492631+0000","last_unstale":"2024-01-22T10:13:04.483437+0000","last_undegraded":"2024-01-22T10:13:04.483437+0000","last_fullsized":"2024-01-22T10:13:04.483437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:32:21.868617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484560+0000","last_change":"2024-01-22T10:13:03.495752+0000","last_active":"2024-01-22T10:13:04.484560+0000","last_peered":"2024-01-22T10:13:04.484560+0000","last_clean":"2024-01-22T10:13:04.484560+0000","last_became_active":"2024-01-22T10:13:03.495494+0000","last_became_peered":"2024-01-22T10:13:03.495494+0000","last_unstale":"2024-01-22T10:13:04.484560+0000","last_undegraded":"2024-01-22T10:13:04.484560+0000","last_fullsized":"2024-01-22T10:13:04.484560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652381+0000","last_change":"2024-01-22T10:13:03.493655+0000","last_active":"2024-01-22T10:13:04.652381+0000","last_peered":"2024-01-22T10:13:04.652381+0000","last_clean":"2024-01-22T10:13:04.652381+0000","last_became_active":"2024-01-22T10:13:03.493392+0000","last_became_peered":"2024-01-22T10:13:03.493392+0000","last_unstale":"2024-01-22T10:13:04.652381+0000","last_undegraded":"2024-01-22T10:13:04.652381+0000","last_fullsized":"2024-01-22T10:13:04.652381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:14:37.672922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509717+0000","last_change":"2024-01-22T10:13:03.499002+0000","last_active":"2024-01-22T10:13:04.509717+0000","last_peered":"2024-01-22T10:13:04.509717+0000","last_clean":"2024-01-22T10:13:04.509717+0000","last_became_active":"2024-01-22T10:13:03.498671+0000","last_became_peered":"2024-01-22T10:13:03.498671+0000","last_unstale":"2024-01-22T10:13:04.509717+0000","last_undegraded":"2024-01-22T10:13:04.509717+0000","last_fullsized":"2024-01-22T10:13:04.509717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:23.433091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483030+0000","last_change":"2024-01-22T10:13:03.491947+0000","last_active":"2024-01-22T10:13:04.483030+0000","last_peered":"2024-01-22T10:13:04.483030+0000","last_clean":"2024-01-22T10:13:04.483030+0000","last_became_active":"2024-01-22T10:13:03.491661+0000","last_became_peered":"2024-01-22T10:13:03.491661+0000","last_unstale":"2024-01-22T10:13:04.483030+0000","last_undegraded":"2024-01-22T10:13:04.483030+0000","last_fullsized":"2024-01-22T10:13:04.483030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:01:27.029405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509675+0000","last_change":"2024-01-22T10:13:03.499247+0000","last_active":"2024-01-22T10:13:04.509675+0000","last_peered":"2024-01-22T10:13:04.509675+0000","last_clean":"2024-01-22T10:13:04.509675+0000","last_became_active":"2024-01-22T10:13:03.498924+0000","last_became_peered":"2024-01-22T10:13:03.498924+0000","last_unstale":"2024-01-22T10:13:04.509675+0000","last_undegraded":"2024-01-22T10:13:04.509675+0000","last_fullsized":"2024-01-22T10:13:04.509675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:28:38.011831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482686+0000","last_change":"2024-01-22T10:13:03.493236+0000","last_active":"2024-01-22T10:13:04.482686+0000","last_peered":"2024-01-22T10:13:04.482686+0000","last_clean":"2024-01-22T10:13:04.482686+0000","last_became_active":"2024-01-22T10:13:03.492833+0000","last_became_peered":"2024-01-22T10:13:03.492833+0000","last_unstale":"2024-01-22T10:13:04.482686+0000","last_undegraded":"2024-01-22T10:13:04.482686+0000","last_fullsized":"2024-01-22T10:13:04.482686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:18:49.293366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483516+0000","last_change":"2024-01-22T10:13:03.492762+0000","last_active":"2024-01-22T10:13:04.483516+0000","last_peered":"2024-01-22T10:13:04.483516+0000","last_clean":"2024-01-22T10:13:04.483516+0000","last_became_active":"2024-01-22T10:13:03.492488+0000","last_became_peered":"2024-01-22T10:13:03.492488+0000","last_unstale":"2024-01-22T10:13:04.483516+0000","last_undegraded":"2024-01-22T10:13:04.483516+0000","last_fullsized":"2024-01-22T10:13:04.483516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:43:22.787729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483554+0000","last_change":"2024-01-22T10:13:03.497140+0000","last_active":"2024-01-22T10:13:04.483554+0000","last_peered":"2024-01-22T10:13:04.483554+0000","last_clean":"2024-01-22T10:13:04.483554+0000","last_became_active":"2024-01-22T10:13:03.496752+0000","last_became_peered":"2024-01-22T10:13:03.496752+0000","last_unstale":"2024-01-22T10:13:04.483554+0000","last_undegraded":"2024-01-22T10:13:04.483554+0000","last_fullsized":"2024-01-22T10:13:04.483554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:23:47.110078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652900+0000","last_change":"2024-01-22T10:13:03.495067+0000","last_active":"2024-01-22T10:13:04.652900+0000","last_peered":"2024-01-22T10:13:04.652900+0000","last_clean":"2024-01-22T10:13:04.652900+0000","last_became_active":"2024-01-22T10:13:03.494818+0000","last_became_peered":"2024-01-22T10:13:03.494818+0000","last_unstale":"2024-01-22T10:13:04.652900+0000","last_undegraded":"2024-01-22T10:13:04.652900+0000","last_fullsized":"2024-01-22T10:13:04.652900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:08:01.408684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652679+0000","last_change":"2024-01-22T10:13:03.495113+0000","last_active":"2024-01-22T10:13:04.652679+0000","last_peered":"2024-01-22T10:13:04.652679+0000","last_clean":"2024-01-22T10:13:04.652679+0000","last_became_active":"2024-01-22T10:13:03.494856+0000","last_became_peered":"2024-01-22T10:13:03.494856+0000","last_unstale":"2024-01-22T10:13:04.652679+0000","last_undegraded":"2024-01-22T10:13:04.652679+0000","last_fullsized":"2024-01-22T10:13:04.652679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:33:39.926559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653345+0000","last_change":"2024-01-22T10:13:03.501906+0000","last_active":"2024-01-22T10:13:04.653345+0000","last_peered":"2024-01-22T10:13:04.653345+0000","last_clean":"2024-01-22T10:13:04.653345+0000","last_became_active":"2024-01-22T10:13:03.501078+0000","last_became_peered":"2024-01-22T10:13:03.501078+0000","last_unstale":"2024-01-22T10:13:04.653345+0000","last_undegraded":"2024-01-22T10:13:04.653345+0000","last_fullsized":"2024-01-22T10:13:04.653345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:26:13.650219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483870+0000","last_change":"2024-01-22T10:13:03.494825+0000","last_active":"2024-01-22T10:13:04.483870+0000","last_peered":"2024-01-22T10:13:04.483870+0000","last_clean":"2024-01-22T10:13:04.483870+0000","last_became_active":"2024-01-22T10:13:03.494556+0000","last_became_peered":"2024-01-22T10:13:03.494556+0000","last_unstale":"2024-01-22T10:13:04.483870+0000","last_undegraded":"2024-01-22T10:13:04.483870+0000","last_fullsized":"2024-01-22T10:13:04.483870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:28:38.011831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652251+0000","last_change":"2024-01-22T10:13:03.492859+0000","last_active":"2024-01-22T10:13:04.652251+0000","last_peered":"2024-01-22T10:13:04.652251+0000","last_clean":"2024-01-22T10:13:04.652251+0000","last_became_active":"2024-01-22T10:13:03.492628+0000","last_became_peered":"2024-01-22T10:13:03.492628+0000","last_unstale":"2024-01-22T10:13:04.652251+0000","last_undegraded":"2024-01-22T10:13:04.652251+0000","last_fullsized":"2024-01-22T10:13:04.652251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:20:16.627504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484299+0000","last_change":"2024-01-22T10:13:03.503667+0000","last_active":"2024-01-22T10:13:04.484299+0000","last_peered":"2024-01-22T10:13:04.484299+0000","last_clean":"2024-01-22T10:13:04.484299+0000","last_became_active":"2024-01-22T10:13:03.503409+0000","last_became_peered":"2024-01-22T10:13:03.503409+0000","last_unstale":"2024-01-22T10:13:04.484299+0000","last_undegraded":"2024-01-22T10:13:04.484299+0000","last_fullsized":"2024-01-22T10:13:04.484299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:33:39.926559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509589+0000","last_change":"2024-01-22T10:13:03.500155+0000","last_active":"2024-01-22T10:13:04.509589+0000","last_peered":"2024-01-22T10:13:04.509589+0000","last_clean":"2024-01-22T10:13:04.509589+0000","last_became_active":"2024-01-22T10:13:03.499892+0000","last_became_peered":"2024-01-22T10:13:03.499892+0000","last_unstale":"2024-01-22T10:13:04.509589+0000","last_undegraded":"2024-01-22T10:13:04.509589+0000","last_fullsized":"2024-01-22T10:13:04.509589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.510149+0000","last_change":"2024-01-22T10:13:03.501001+0000","last_active":"2024-01-22T10:13:04.510149+0000","last_peered":"2024-01-22T10:13:04.510149+0000","last_clean":"2024-01-22T10:13:04.510149+0000","last_became_active":"2024-01-22T10:13:03.500767+0000","last_became_peered":"2024-01-22T10:13:03.500767+0000","last_unstale":"2024-01-22T10:13:04.510149+0000","last_undegraded":"2024-01-22T10:13:04.510149+0000","last_fullsized":"2024-01-22T10:13:04.510149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:05:11.277521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652376+0000","last_change":"2024-01-22T10:13:03.492397+0000","last_active":"2024-01-22T10:13:04.652376+0000","last_peered":"2024-01-22T10:13:04.652376+0000","last_clean":"2024-01-22T10:13:04.652376+0000","last_became_active":"2024-01-22T10:13:03.492127+0000","last_became_peered":"2024-01-22T10:13:03.492127+0000","last_unstale":"2024-01-22T10:13:04.652376+0000","last_undegraded":"2024-01-22T10:13:04.652376+0000","last_fullsized":"2024-01-22T10:13:04.652376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:26:13.650219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483270+0000","last_change":"2024-01-22T10:13:03.491259+0000","last_active":"2024-01-22T10:13:04.483270+0000","last_peered":"2024-01-22T10:13:04.483270+0000","last_clean":"2024-01-22T10:13:04.483270+0000","last_became_active":"2024-01-22T10:13:03.489580+0000","last_became_peered":"2024-01-22T10:13:03.489580+0000","last_unstale":"2024-01-22T10:13:04.483270+0000","last_undegraded":"2024-01-22T10:13:04.483270+0000","last_fullsized":"2024-01-22T10:13:04.483270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:43:40.855210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652921+0000","last_change":"2024-01-22T10:13:03.506931+0000","last_active":"2024-01-22T10:13:04.652921+0000","last_peered":"2024-01-22T10:13:04.652921+0000","last_clean":"2024-01-22T10:13:04.652921+0000","last_became_active":"2024-01-22T10:13:03.505686+0000","last_became_peered":"2024-01-22T10:13:03.505686+0000","last_unstale":"2024-01-22T10:13:04.652921+0000","last_undegraded":"2024-01-22T10:13:04.652921+0000","last_fullsized":"2024-01-22T10:13:04.652921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652496+0000","last_change":"2024-01-22T10:13:03.496832+0000","last_active":"2024-01-22T10:13:04.652496+0000","last_peered":"2024-01-22T10:13:04.652496+0000","last_clean":"2024-01-22T10:13:04.652496+0000","last_became_active":"2024-01-22T10:13:03.496550+0000","last_became_peered":"2024-01-22T10:13:03.496550+0000","last_unstale":"2024-01-22T10:13:04.652496+0000","last_undegraded":"2024-01-22T10:13:04.652496+0000","last_fullsized":"2024-01-22T10:13:04.652496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:43:22.787729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509734+0000","last_change":"2024-01-22T10:13:03.503279+0000","last_active":"2024-01-22T10:13:04.509734+0000","last_peered":"2024-01-22T10:13:04.509734+0000","last_clean":"2024-01-22T10:13:04.509734+0000","last_became_active":"2024-01-22T10:13:03.502324+0000","last_became_peered":"2024-01-22T10:13:03.502324+0000","last_unstale":"2024-01-22T10:13:04.509734+0000","last_undegraded":"2024-01-22T10:13:04.509734+0000","last_fullsized":"2024-01-22T10:13:04.509734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:52:13.153249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483600+0000","last_change":"2024-01-22T10:13:03.504327+0000","last_active":"2024-01-22T10:13:04.483600+0000","last_peered":"2024-01-22T10:13:04.483600+0000","last_clean":"2024-01-22T10:13:04.483600+0000","last_became_active":"2024-01-22T10:13:03.504047+0000","last_became_peered":"2024-01-22T10:13:03.504047+0000","last_unstale":"2024-01-22T10:13:04.483600+0000","last_undegraded":"2024-01-22T10:13:04.483600+0000","last_fullsized":"2024-01-22T10:13:04.483600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:10:02.956052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509658+0000","last_change":"2024-01-22T10:13:03.499696+0000","last_active":"2024-01-22T10:13:04.509658+0000","last_peered":"2024-01-22T10:13:04.509658+0000","last_clean":"2024-01-22T10:13:04.509658+0000","last_became_active":"2024-01-22T10:13:03.499363+0000","last_became_peered":"2024-01-22T10:13:03.499363+0000","last_unstale":"2024-01-22T10:13:04.509658+0000","last_undegraded":"2024-01-22T10:13:04.509658+0000","last_fullsized":"2024-01-22T10:13:04.509658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483902+0000","last_change":"2024-01-22T10:13:03.504284+0000","last_active":"2024-01-22T10:13:04.483902+0000","last_peered":"2024-01-22T10:13:04.483902+0000","last_clean":"2024-01-22T10:13:04.483902+0000","last_became_active":"2024-01-22T10:13:03.504024+0000","last_became_peered":"2024-01-22T10:13:03.504024+0000","last_unstale":"2024-01-22T10:13:04.483902+0000","last_undegraded":"2024-01-22T10:13:04.483902+0000","last_fullsized":"2024-01-22T10:13:04.483902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:52:13.153249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653011+0000","last_change":"2024-01-22T10:13:03.496717+0000","last_active":"2024-01-22T10:13:04.653011+0000","last_peered":"2024-01-22T10:13:04.653011+0000","last_clean":"2024-01-22T10:13:04.653011+0000","last_became_active":"2024-01-22T10:13:03.496422+0000","last_became_peered":"2024-01-22T10:13:03.496422+0000","last_unstale":"2024-01-22T10:13:04.653011+0000","last_undegraded":"2024-01-22T10:13:04.653011+0000","last_fullsized":"2024-01-22T10:13:04.653011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484458+0000","last_change":"2024-01-22T10:13:03.491265+0000","last_active":"2024-01-22T10:13:04.484458+0000","last_peered":"2024-01-22T10:13:04.484458+0000","last_clean":"2024-01-22T10:13:04.484458+0000","last_became_active":"2024-01-22T10:13:03.490993+0000","last_became_peered":"2024-01-22T10:13:03.490993+0000","last_unstale":"2024-01-22T10:13:04.484458+0000","last_undegraded":"2024-01-22T10:13:04.484458+0000","last_fullsized":"2024-01-22T10:13:04.484458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483894+0000","last_change":"2024-01-22T10:13:03.504160+0000","last_active":"2024-01-22T10:13:04.483894+0000","last_peered":"2024-01-22T10:13:04.483894+0000","last_clean":"2024-01-22T10:13:04.483894+0000","last_became_active":"2024-01-22T10:13:03.503946+0000","last_became_peered":"2024-01-22T10:13:03.503946+0000","last_unstale":"2024-01-22T10:13:04.483894+0000","last_undegraded":"2024-01-22T10:13:04.483894+0000","last_fullsized":"2024-01-22T10:13:04.483894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:23.433091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652533+0000","last_change":"2024-01-22T10:13:03.497065+0000","last_active":"2024-01-22T10:13:04.652533+0000","last_peered":"2024-01-22T10:13:04.652533+0000","last_clean":"2024-01-22T10:13:04.652533+0000","last_became_active":"2024-01-22T10:13:03.496805+0000","last_became_peered":"2024-01-22T10:13:03.496805+0000","last_unstale":"2024-01-22T10:13:04.652533+0000","last_undegraded":"2024-01-22T10:13:04.652533+0000","last_fullsized":"2024-01-22T10:13:04.652533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:33:39.926559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509854+0000","last_change":"2024-01-22T10:13:03.499866+0000","last_active":"2024-01-22T10:13:04.509854+0000","last_peered":"2024-01-22T10:13:04.509854+0000","last_clean":"2024-01-22T10:13:04.509854+0000","last_became_active":"2024-01-22T10:13:03.499534+0000","last_became_peered":"2024-01-22T10:13:03.499534+0000","last_unstale":"2024-01-22T10:13:04.509854+0000","last_undegraded":"2024-01-22T10:13:04.509854+0000","last_fullsized":"2024-01-22T10:13:04.509854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:59:10.835472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652166+0000","last_change":"2024-01-22T10:13:03.495017+0000","last_active":"2024-01-22T10:13:04.652166+0000","last_peered":"2024-01-22T10:13:04.652166+0000","last_clean":"2024-01-22T10:13:04.652166+0000","last_became_active":"2024-01-22T10:13:03.494765+0000","last_became_peered":"2024-01-22T10:13:03.494765+0000","last_unstale":"2024-01-22T10:13:04.652166+0000","last_undegraded":"2024-01-22T10:13:04.652166+0000","last_fullsized":"2024-01-22T10:13:04.652166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:28:12.828318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652480+0000","last_change":"2024-01-22T10:13:03.496343+0000","last_active":"2024-01-22T10:13:04.652480+0000","last_peered":"2024-01-22T10:13:04.652480+0000","last_clean":"2024-01-22T10:13:04.652480+0000","last_became_active":"2024-01-22T10:13:03.496071+0000","last_became_peered":"2024-01-22T10:13:03.496071+0000","last_unstale":"2024-01-22T10:13:04.652480+0000","last_undegraded":"2024-01-22T10:13:04.652480+0000","last_fullsized":"2024-01-22T10:13:04.652480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:14:37.672922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652604+0000","last_change":"2024-01-22T10:13:03.499195+0000","last_active":"2024-01-22T10:13:04.652604+0000","last_peered":"2024-01-22T10:13:04.652604+0000","last_clean":"2024-01-22T10:13:04.652604+0000","last_became_active":"2024-01-22T10:13:03.498657+0000","last_became_peered":"2024-01-22T10:13:03.498657+0000","last_unstale":"2024-01-22T10:13:04.652604+0000","last_undegraded":"2024-01-22T10:13:04.652604+0000","last_fullsized":"2024-01-22T10:13:04.652604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:52:50.082332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483961+0000","last_change":"2024-01-22T10:13:02.508626+0000","last_active":"2024-01-22T10:13:04.483961+0000","last_peered":"2024-01-22T10:13:04.483961+0000","last_clean":"2024-01-22T10:13:04.483961+0000","last_became_active":"2024-01-22T10:13:02.508377+0000","last_became_peered":"2024-01-22T10:13:02.508377+0000","last_unstale":"2024-01-22T10:13:04.483961+0000","last_undegraded":"2024-01-22T10:13:04.483961+0000","last_fullsized":"2024-01-22T10:13:04.483961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:55:15.314732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652615+0000","last_change":"2024-01-22T10:13:03.501315+0000","last_active":"2024-01-22T10:13:04.652615+0000","last_peered":"2024-01-22T10:13:04.652615+0000","last_clean":"2024-01-22T10:13:04.652615+0000","last_became_active":"2024-01-22T10:13:03.501151+0000","last_became_peered":"2024-01-22T10:13:03.501151+0000","last_unstale":"2024-01-22T10:13:04.652615+0000","last_undegraded":"2024-01-22T10:13:04.652615+0000","last_fullsized":"2024-01-22T10:13:04.652615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652770+0000","last_change":"2024-01-22T10:13:02.517526+0000","last_active":"2024-01-22T10:13:04.652770+0000","last_peered":"2024-01-22T10:13:04.652770+0000","last_clean":"2024-01-22T10:13:04.652770+0000","last_became_active":"2024-01-22T10:13:02.517235+0000","last_became_peered":"2024-01-22T10:13:02.517235+0000","last_unstale":"2024-01-22T10:13:04.652770+0000","last_undegraded":"2024-01-22T10:13:04.652770+0000","last_fullsized":"2024-01-22T10:13:04.652770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:53:07.743815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483581+0000","last_change":"2024-01-22T10:13:02.510486+0000","last_active":"2024-01-22T10:13:04.483581+0000","last_peered":"2024-01-22T10:13:04.483581+0000","last_clean":"2024-01-22T10:13:04.483581+0000","last_became_active":"2024-01-22T10:13:02.510213+0000","last_became_peered":"2024-01-22T10:13:02.510213+0000","last_unstale":"2024-01-22T10:13:04.483581+0000","last_undegraded":"2024-01-22T10:13:04.483581+0000","last_fullsized":"2024-01-22T10:13:04.483581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:12.080022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483938+0000","last_change":"2024-01-22T10:13:03.495558+0000","last_active":"2024-01-22T10:13:04.483938+0000","last_peered":"2024-01-22T10:13:04.483938+0000","last_clean":"2024-01-22T10:13:04.483938+0000","last_became_active":"2024-01-22T10:13:03.495279+0000","last_became_peered":"2024-01-22T10:13:03.495279+0000","last_unstale":"2024-01-22T10:13:04.483938+0000","last_undegraded":"2024-01-22T10:13:04.483938+0000","last_fullsized":"2024-01-22T10:13:04.483938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:33:39.926559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509710+0000","last_change":"2024-01-22T10:13:02.518247+0000","last_active":"2024-01-22T10:13:04.509710+0000","last_peered":"2024-01-22T10:13:04.509710+0000","last_clean":"2024-01-22T10:13:04.509710+0000","last_became_active":"2024-01-22T10:13:02.517891+0000","last_became_peered":"2024-01-22T10:13:02.517891+0000","last_unstale":"2024-01-22T10:13:04.509710+0000","last_undegraded":"2024-01-22T10:13:04.509710+0000","last_fullsized":"2024-01-22T10:13:04.509710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:52:49.078163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484290+0000","last_change":"2024-01-22T10:13:03.491458+0000","last_active":"2024-01-22T10:13:04.484290+0000","last_peered":"2024-01-22T10:13:04.484290+0000","last_clean":"2024-01-22T10:13:04.484290+0000","last_became_active":"2024-01-22T10:13:03.490965+0000","last_became_peered":"2024-01-22T10:13:03.490965+0000","last_unstale":"2024-01-22T10:13:04.484290+0000","last_undegraded":"2024-01-22T10:13:04.484290+0000","last_fullsized":"2024-01-22T10:13:04.484290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:43:22.787729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652631+0000","last_change":"2024-01-22T10:13:02.520405+0000","last_active":"2024-01-22T10:13:04.652631+0000","last_peered":"2024-01-22T10:13:04.652631+0000","last_clean":"2024-01-22T10:13:04.652631+0000","last_became_active":"2024-01-22T10:13:02.520031+0000","last_became_peered":"2024-01-22T10:13:02.520031+0000","last_unstale":"2024-01-22T10:13:04.652631+0000","last_undegraded":"2024-01-22T10:13:04.652631+0000","last_fullsized":"2024-01-22T10:13:04.652631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:52:49.078163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.510021+0000","last_change":"2024-01-22T10:13:03.501651+0000","last_active":"2024-01-22T10:13:04.510021+0000","last_peered":"2024-01-22T10:13:04.510021+0000","last_clean":"2024-01-22T10:13:04.510021+0000","last_became_active":"2024-01-22T10:13:03.501327+0000","last_became_peered":"2024-01-22T10:13:03.501327+0000","last_unstale":"2024-01-22T10:13:04.510021+0000","last_undegraded":"2024-01-22T10:13:04.510021+0000","last_fullsized":"2024-01-22T10:13:04.510021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:14:51.613418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.510024+0000","last_change":"2024-01-22T10:13:02.520696+0000","last_active":"2024-01-22T10:13:04.510024+0000","last_peered":"2024-01-22T10:13:04.510024+0000","last_clean":"2024-01-22T10:13:04.510024+0000","last_became_active":"2024-01-22T10:13:02.519608+0000","last_became_peered":"2024-01-22T10:13:02.519608+0000","last_unstale":"2024-01-22T10:13:04.510024+0000","last_undegraded":"2024-01-22T10:13:04.510024+0000","last_fullsized":"2024-01-22T10:13:04.510024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:55:15.314732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652656+0000","last_change":"2024-01-22T10:13:03.495561+0000","last_active":"2024-01-22T10:13:04.652656+0000","last_peered":"2024-01-22T10:13:04.652656+0000","last_clean":"2024-01-22T10:13:04.652656+0000","last_became_active":"2024-01-22T10:13:03.495046+0000","last_became_peered":"2024-01-22T10:13:03.495046+0000","last_unstale":"2024-01-22T10:13:04.652656+0000","last_undegraded":"2024-01-22T10:13:04.652656+0000","last_fullsized":"2024-01-22T10:13:04.652656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484426+0000","last_change":"2024-01-22T10:13:02.520255+0000","last_active":"2024-01-22T10:13:04.484426+0000","last_peered":"2024-01-22T10:13:04.484426+0000","last_clean":"2024-01-22T10:13:04.484426+0000","last_became_active":"2024-01-22T10:13:02.519958+0000","last_became_peered":"2024-01-22T10:13:02.519958+0000","last_unstale":"2024-01-22T10:13:04.484426+0000","last_undegraded":"2024-01-22T10:13:04.484426+0000","last_fullsized":"2024-01-22T10:13:04.484426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:26:12.646050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653423+0000","last_change":"2024-01-22T10:13:03.501610+0000","last_active":"2024-01-22T10:13:04.653423+0000","last_peered":"2024-01-22T10:13:04.653423+0000","last_clean":"2024-01-22T10:13:04.653423+0000","last_became_active":"2024-01-22T10:13:03.500770+0000","last_became_peered":"2024-01-22T10:13:03.500770+0000","last_unstale":"2024-01-22T10:13:04.653423+0000","last_undegraded":"2024-01-22T10:13:04.653423+0000","last_fullsized":"2024-01-22T10:13:04.653423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:46:21.339741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652911+0000","last_change":"2024-01-22T10:13:02.515746+0000","last_active":"2024-01-22T10:13:04.652911+0000","last_peered":"2024-01-22T10:13:04.652911+0000","last_clean":"2024-01-22T10:13:04.652911+0000","last_became_active":"2024-01-22T10:13:02.515480+0000","last_became_peered":"2024-01-22T10:13:02.515480+0000","last_unstale":"2024-01-22T10:13:04.652911+0000","last_undegraded":"2024-01-22T10:13:04.652911+0000","last_fullsized":"2024-01-22T10:13:04.652911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483017+0000","last_change":"2024-01-22T10:13:03.497330+0000","last_active":"2024-01-22T10:13:04.483017+0000","last_peered":"2024-01-22T10:13:04.483017+0000","last_clean":"2024-01-22T10:13:04.483017+0000","last_became_active":"2024-01-22T10:13:03.497059+0000","last_became_peered":"2024-01-22T10:13:03.497059+0000","last_unstale":"2024-01-22T10:13:04.483017+0000","last_undegraded":"2024-01-22T10:13:04.483017+0000","last_fullsized":"2024-01-22T10:13:04.483017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:14:51.613418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652626+0000","last_change":"2024-01-22T10:13:02.517370+0000","last_active":"2024-01-22T10:13:04.652626+0000","last_peered":"2024-01-22T10:13:04.652626+0000","last_clean":"2024-01-22T10:13:04.652626+0000","last_became_active":"2024-01-22T10:13:02.517049+0000","last_became_peered":"2024-01-22T10:13:02.517049+0000","last_unstale":"2024-01-22T10:13:04.652626+0000","last_undegraded":"2024-01-22T10:13:04.652626+0000","last_fullsized":"2024-01-22T10:13:04.652626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:33.688072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652365+0000","last_change":"2024-01-22T10:13:03.499203+0000","last_active":"2024-01-22T10:13:04.652365+0000","last_peered":"2024-01-22T10:13:04.652365+0000","last_clean":"2024-01-22T10:13:04.652365+0000","last_became_active":"2024-01-22T10:13:03.498882+0000","last_became_peered":"2024-01-22T10:13:03.498882+0000","last_unstale":"2024-01-22T10:13:04.652365+0000","last_undegraded":"2024-01-22T10:13:04.652365+0000","last_fullsized":"2024-01-22T10:13:04.652365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:26:02.561919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509844+0000","last_change":"2024-01-22T10:13:02.521514+0000","last_active":"2024-01-22T10:13:04.509844+0000","last_peered":"2024-01-22T10:13:04.509844+0000","last_clean":"2024-01-22T10:13:04.509844+0000","last_became_active":"2024-01-22T10:13:02.521145+0000","last_became_peered":"2024-01-22T10:13:02.521145+0000","last_unstale":"2024-01-22T10:13:04.509844+0000","last_undegraded":"2024-01-22T10:13:04.509844+0000","last_fullsized":"2024-01-22T10:13:04.509844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482950+0000","last_change":"2024-01-22T10:13:03.505052+0000","last_active":"2024-01-22T10:13:04.482950+0000","last_peered":"2024-01-22T10:13:04.482950+0000","last_clean":"2024-01-22T10:13:04.482950+0000","last_became_active":"2024-01-22T10:13:03.504265+0000","last_became_peered":"2024-01-22T10:13:03.504265+0000","last_unstale":"2024-01-22T10:13:04.482950+0000","last_undegraded":"2024-01-22T10:13:04.482950+0000","last_fullsized":"2024-01-22T10:13:04.482950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:25:05.310085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652525+0000","last_change":"2024-01-22T10:13:02.518658+0000","last_active":"2024-01-22T10:13:04.652525+0000","last_peered":"2024-01-22T10:13:04.652525+0000","last_clean":"2024-01-22T10:13:04.652525+0000","last_became_active":"2024-01-22T10:13:02.518390+0000","last_became_peered":"2024-01-22T10:13:02.518390+0000","last_unstale":"2024-01-22T10:13:04.652525+0000","last_undegraded":"2024-01-22T10:13:04.652525+0000","last_fullsized":"2024-01-22T10:13:04.652525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:12.080022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652570+0000","last_change":"2024-01-22T10:13:03.497378+0000","last_active":"2024-01-22T10:13:04.652570+0000","last_peered":"2024-01-22T10:13:04.652570+0000","last_clean":"2024-01-22T10:13:04.652570+0000","last_became_active":"2024-01-22T10:13:03.497000+0000","last_became_peered":"2024-01-22T10:13:03.497000+0000","last_unstale":"2024-01-22T10:13:04.652570+0000","last_undegraded":"2024-01-22T10:13:04.652570+0000","last_fullsized":"2024-01-22T10:13:04.652570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:43:22.787729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652033+0000","last_change":"2024-01-22T10:13:02.510852+0000","last_active":"2024-01-22T10:13:04.652033+0000","last_peered":"2024-01-22T10:13:04.652033+0000","last_clean":"2024-01-22T10:13:04.652033+0000","last_became_active":"2024-01-22T10:13:02.510574+0000","last_became_peered":"2024-01-22T10:13:02.510574+0000","last_unstale":"2024-01-22T10:13:04.652033+0000","last_undegraded":"2024-01-22T10:13:04.652033+0000","last_fullsized":"2024-01-22T10:13:04.652033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:55:15.314732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482713+0000","last_change":"2024-01-22T10:13:03.504783+0000","last_active":"2024-01-22T10:13:04.482713+0000","last_peered":"2024-01-22T10:13:04.482713+0000","last_clean":"2024-01-22T10:13:04.482713+0000","last_became_active":"2024-01-22T10:13:03.504479+0000","last_became_peered":"2024-01-22T10:13:03.504479+0000","last_unstale":"2024-01-22T10:13:04.482713+0000","last_undegraded":"2024-01-22T10:13:04.482713+0000","last_fullsized":"2024-01-22T10:13:04.482713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:24:59.153525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653388+0000","last_change":"2024-01-22T10:13:02.515839+0000","last_active":"2024-01-22T10:13:04.653388+0000","last_peered":"2024-01-22T10:13:04.653388+0000","last_clean":"2024-01-22T10:13:04.653388+0000","last_became_active":"2024-01-22T10:13:02.515570+0000","last_became_peered":"2024-01-22T10:13:02.515570+0000","last_unstale":"2024-01-22T10:13:04.653388+0000","last_undegraded":"2024-01-22T10:13:04.653388+0000","last_fullsized":"2024-01-22T10:13:04.653388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:53:07.456362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483233+0000","last_change":"2024-01-22T10:13:03.504368+0000","last_active":"2024-01-22T10:13:04.483233+0000","last_peered":"2024-01-22T10:13:04.483233+0000","last_clean":"2024-01-22T10:13:04.483233+0000","last_became_active":"2024-01-22T10:13:03.504085+0000","last_became_peered":"2024-01-22T10:13:03.504085+0000","last_unstale":"2024-01-22T10:13:04.483233+0000","last_undegraded":"2024-01-22T10:13:04.483233+0000","last_fullsized":"2024-01-22T10:13:04.483233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:42:23.812565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652462+0000","last_change":"2024-01-22T10:13:02.508413+0000","last_active":"2024-01-22T10:13:04.652462+0000","last_peered":"2024-01-22T10:13:04.652462+0000","last_clean":"2024-01-22T10:13:04.652462+0000","last_became_active":"2024-01-22T10:13:02.508164+0000","last_became_peered":"2024-01-22T10:13:02.508164+0000","last_unstale":"2024-01-22T10:13:04.652462+0000","last_undegraded":"2024-01-22T10:13:04.652462+0000","last_fullsized":"2024-01-22T10:13:04.652462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483520+0000","last_change":"2024-01-22T10:13:03.501288+0000","last_active":"2024-01-22T10:13:04.483520+0000","last_peered":"2024-01-22T10:13:04.483520+0000","last_clean":"2024-01-22T10:13:04.483520+0000","last_became_active":"2024-01-22T10:13:03.501009+0000","last_became_peered":"2024-01-22T10:13:03.501009+0000","last_unstale":"2024-01-22T10:13:04.483520+0000","last_undegraded":"2024-01-22T10:13:04.483520+0000","last_fullsized":"2024-01-22T10:13:04.483520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:06.156461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484504+0000","last_change":"2024-01-22T10:13:02.517585+0000","last_active":"2024-01-22T10:13:04.484504+0000","last_peered":"2024-01-22T10:13:04.484504+0000","last_clean":"2024-01-22T10:13:04.484504+0000","last_became_active":"2024-01-22T10:13:02.517264+0000","last_became_peered":"2024-01-22T10:13:02.517264+0000","last_unstale":"2024-01-22T10:13:04.484504+0000","last_undegraded":"2024-01-22T10:13:04.484504+0000","last_fullsized":"2024-01-22T10:13:04.484504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:28:11.824149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509907+0000","last_change":"2024-01-22T10:13:03.494074+0000","last_active":"2024-01-22T10:13:04.509907+0000","last_peered":"2024-01-22T10:13:04.509907+0000","last_clean":"2024-01-22T10:13:04.509907+0000","last_became_active":"2024-01-22T10:13:03.493813+0000","last_became_peered":"2024-01-22T10:13:03.493813+0000","last_unstale":"2024-01-22T10:13:04.509907+0000","last_undegraded":"2024-01-22T10:13:04.509907+0000","last_fullsized":"2024-01-22T10:13:04.509907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:24:59.153525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652344+0000","last_change":"2024-01-22T10:13:02.520256+0000","last_active":"2024-01-22T10:13:04.652344+0000","last_peered":"2024-01-22T10:13:04.652344+0000","last_clean":"2024-01-22T10:13:04.652344+0000","last_became_active":"2024-01-22T10:13:02.519958+0000","last_became_peered":"2024-01-22T10:13:02.519958+0000","last_unstale":"2024-01-22T10:13:04.652344+0000","last_undegraded":"2024-01-22T10:13:04.652344+0000","last_fullsized":"2024-01-22T10:13:04.652344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:53:07.743815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483076+0000","last_change":"2024-01-22T10:13:03.496747+0000","last_active":"2024-01-22T10:13:04.483076+0000","last_peered":"2024-01-22T10:13:04.483076+0000","last_clean":"2024-01-22T10:13:04.483076+0000","last_became_active":"2024-01-22T10:13:03.496101+0000","last_became_peered":"2024-01-22T10:13:03.496101+0000","last_unstale":"2024-01-22T10:13:04.483076+0000","last_undegraded":"2024-01-22T10:13:04.483076+0000","last_fullsized":"2024-01-22T10:13:04.483076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:05:11.277521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-01-22T10:13:03.481850+0000","last_change":"2024-01-22T10:12:52.033359+0000","last_active":"2024-01-22T10:13:03.481850+0000","last_peered":"2024-01-22T10:13:03.481850+0000","last_clean":"2024-01-22T10:13:03.481850+0000","last_became_active":"2024-01-22T10:12:52.033101+0000","last_became_peered":"2024-01-22T10:12:52.033101+0000","last_unstale":"2024-01-22T10:13:03.481850+0000","last_undegraded":"2024-01-22T10:13:03.481850+0000","last_fullsized":"2024-01-22T10:13:03.481850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_clean_scrub_stamp":"2024-01-22T10:12:51.022957+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:45:37.023233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509648+0000","last_change":"2024-01-22T10:13:02.520393+0000","last_active":"2024-01-22T10:13:04.509648+0000","last_peered":"2024-01-22T10:13:04.509648+0000","last_clean":"2024-01-22T10:13:04.509648+0000","last_became_active":"2024-01-22T10:13:02.519136+0000","last_became_peered":"2024-01-22T10:13:02.519136+0000","last_unstale":"2024-01-22T10:13:04.509648+0000","last_undegraded":"2024-01-22T10:13:04.509648+0000","last_fullsized":"2024-01-22T10:13:04.509648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:12.080022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483783+0000","last_change":"2024-01-22T10:13:03.492656+0000","last_active":"2024-01-22T10:13:04.483783+0000","last_peered":"2024-01-22T10:13:04.483783+0000","last_clean":"2024-01-22T10:13:04.483783+0000","last_became_active":"2024-01-22T10:13:03.492384+0000","last_became_peered":"2024-01-22T10:13:03.492384+0000","last_unstale":"2024-01-22T10:13:04.483783+0000","last_undegraded":"2024-01-22T10:13:04.483783+0000","last_fullsized":"2024-01-22T10:13:04.483783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:02:23.405043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482591+0000","last_change":"2024-01-22T10:13:02.516696+0000","last_active":"2024-01-22T10:13:04.482591+0000","last_peered":"2024-01-22T10:13:04.482591+0000","last_clean":"2024-01-22T10:13:04.482591+0000","last_became_active":"2024-01-22T10:13:02.515332+0000","last_became_peered":"2024-01-22T10:13:02.515332+0000","last_unstale":"2024-01-22T10:13:04.482591+0000","last_undegraded":"2024-01-22T10:13:04.482591+0000","last_fullsized":"2024-01-22T10:13:04.482591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:27:12.120129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652280+0000","last_change":"2024-01-22T10:13:03.503310+0000","last_active":"2024-01-22T10:13:04.652280+0000","last_peered":"2024-01-22T10:13:04.652280+0000","last_clean":"2024-01-22T10:13:04.652280+0000","last_became_active":"2024-01-22T10:13:03.503035+0000","last_became_peered":"2024-01-22T10:13:03.503035+0000","last_unstale":"2024-01-22T10:13:04.652280+0000","last_undegraded":"2024-01-22T10:13:04.652280+0000","last_fullsized":"2024-01-22T10:13:04.652280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:19:02.332837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652246+0000","last_change":"2024-01-22T10:13:02.515616+0000","last_active":"2024-01-22T10:13:04.652246+0000","last_peered":"2024-01-22T10:13:04.652246+0000","last_clean":"2024-01-22T10:13:04.652246+0000","last_became_active":"2024-01-22T10:13:02.515305+0000","last_became_peered":"2024-01-22T10:13:02.515305+0000","last_unstale":"2024-01-22T10:13:04.652246+0000","last_undegraded":"2024-01-22T10:13:04.652246+0000","last_fullsized":"2024-01-22T10:13:04.652246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:40:12.080022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484326+0000","last_change":"2024-01-22T10:13:03.488752+0000","last_active":"2024-01-22T10:13:04.484326+0000","last_peered":"2024-01-22T10:13:04.484326+0000","last_clean":"2024-01-22T10:13:04.484326+0000","last_became_active":"2024-01-22T10:13:03.488507+0000","last_became_peered":"2024-01-22T10:13:03.488507+0000","last_unstale":"2024-01-22T10:13:04.484326+0000","last_undegraded":"2024-01-22T10:13:04.484326+0000","last_fullsized":"2024-01-22T10:13:04.484326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:10:02.956052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509999+0000","last_change":"2024-01-22T10:13:02.519467+0000","last_active":"2024-01-22T10:13:04.509999+0000","last_peered":"2024-01-22T10:13:04.509999+0000","last_clean":"2024-01-22T10:13:04.509999+0000","last_became_active":"2024-01-22T10:13:02.518703+0000","last_became_peered":"2024-01-22T10:13:02.518703+0000","last_unstale":"2024-01-22T10:13:04.509999+0000","last_undegraded":"2024-01-22T10:13:04.509999+0000","last_fullsized":"2024-01-22T10:13:04.509999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:53:07.743815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653092+0000","last_change":"2024-01-22T10:13:03.502386+0000","last_active":"2024-01-22T10:13:04.653092+0000","last_peered":"2024-01-22T10:13:04.653092+0000","last_clean":"2024-01-22T10:13:04.653092+0000","last_became_active":"2024-01-22T10:13:03.501769+0000","last_became_peered":"2024-01-22T10:13:03.501769+0000","last_unstale":"2024-01-22T10:13:04.653092+0000","last_undegraded":"2024-01-22T10:13:04.653092+0000","last_fullsized":"2024-01-22T10:13:04.653092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:28:12.828318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484433+0000","last_change":"2024-01-22T10:13:02.513770+0000","last_active":"2024-01-22T10:13:04.484433+0000","last_peered":"2024-01-22T10:13:04.484433+0000","last_clean":"2024-01-22T10:13:04.484433+0000","last_became_active":"2024-01-22T10:13:02.513467+0000","last_became_peered":"2024-01-22T10:13:02.513467+0000","last_unstale":"2024-01-22T10:13:04.484433+0000","last_undegraded":"2024-01-22T10:13:04.484433+0000","last_fullsized":"2024-01-22T10:13:04.484433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:27:12.120129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.510030+0000","last_change":"2024-01-22T10:13:03.494128+0000","last_active":"2024-01-22T10:13:04.510030+0000","last_peered":"2024-01-22T10:13:04.510030+0000","last_clean":"2024-01-22T10:13:04.510030+0000","last_became_active":"2024-01-22T10:13:03.493896+0000","last_became_peered":"2024-01-22T10:13:03.493896+0000","last_unstale":"2024-01-22T10:13:04.510030+0000","last_undegraded":"2024-01-22T10:13:04.510030+0000","last_fullsized":"2024-01-22T10:13:04.510030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:01:27.029405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483336+0000","last_change":"2024-01-22T10:13:02.516338+0000","last_active":"2024-01-22T10:13:04.483336+0000","last_peered":"2024-01-22T10:13:04.483336+0000","last_clean":"2024-01-22T10:13:04.483336+0000","last_became_active":"2024-01-22T10:13:02.516078+0000","last_became_peered":"2024-01-22T10:13:02.516078+0000","last_unstale":"2024-01-22T10:13:04.483336+0000","last_undegraded":"2024-01-22T10:13:04.483336+0000","last_fullsized":"2024-01-22T10:13:04.483336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:20:15.623335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484425+0000","last_change":"2024-01-22T10:13:03.489431+0000","last_active":"2024-01-22T10:13:04.484425+0000","last_peered":"2024-01-22T10:13:04.484425+0000","last_clean":"2024-01-22T10:13:04.484425+0000","last_became_active":"2024-01-22T10:13:03.489087+0000","last_became_peered":"2024-01-22T10:13:03.489087+0000","last_unstale":"2024-01-22T10:13:04.484425+0000","last_undegraded":"2024-01-22T10:13:04.484425+0000","last_fullsized":"2024-01-22T10:13:04.484425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:08:01.408684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:05.520945+0000","last_change":"2024-01-22T10:13:02.511112+0000","last_active":"2024-01-22T10:13:05.520945+0000","last_peered":"2024-01-22T10:13:05.520945+0000","last_clean":"2024-01-22T10:13:05.520945+0000","last_became_active":"2024-01-22T10:13:02.510787+0000","last_became_peered":"2024-01-22T10:13:02.510787+0000","last_unstale":"2024-01-22T10:13:05.520945+0000","last_undegraded":"2024-01-22T10:13:05.520945+0000","last_fullsized":"2024-01-22T10:13:05.520945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:52:49.078163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483990+0000","last_change":"2024-01-22T10:13:03.493410+0000","last_active":"2024-01-22T10:13:04.483990+0000","last_peered":"2024-01-22T10:13:04.483990+0000","last_clean":"2024-01-22T10:13:04.483990+0000","last_became_active":"2024-01-22T10:13:03.493143+0000","last_became_peered":"2024-01-22T10:13:03.493143+0000","last_unstale":"2024-01-22T10:13:04.483990+0000","last_undegraded":"2024-01-22T10:13:04.483990+0000","last_fullsized":"2024-01-22T10:13:04.483990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:18:49.293366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652802+0000","last_change":"2024-01-22T10:13:02.513484+0000","last_active":"2024-01-22T10:13:04.652802+0000","last_peered":"2024-01-22T10:13:04.652802+0000","last_clean":"2024-01-22T10:13:04.652802+0000","last_became_active":"2024-01-22T10:13:02.513171+0000","last_became_peered":"2024-01-22T10:13:02.513171+0000","last_unstale":"2024-01-22T10:13:04.652802+0000","last_undegraded":"2024-01-22T10:13:04.652802+0000","last_fullsized":"2024-01-22T10:13:04.652802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:27:12.120129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652593+0000","last_change":"2024-01-22T10:13:03.495046+0000","last_active":"2024-01-22T10:13:04.652593+0000","last_peered":"2024-01-22T10:13:04.652593+0000","last_clean":"2024-01-22T10:13:04.652593+0000","last_became_active":"2024-01-22T10:13:03.494817+0000","last_became_peered":"2024-01-22T10:13:03.494817+0000","last_unstale":"2024-01-22T10:13:04.652593+0000","last_undegraded":"2024-01-22T10:13:04.652593+0000","last_fullsized":"2024-01-22T10:13:04.652593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:08:01.408684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482603+0000","last_change":"2024-01-22T10:13:02.516259+0000","last_active":"2024-01-22T10:13:04.482603+0000","last_peered":"2024-01-22T10:13:04.482603+0000","last_clean":"2024-01-22T10:13:04.482603+0000","last_became_active":"2024-01-22T10:13:02.515672+0000","last_became_peered":"2024-01-22T10:13:02.515672+0000","last_unstale":"2024-01-22T10:13:04.482603+0000","last_undegraded":"2024-01-22T10:13:04.482603+0000","last_fullsized":"2024-01-22T10:13:04.482603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:28:11.824149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.653012+0000","last_change":"2024-01-22T10:13:03.501480+0000","last_active":"2024-01-22T10:13:04.653012+0000","last_peered":"2024-01-22T10:13:04.653012+0000","last_clean":"2024-01-22T10:13:04.653012+0000","last_became_active":"2024-01-22T10:13:03.500884+0000","last_became_peered":"2024-01-22T10:13:03.500884+0000","last_unstale":"2024-01-22T10:13:04.653012+0000","last_undegraded":"2024-01-22T10:13:04.653012+0000","last_fullsized":"2024-01-22T10:13:04.653012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:27:13.124298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484380+0000","last_change":"2024-01-22T10:13:02.507443+0000","last_active":"2024-01-22T10:13:04.484380+0000","last_peered":"2024-01-22T10:13:04.484380+0000","last_clean":"2024-01-22T10:13:04.484380+0000","last_became_active":"2024-01-22T10:13:02.507186+0000","last_became_peered":"2024-01-22T10:13:02.507186+0000","last_unstale":"2024-01-22T10:13:04.484380+0000","last_undegraded":"2024-01-22T10:13:04.484380+0000","last_fullsized":"2024-01-22T10:13:04.484380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:53:07.743815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483642+0000","last_change":"2024-01-22T10:13:03.487955+0000","last_active":"2024-01-22T10:13:04.483642+0000","last_peered":"2024-01-22T10:13:04.483642+0000","last_clean":"2024-01-22T10:13:04.483642+0000","last_became_active":"2024-01-22T10:13:03.487676+0000","last_became_peered":"2024-01-22T10:13:03.487676+0000","last_unstale":"2024-01-22T10:13:04.483642+0000","last_undegraded":"2024-01-22T10:13:04.483642+0000","last_fullsized":"2024-01-22T10:13:04.483642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:08:01.408684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.484589+0000","last_change":"2024-01-22T10:13:02.507207+0000","last_active":"2024-01-22T10:13:04.484589+0000","last_peered":"2024-01-22T10:13:04.484589+0000","last_clean":"2024-01-22T10:13:04.484589+0000","last_became_active":"2024-01-22T10:13:02.506859+0000","last_became_peered":"2024-01-22T10:13:02.506859+0000","last_unstale":"2024-01-22T10:13:04.484589+0000","last_undegraded":"2024-01-22T10:13:04.484589+0000","last_fullsized":"2024-01-22T10:13:04.484589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483733+0000","last_change":"2024-01-22T10:13:03.495441+0000","last_active":"2024-01-22T10:13:04.483733+0000","last_peered":"2024-01-22T10:13:04.483733+0000","last_clean":"2024-01-22T10:13:04.483733+0000","last_became_active":"2024-01-22T10:13:03.495161+0000","last_became_peered":"2024-01-22T10:13:03.495161+0000","last_unstale":"2024-01-22T10:13:04.483733+0000","last_undegraded":"2024-01-22T10:13:04.483733+0000","last_fullsized":"2024-01-22T10:13:04.483733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:45:52.915070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483100+0000","last_change":"2024-01-22T10:13:02.519141+0000","last_active":"2024-01-22T10:13:04.483100+0000","last_peered":"2024-01-22T10:13:04.483100+0000","last_clean":"2024-01-22T10:13:04.483100+0000","last_became_active":"2024-01-22T10:13:02.518879+0000","last_became_peered":"2024-01-22T10:13:02.518879+0000","last_unstale":"2024-01-22T10:13:04.483100+0000","last_undegraded":"2024-01-22T10:13:04.483100+0000","last_fullsized":"2024-01-22T10:13:04.483100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:23:06.376125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652801+0000","last_change":"2024-01-22T10:13:03.505053+0000","last_active":"2024-01-22T10:13:04.652801+0000","last_peered":"2024-01-22T10:13:04.652801+0000","last_clean":"2024-01-22T10:13:04.652801+0000","last_became_active":"2024-01-22T10:13:03.504770+0000","last_became_peered":"2024-01-22T10:13:03.504770+0000","last_unstale":"2024-01-22T10:13:04.652801+0000","last_undegraded":"2024-01-22T10:13:04.652801+0000","last_fullsized":"2024-01-22T10:13:04.652801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:10:02.956052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509948+0000","last_change":"2024-01-22T10:13:03.503528+0000","last_active":"2024-01-22T10:13:04.509948+0000","last_peered":"2024-01-22T10:13:04.509948+0000","last_clean":"2024-01-22T10:13:04.509948+0000","last_became_active":"2024-01-22T10:13:03.503272+0000","last_became_peered":"2024-01-22T10:13:03.503272+0000","last_unstale":"2024-01-22T10:13:04.509948+0000","last_undegraded":"2024-01-22T10:13:04.509948+0000","last_fullsized":"2024-01-22T10:13:04.509948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:25:05.310085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.482933+0000","last_change":"2024-01-22T10:13:02.521399+0000","last_active":"2024-01-22T10:13:04.482933+0000","last_peered":"2024-01-22T10:13:04.482933+0000","last_clean":"2024-01-22T10:13:04.482933+0000","last_became_active":"2024-01-22T10:13:02.521125+0000","last_became_peered":"2024-01-22T10:13:02.521125+0000","last_unstale":"2024-01-22T10:13:04.482933+0000","last_undegraded":"2024-01-22T10:13:04.482933+0000","last_fullsized":"2024-01-22T10:13:04.482933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:26:12.646050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.509872+0000","last_change":"2024-01-22T10:13:03.503608+0000","last_active":"2024-01-22T10:13:04.509872+0000","last_peered":"2024-01-22T10:13:04.509872+0000","last_clean":"2024-01-22T10:13:04.509872+0000","last_became_active":"2024-01-22T10:13:03.503334+0000","last_became_peered":"2024-01-22T10:13:03.503334+0000","last_unstale":"2024-01-22T10:13:04.509872+0000","last_undegraded":"2024-01-22T10:13:04.509872+0000","last_fullsized":"2024-01-22T10:13:04.509872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:18:49.293366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483210+0000","last_change":"2024-01-22T10:13:02.511844+0000","last_active":"2024-01-22T10:13:04.483210+0000","last_peered":"2024-01-22T10:13:04.483210+0000","last_clean":"2024-01-22T10:13:04.483210+0000","last_became_active":"2024-01-22T10:13:02.510702+0000","last_became_peered":"2024-01-22T10:13:02.510702+0000","last_unstale":"2024-01-22T10:13:04.483210+0000","last_undegraded":"2024-01-22T10:13:04.483210+0000","last_fullsized":"2024-01-22T10:13:04.483210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:46:20.335572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652546+0000","last_change":"2024-01-22T10:13:03.495676+0000","last_active":"2024-01-22T10:13:04.652546+0000","last_peered":"2024-01-22T10:13:04.652546+0000","last_clean":"2024-01-22T10:13:04.652546+0000","last_became_active":"2024-01-22T10:13:03.495309+0000","last_became_peered":"2024-01-22T10:13:03.495309+0000","last_unstale":"2024-01-22T10:13:04.652546+0000","last_undegraded":"2024-01-22T10:13:04.652546+0000","last_fullsized":"2024-01-22T10:13:04.652546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:10:02.956052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483976+0000","last_change":"2024-01-22T10:13:02.513564+0000","last_active":"2024-01-22T10:13:04.483976+0000","last_peered":"2024-01-22T10:13:04.483976+0000","last_clean":"2024-01-22T10:13:04.483976+0000","last_became_active":"2024-01-22T10:13:02.513272+0000","last_became_peered":"2024-01-22T10:13:02.513272+0000","last_unstale":"2024-01-22T10:13:04.483976+0000","last_undegraded":"2024-01-22T10:13:04.483976+0000","last_fullsized":"2024-01-22T10:13:04.483976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:28:43.832843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.483925+0000","last_change":"2024-01-22T10:13:03.492530+0000","last_active":"2024-01-22T10:13:04.483925+0000","last_peered":"2024-01-22T10:13:04.483925+0000","last_clean":"2024-01-22T10:13:04.483925+0000","last_became_active":"2024-01-22T10:13:03.492265+0000","last_became_peered":"2024-01-22T10:13:03.492265+0000","last_unstale":"2024-01-22T10:13:04.483925+0000","last_undegraded":"2024-01-22T10:13:04.483925+0000","last_fullsized":"2024-01-22T10:13:04.483925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:02.493096+0000","last_clean_scrub_stamp":"2024-01-22T10:13:02.493096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:59:10.835472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-22T10:13:04.652704+0000","last_change":"2024-01-22T10:13:02.519858+0000","last_active":"2024-01-22T10:13:04.652704+0000","last_peered":"2024-01-22T10:13:04.652704+0000","last_clean":"2024-01-22T10:13:04.652704+0000","last_became_active":"2024-01-22T10:13:02.519559+0000","last_became_peered":"2024-01-22T10:13:02.519559+0000","last_unstale":"2024-01-22T10:13:04.652704+0000","last_undegraded":"2024-01-22T10:13:04.652704+0000","last_fullsized":"2024-01-22T10:13:04.652704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:01.488926+0000","last_clean_scrub_stamp":"2024-01-22T10:13:01.488926+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:53:07.456362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T10:13:11.050 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-22T10:13:11.050 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-22T10:13:11.050 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-22T10:13:11.050 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-22T10:13:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.202+0000 7f1b90d05640 1 Processor -- start 2024-01-22T10:13:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.202+0000 7f1b90d05640 1 -- start start 2024-01-22T10:13:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.202+0000 7f1b90d05640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b8c0b95e0 0x7f1b8c0b9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.202+0000 7f1b90d05640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1b8c0b9f90 0x7f1b8c153010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.202+0000 7f1b90d05640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8c0b37e0 con 0x7f1b8c0b8920 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.202+0000 7f1b90d05640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8c14c170 con 0x7f1b8c0b9f90 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.202+0000 7f1b90d05640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c0b5570 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.203+0000 7f1b8ad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1b8c0b9f90 0x7f1b8c153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.203+0000 7f1b8a59c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1b8c0b8920 0x7f1b8c14ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42004/0 (socket says 172.21.15.88:42004) 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.203+0000 7f1b8a59c640 1 -- 172.21.15.88:0/1018536368 learned_addr learned my addr 172.21.15.88:0/1018536368 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.203+0000 7f1b89d9b640 1 --2- 172.21.15.88:0/1018536368 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b8c0b95e0 0x7f1b8c0b9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.203+0000 7f1b8ad9d640 1 -- 172.21.15.88:0/1018536368 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b8c0b95e0 msgr2=0x7f1b8c0b9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.203+0000 7f1b8ad9d640 1 --2- 172.21.15.88:0/1018536368 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b8c0b95e0 0x7f1b8c0b9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.203+0000 7f1b8ad9d640 1 -- 172.21.15.88:0/1018536368 >> v1:172.21.15.88:6789/0 conn(0x7f1b8c0b8920 legacy=0x7f1b8c14ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.203+0000 7f1b8959a640 1 -- 172.21.15.88:0/1018536368 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601281533 0 0) 0x7f1b8c0b37e0 con 0x7f1b8c0b8920 2024-01-22T10:13:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.203+0000 7f1b8ad9d640 1 -- 172.21.15.88:0/1018536368 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c0ba420 con 0x7f1b8c0b9f90 2024-01-22T10:13:11.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.204+0000 7f1b8ad9d640 1 --2- 172.21.15.88:0/1018536368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b8c0b9f90 0x7f1b8c153010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00bfa0 tx=0x7f1b7c02e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136090c003fc6d07 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:11.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.204+0000 7f1b8959a640 1 -- 172.21.15.88:0/1018536368 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c02e9b0 con 0x7f1b8c0b9f90 2024-01-22T10:13:11.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.204+0000 7f1b8959a640 1 -- 172.21.15.88:0/1018536368 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c02eb10 con 0x7f1b8c0b9f90 2024-01-22T10:13:11.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.204+0000 7f1b8959a640 1 -- 172.21.15.88:0/1018536368 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c02eea0 con 0x7f1b8c0b9f90 2024-01-22T10:13:11.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.204+0000 7f1b90d05640 1 -- 172.21.15.88:0/1018536368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b8c0b9f90 msgr2=0x7f1b8c153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.204+0000 7f1b90d05640 1 --2- 172.21.15.88:0/1018536368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b8c0b9f90 0x7f1b8c153010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00bfa0 tx=0x7f1b7c02e010 comp rx=0 tx=0).stop 2024-01-22T10:13:11.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.204+0000 7f1b90d05640 1 -- 172.21.15.88:0/1018536368 shutdown_connections 2024-01-22T10:13:11.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.204+0000 7f1b90d05640 1 --2- 172.21.15.88:0/1018536368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b8c0b9f90 0x7f1b8c153010 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.204+0000 7f1b90d05640 1 --2- 172.21.15.88:0/1018536368 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b8c0b95e0 0x7f1b8c0b9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.204+0000 7f1b90d05640 1 -- 172.21.15.88:0/1018536368 >> 172.21.15.88:0/1018536368 conn(0x7f1b8c06a6f0 msgr2=0x7f1b8c06ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:11.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.204+0000 7f1b90d05640 1 -- 172.21.15.88:0/1018536368 shutdown_connections 2024-01-22T10:13:11.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.204+0000 7f1b90d05640 1 -- 172.21.15.88:0/1018536368 wait complete. 2024-01-22T10:13:11.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.205+0000 7f1b90d05640 1 Processor -- start 2024-01-22T10:13:11.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b90d05640 1 -- start start 2024-01-22T10:13:11.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b90d05640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c0b8920 0x7f1b8c0b7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b90d05640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b8c0b95e0 0x7f1b8c070320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b90d05640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b8c0b9f90 0x7f1b8c0a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b90d05640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c0b7a40 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b90d05640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c071ea0 con 0x7f1b8c0b8920 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b90d05640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c06fe90 con 0x7f1b8c0b9f90 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b89d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b8c0b95e0 0x7f1b8c070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b89d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b8c0b95e0 0x7f1b8c070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43992/0 (socket says 172.21.15.88:43992) 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b89d9b640 1 -- 172.21.15.88:0/2621565742 learned_addr learned my addr 172.21.15.88:0/2621565742 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b8a59c640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c0b8920 0x7f1b8c0b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b8ad9d640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b8c0b9f90 0x7f1b8c0a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b89d9b640 1 -- 172.21.15.88:0/2621565742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b8c0b9f90 msgr2=0x7f1b8c0a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b89d9b640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b8c0b9f90 0x7f1b8c0a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b89d9b640 1 -- 172.21.15.88:0/2621565742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c0b8920 msgr2=0x7f1b8c0b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b89d9b640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c0b8920 0x7f1b8c0b7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b89d9b640 1 -- 172.21.15.88:0/2621565742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c00bc80 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.206+0000 7f1b8ad9d640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b8c0b9f90 0x7f1b8c0a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:11.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.207+0000 7f1b89d9b640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b8c0b95e0 0x7f1b8c070320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400d800 tx=0x7f1b7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:11.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.207+0000 7f1b82ffd640 1 -- 172.21.15.88:0/2621565742 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7400b6c0 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.207+0000 7f1b82ffd640 1 -- 172.21.15.88:0/2621565742 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7400b820 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.207+0000 7f1b90d05640 1 -- 172.21.15.88:0/2621565742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8c0717a0 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.207+0000 7f1b82ffd640 1 -- 172.21.15.88:0/2621565742 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7400bbb0 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.207+0000 7f1b90d05640 1 -- 172.21.15.88:0/2621565742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8c0720d0 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.208+0000 7f1b90d05640 1 -- 172.21.15.88:0/2621565742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8c144ba0 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.208+0000 7f1b82ffd640 1 -- 172.21.15.88:0/2621565742 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f1b7400bd10 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.209+0000 7f1b82ffd640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1b6c06b360 0x7f1b6c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.209+0000 7f1b82ffd640 1 -- 172.21.15.88:0/2621565742 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b7408a150 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.209+0000 7f1b8a59c640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1b6c06b360 0x7f1b6c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.209+0000 7f1b8a59c640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1b6c06b360 0x7f1b6c06d820 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1b84000f60 tx=0x7f1b84007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:11.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.213+0000 7f1b82ffd640 1 -- 172.21.15.88:0/2621565742 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1b74054e70 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.417+0000 7f1b90d05640 1 -- 172.21.15.88:0/2621565742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1b8c04ea30 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.418+0000 7f1b82ffd640 1 -- 172.21.15.88:0/2621565742 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1b74058490 con 0x7f1b8c0b95e0 2024-01-22T10:13:11.401 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:11.401 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-22T10:13:11.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.419+0000 7f1b90d05640 1 -- 172.21.15.88:0/2621565742 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1b6c06b360 msgr2=0x7f1b6c06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.419+0000 7f1b90d05640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1b6c06b360 0x7f1b6c06d820 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1b84000f60 tx=0x7f1b84007b50 comp rx=0 tx=0).stop 2024-01-22T10:13:11.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.420+0000 7f1b90d05640 1 -- 172.21.15.88:0/2621565742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b8c0b95e0 msgr2=0x7f1b8c070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.420+0000 7f1b90d05640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b8c0b95e0 0x7f1b8c070320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400d800 tx=0x7f1b7400dcc0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.420+0000 7f1b90d05640 1 -- 172.21.15.88:0/2621565742 shutdown_connections 2024-01-22T10:13:11.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.420+0000 7f1b90d05640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1b6c06b360 0x7f1b6c06d820 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.420+0000 7f1b90d05640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b8c0b9f90 0x7f1b8c0a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.420+0000 7f1b90d05640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b8c0b95e0 0x7f1b8c070320 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.420+0000 7f1b90d05640 1 --2- 172.21.15.88:0/2621565742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c0b8920 0x7f1b8c0b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.420+0000 7f1b90d05640 1 -- 172.21.15.88:0/2621565742 >> 172.21.15.88:0/2621565742 conn(0x7f1b8c06a6f0 msgr2=0x7f1b8c0b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:11.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.420+0000 7f1b90d05640 1 -- 172.21.15.88:0/2621565742 shutdown_connections 2024-01-22T10:13:11.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.420+0000 7f1b90d05640 1 -- 172.21.15.88:0/2621565742 wait complete. 2024-01-22T10:13:11.413 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-22T10:13:11.413 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:11.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.532+0000 7f35ce8d0640 1 Processor -- start 2024-01-22T10:13:11.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.532+0000 7f35ce8d0640 1 -- start start 2024-01-22T10:13:11.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.532+0000 7f35ce8d0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35c80bdee0 0x7f35c814b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.532+0000 7f35ce8d0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f35c8148c30 0x7f35c8149080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.532+0000 7f35ce8d0640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c80bb800 con 0x7f35c814ece0 2024-01-22T10:13:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.532+0000 7f35ce8d0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c80bbb50 con 0x7f35c80bdee0 2024-01-22T10:13:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.532+0000 7f35ce8d0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c80bc520 con 0x7f35c8148c30 2024-01-22T10:13:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.532+0000 7f35c7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35c80bdee0 0x7f35c814b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.532+0000 7f35cce6d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f35c814ece0 0x7f35c814f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42014/0 (socket says 172.21.15.88:42014) 2024-01-22T10:13:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.532+0000 7f35c7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35c80bdee0 0x7f35c814b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43998/0 (socket says 172.21.15.88:43998) 2024-01-22T10:13:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.532+0000 7f35cce6d640 1 -- 172.21.15.88:0/262259525 learned_addr learned my addr 172.21.15.88:0/262259525 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.533+0000 7f35c77fe640 1 --2- 172.21.15.88:0/262259525 >> v2:172.21.15.119:3300/0 conn(0x7f35c8148c30 0x7f35c8149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.533+0000 7f35c7fff640 1 -- 172.21.15.88:0/262259525 >> v2:172.21.15.119:3300/0 conn(0x7f35c8148c30 msgr2=0x7f35c8149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.533+0000 7f35c7fff640 1 --2- 172.21.15.88:0/262259525 >> v2:172.21.15.119:3300/0 conn(0x7f35c8148c30 0x7f35c8149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.533+0000 7f35c7fff640 1 -- 172.21.15.88:0/262259525 >> v1:172.21.15.88:6789/0 conn(0x7f35c814ece0 legacy=0x7f35c814f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.533+0000 7f35c7fff640 1 -- 172.21.15.88:0/262259525 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c80bf820 con 0x7f35c80bdee0 2024-01-22T10:13:11.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.533+0000 7f35c6ffd640 1 -- 172.21.15.88:0/262259525 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744763954 0 0) 0x7f35c80bb800 con 0x7f35c814ece0 2024-01-22T10:13:11.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.533+0000 7f35c77fe640 1 --2- 172.21.15.88:0/262259525 >> v2:172.21.15.119:3300/0 conn(0x7f35c8148c30 0x7f35c8149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:11.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.533+0000 7f35c7fff640 1 --2- 172.21.15.88:0/262259525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c80bdee0 0x7f35c814b7e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f35c80befc0 tx=0x7f35b802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7c64814f63aec1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:11.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.534+0000 7f35c6ffd640 1 -- 172.21.15.88:0/262259525 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8031710 con 0x7f35c80bdee0 2024-01-22T10:13:11.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.534+0000 7f35c6ffd640 1 -- 172.21.15.88:0/262259525 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b802f050 con 0x7f35c80bdee0 2024-01-22T10:13:11.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.534+0000 7f35c6ffd640 1 -- 172.21.15.88:0/262259525 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8031a90 con 0x7f35c80bdee0 2024-01-22T10:13:11.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.534+0000 7f35ce8d0640 1 -- 172.21.15.88:0/262259525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c80bdee0 msgr2=0x7f35c814b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.534+0000 7f35ce8d0640 1 --2- 172.21.15.88:0/262259525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c80bdee0 0x7f35c814b7e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f35c80befc0 tx=0x7f35b802b7b0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.534+0000 7f35ce8d0640 1 -- 172.21.15.88:0/262259525 shutdown_connections 2024-01-22T10:13:11.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.534+0000 7f35ce8d0640 1 --2- 172.21.15.88:0/262259525 >> v2:172.21.15.119:3300/0 conn(0x7f35c8148c30 0x7f35c8149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.534+0000 7f35ce8d0640 1 --2- 172.21.15.88:0/262259525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c80bdee0 0x7f35c814b7e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.534+0000 7f35ce8d0640 1 -- 172.21.15.88:0/262259525 >> 172.21.15.88:0/262259525 conn(0x7f35c80a2d80 msgr2=0x7f35c80a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:11.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.534+0000 7f35ce8d0640 1 -- 172.21.15.88:0/262259525 shutdown_connections 2024-01-22T10:13:11.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.534+0000 7f35ce8d0640 1 -- 172.21.15.88:0/262259525 wait complete. 2024-01-22T10:13:11.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.535+0000 7f35ce8d0640 1 Processor -- start 2024-01-22T10:13:11.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.535+0000 7f35ce8d0640 1 -- start start 2024-01-22T10:13:11.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35ce8d0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35c80bdee0 0x7f35c81e4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35ce8d0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c8148c30 0x7f35c80b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35ce8d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35c814ece0 0x7f35c8143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35ce8d0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80bef60 con 0x7f35c8148c30 2024-01-22T10:13:11.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35ce8d0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c81e4c50 con 0x7f35c814ece0 2024-01-22T10:13:11.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35ce8d0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80a6620 con 0x7f35c80bdee0 2024-01-22T10:13:11.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35c77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c8148c30 0x7f35c80b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35c77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c8148c30 0x7f35c80b8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44006/0 (socket says 172.21.15.88:44006) 2024-01-22T10:13:11.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35c77fe640 1 -- 172.21.15.88:0/3429754982 learned_addr learned my addr 172.21.15.88:0/3429754982 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:11.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35c7fff640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35c80bdee0 0x7f35c81e4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35cce6d640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35c814ece0 0x7f35c8143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35c77fe640 1 -- 172.21.15.88:0/3429754982 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35c80bdee0 msgr2=0x7f35c81e4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35c77fe640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35c80bdee0 0x7f35c81e4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35c77fe640 1 -- 172.21.15.88:0/3429754982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35c814ece0 msgr2=0x7f35c8143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35c77fe640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35c814ece0 0x7f35c8143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35c77fe640 1 -- 172.21.15.88:0/3429754982 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b8009400 con 0x7f35c8148c30 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.536+0000 7f35c77fe640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c8148c30 0x7f35c80b8180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00e7e0 tx=0x7f35bc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.537+0000 7f35c4ff9640 1 -- 172.21.15.88:0/3429754982 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc004030 con 0x7f35c8148c30 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.537+0000 7f35c4ff9640 1 -- 172.21.15.88:0/3429754982 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35bc004190 con 0x7f35c8148c30 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.537+0000 7f35c4ff9640 1 -- 172.21.15.88:0/3429754982 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc004520 con 0x7f35c8148c30 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.537+0000 7f35ce8d0640 1 -- 172.21.15.88:0/3429754982 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c80bb070 con 0x7f35c8148c30 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.537+0000 7f35ce8d0640 1 -- 172.21.15.88:0/3429754982 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c81e5270 con 0x7f35c8148c30 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.538+0000 7f35ce8d0640 1 -- 172.21.15.88:0/3429754982 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c80a6890 con 0x7f35c8148c30 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.538+0000 7f35c4ff9640 1 -- 172.21.15.88:0/3429754982 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f35bc00c6d0 con 0x7f35c8148c30 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.538+0000 7f35c4ff9640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f35b406b330 0x7f35b406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.538+0000 7f35c4ff9640 1 -- 172.21.15.88:0/3429754982 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35bc0897b0 con 0x7f35c8148c30 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.538+0000 7f35c7fff640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f35b406b330 0x7f35b406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.539+0000 7f35c7fff640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f35b406b330 0x7f35b406d7f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f35b8035000 tx=0x7f35b8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:11.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.542+0000 7f35c4ff9640 1 -- 172.21.15.88:0/3429754982 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f35bc0544d0 con 0x7f35c8148c30 2024-01-22T10:13:11.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.713+0000 7f35ce8d0640 1 -- 172.21.15.88:0/3429754982 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35c804ea30 con 0x7f35c8148c30 2024-01-22T10:13:11.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.714+0000 7f35c4ff9640 1 -- 172.21.15.88:0/3429754982 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f35bc057af0 con 0x7f35c8148c30 2024-01-22T10:13:11.697 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:11.697 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:11.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.716+0000 7f35ce8d0640 1 -- 172.21.15.88:0/3429754982 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f35b406b330 msgr2=0x7f35b406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.716+0000 7f35ce8d0640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f35b406b330 0x7f35b406d7f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f35b8035000 tx=0x7f35b8008030 comp rx=0 tx=0).stop 2024-01-22T10:13:11.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.716+0000 7f35ce8d0640 1 -- 172.21.15.88:0/3429754982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c8148c30 msgr2=0x7f35c80b8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.716+0000 7f35ce8d0640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c8148c30 0x7f35c80b8180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00e7e0 tx=0x7f35bc00eca0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.716+0000 7f35ce8d0640 1 -- 172.21.15.88:0/3429754982 shutdown_connections 2024-01-22T10:13:11.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.716+0000 7f35ce8d0640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f35b406b330 0x7f35b406d7f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.716+0000 7f35ce8d0640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35c814ece0 0x7f35c8143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.716+0000 7f35ce8d0640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c8148c30 0x7f35c80b8180 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.716+0000 7f35ce8d0640 1 --2- 172.21.15.88:0/3429754982 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35c80bdee0 0x7f35c81e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.716+0000 7f35ce8d0640 1 -- 172.21.15.88:0/3429754982 >> 172.21.15.88:0/3429754982 conn(0x7f35c80a2d80 msgr2=0x7f35c814d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:11.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.716+0000 7f35ce8d0640 1 -- 172.21.15.88:0/3429754982 shutdown_connections 2024-01-22T10:13:11.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.716+0000 7f35ce8d0640 1 -- 172.21.15.88:0/3429754982 wait complete. 2024-01-22T10:13:11.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T10:13:00.844842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T10:13:01.816849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:13:11.710 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:13:11.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.829+0000 7f1a7550f640 1 Processor -- start 2024-01-22T10:13:11.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.830+0000 7f1a7550f640 1 -- start start 2024-01-22T10:13:11.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.830+0000 7f1a7550f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1a70149010 0x7f1a7014b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.830+0000 7f1a7550f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a700bbc70 0x7f1a70156170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.830+0000 7f1a7550f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a700bb7e0 con 0x7f1a700b44f0 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.830+0000 7f1a7550f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a700c04e0 con 0x7f1a70149010 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.830+0000 7f1a7550f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a700a3150 con 0x7f1a700bbc70 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.830+0000 7f1a6e7fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1a700b44f0 0x7f1a700a2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42022/0 (socket says 172.21.15.88:42022) 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.830+0000 7f1a6e7fc640 1 -- 172.21.15.88:0/643009641 learned_addr learned my addr 172.21.15.88:0/643009641 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.830+0000 7f1a6f7fe640 1 --2- 172.21.15.88:0/643009641 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a700bbc70 0x7f1a70156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.830+0000 7f1a6effd640 1 --2- 172.21.15.88:0/643009641 >> v2:172.21.15.119:3300/0 conn(0x7f1a70149010 0x7f1a7014b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.831+0000 7f1a6dffb640 1 -- 172.21.15.88:0/643009641 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552616311 0 0) 0x7f1a700bb7e0 con 0x7f1a700b44f0 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.831+0000 7f1a6dffb640 1 -- 172.21.15.88:0/643009641 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a58003520 con 0x7f1a700b44f0 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.831+0000 7f1a6dffb640 1 -- 172.21.15.88:0/643009641 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 805182709 0 0) 0x7f1a58003520 con 0x7f1a700b44f0 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.831+0000 7f1a6effd640 1 -- 172.21.15.88:0/643009641 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a700bbc70 msgr2=0x7f1a70156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.831+0000 7f1a6effd640 1 --2- 172.21.15.88:0/643009641 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a700bbc70 0x7f1a70156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.831+0000 7f1a6effd640 1 -- 172.21.15.88:0/643009641 >> v1:172.21.15.88:6789/0 conn(0x7f1a700b44f0 legacy=0x7f1a700a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.831+0000 7f1a6effd640 1 -- 172.21.15.88:0/643009641 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a701493f0 con 0x7f1a70149010 2024-01-22T10:13:11.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.831+0000 7f1a6f7fe640 1 --2- 172.21.15.88:0/643009641 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a700bbc70 0x7f1a70156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:11.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.832+0000 7f1a6effd640 1 --2- 172.21.15.88:0/643009641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a70149010 0x7f1a7014b940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1a640097a0 tx=0x7f1a6402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3b13a0441eda72 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:11.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.832+0000 7f1a6dffb640 1 -- 172.21.15.88:0/643009641 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6402f050 con 0x7f1a70149010 2024-01-22T10:13:11.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.832+0000 7f1a6dffb640 1 -- 172.21.15.88:0/643009641 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a64031500 con 0x7f1a70149010 2024-01-22T10:13:11.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.832+0000 7f1a6dffb640 1 -- 172.21.15.88:0/643009641 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60001690 con 0x7f1a70149010 2024-01-22T10:13:11.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.832+0000 7f1a7550f640 1 -- 172.21.15.88:0/643009641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a70149010 msgr2=0x7f1a7014b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.832+0000 7f1a7550f640 1 --2- 172.21.15.88:0/643009641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a70149010 0x7f1a7014b940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1a640097a0 tx=0x7f1a6402b820 comp rx=0 tx=0).stop 2024-01-22T10:13:11.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.832+0000 7f1a7550f640 1 -- 172.21.15.88:0/643009641 shutdown_connections 2024-01-22T10:13:11.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.832+0000 7f1a7550f640 1 --2- 172.21.15.88:0/643009641 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a700bbc70 0x7f1a70156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.832+0000 7f1a7550f640 1 --2- 172.21.15.88:0/643009641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a70149010 0x7f1a7014b940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.832+0000 7f1a7550f640 1 -- 172.21.15.88:0/643009641 >> 172.21.15.88:0/643009641 conn(0x7f1a700c1040 msgr2=0x7f1a700c1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:11.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.832+0000 7f1a7550f640 1 -- 172.21.15.88:0/643009641 shutdown_connections 2024-01-22T10:13:11.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.832+0000 7f1a7550f640 1 -- 172.21.15.88:0/643009641 wait complete. 2024-01-22T10:13:11.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.833+0000 7f1a7550f640 1 Processor -- start 2024-01-22T10:13:11.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a7550f640 1 -- start start 2024-01-22T10:13:11.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a7550f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a700b44f0 0x7f1a701e49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a7550f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a700bbc70 0x7f1a700aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a7550f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a70149010 0x7f1a701435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a7550f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a701e1450 con 0x7f1a700bbc70 2024-01-22T10:13:11.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a7550f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a701e4ee0 con 0x7f1a70149010 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a7550f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a700abfc0 con 0x7f1a700b44f0 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a6e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a700bbc70 0x7f1a700aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a6e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a700bbc70 0x7f1a700aba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44008/0 (socket says 172.21.15.88:44008) 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a6e7fc640 1 -- 172.21.15.88:0/3116228570 learned_addr learned my addr 172.21.15.88:0/3116228570 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a6effd640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a700b44f0 0x7f1a701e49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a6f7fe640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a70149010 0x7f1a701435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a6e7fc640 1 -- 172.21.15.88:0/3116228570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a700b44f0 msgr2=0x7f1a701e49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a6e7fc640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a700b44f0 0x7f1a701e49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a6e7fc640 1 -- 172.21.15.88:0/3116228570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a70149010 msgr2=0x7f1a701435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.834+0000 7f1a6e7fc640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a70149010 0x7f1a701435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.835+0000 7f1a6e7fc640 1 -- 172.21.15.88:0/3116228570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a68009a70 con 0x7f1a700bbc70 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.835+0000 7f1a6f7fe640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a70149010 0x7f1a701435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.835+0000 7f1a6effd640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a700b44f0 0x7f1a701e49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.835+0000 7f1a6e7fc640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a700bbc70 0x7f1a700aba80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000c750 tx=0x7f1a6000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:11.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.835+0000 7f1a577fe640 1 -- 172.21.15.88:0/3116228570 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60005ad0 con 0x7f1a700bbc70 2024-01-22T10:13:11.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.835+0000 7f1a577fe640 1 -- 172.21.15.88:0/3116228570 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a60005c30 con 0x7f1a700bbc70 2024-01-22T10:13:11.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.835+0000 7f1a7550f640 1 -- 172.21.15.88:0/3116228570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a64009400 con 0x7f1a700bbc70 2024-01-22T10:13:11.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.835+0000 7f1a577fe640 1 -- 172.21.15.88:0/3116228570 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60007070 con 0x7f1a700bbc70 2024-01-22T10:13:11.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.835+0000 7f1a7550f640 1 -- 172.21.15.88:0/3116228570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a701e53d0 con 0x7f1a700bbc70 2024-01-22T10:13:11.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.836+0000 7f1a7550f640 1 -- 172.21.15.88:0/3116228570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a700bc6b0 con 0x7f1a700bbc70 2024-01-22T10:13:11.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.836+0000 7f1a577fe640 1 -- 172.21.15.88:0/3116228570 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f1a600071d0 con 0x7f1a700bbc70 2024-01-22T10:13:11.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.837+0000 7f1a577fe640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1a5c06b330 0x7f1a5c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:11.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.837+0000 7f1a577fe640 1 -- 172.21.15.88:0/3116228570 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a600898a0 con 0x7f1a700bbc70 2024-01-22T10:13:11.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.837+0000 7f1a6effd640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1a5c06b330 0x7f1a5c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:11.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.837+0000 7f1a6effd640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1a5c06b330 0x7f1a5c06d7f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a64035000 tx=0x7f1a64008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:11.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:11.841+0000 7f1a577fe640 1 -- 172.21.15.88:0/3116228570 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1a600545c0 con 0x7f1a700bbc70 2024-01-22T10:13:11.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.009+0000 7f1a7550f640 1 -- 172.21.15.88:0/3116228570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a701e15a0 con 0x7f1a700bbc70 2024-01-22T10:13:11.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.010+0000 7f1a577fe640 1 -- 172.21.15.88:0/3116228570 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a60057be0 con 0x7f1a700bbc70 2024-01-22T10:13:11.995 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:13:11.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.011+0000 7f1a7550f640 1 -- 172.21.15.88:0/3116228570 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1a5c06b330 msgr2=0x7f1a5c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.012+0000 7f1a7550f640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1a5c06b330 0x7f1a5c06d7f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a64035000 tx=0x7f1a64008030 comp rx=0 tx=0).stop 2024-01-22T10:13:11.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.012+0000 7f1a7550f640 1 -- 172.21.15.88:0/3116228570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a700bbc70 msgr2=0x7f1a700aba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:11.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.012+0000 7f1a7550f640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a700bbc70 0x7f1a700aba80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000c750 tx=0x7f1a6000cc10 comp rx=0 tx=0).stop 2024-01-22T10:13:11.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.012+0000 7f1a7550f640 1 -- 172.21.15.88:0/3116228570 shutdown_connections 2024-01-22T10:13:11.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.012+0000 7f1a7550f640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1a5c06b330 0x7f1a5c06d7f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.012+0000 7f1a7550f640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a70149010 0x7f1a701435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.012+0000 7f1a7550f640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a700bbc70 0x7f1a700aba80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.012+0000 7f1a7550f640 1 --2- 172.21.15.88:0/3116228570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a700b44f0 0x7f1a701e49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:11.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.012+0000 7f1a7550f640 1 -- 172.21.15.88:0/3116228570 >> 172.21.15.88:0/3116228570 conn(0x7f1a700c1040 msgr2=0x7f1a70146a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:11.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.012+0000 7f1a7550f640 1 -- 172.21.15.88:0/3116228570 shutdown_connections 2024-01-22T10:13:11.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.012+0000 7f1a7550f640 1 -- 172.21.15.88:0/3116228570 wait complete. 2024-01-22T10:13:12.005 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T10:13:12.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.124+0000 7f513965c640 1 Processor -- start 2024-01-22T10:13:12.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.124+0000 7f513965c640 1 -- start start 2024-01-22T10:13:12.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.124+0000 7f513965c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51340b45a0 0x7f513414b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.124+0000 7f513965c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51340bd1c0 con 0x7f51340bbb00 2024-01-22T10:13:12.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.124+0000 7f513965c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51340c0820 con 0x7f51340bdde0 2024-01-22T10:13:12.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.124+0000 7f513965c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51340bc560 con 0x7f51340b45a0 2024-01-22T10:13:12.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.125+0000 7f51327fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51340b45a0 0x7f513414b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.125+0000 7f5132ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f51340bbb00 0x7f513414ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42034/0 (socket says 172.21.15.88:42034) 2024-01-22T10:13:12.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.125+0000 7f5132ffd640 1 -- 172.21.15.88:0/1791786325 learned_addr learned my addr 172.21.15.88:0/1791786325 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:12.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.125+0000 7f51327fc640 1 -- 172.21.15.88:0/1791786325 >> v1:172.21.15.119:6789/0 conn(0x7f51340bdde0 legacy=0x7f5134156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:12.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.125+0000 7f51327fc640 1 -- 172.21.15.88:0/1791786325 >> v1:172.21.15.88:6789/0 conn(0x7f51340bbb00 legacy=0x7f513414ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.125+0000 7f51327fc640 1 -- 172.21.15.88:0/1791786325 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51340c0b00 con 0x7f51340b45a0 2024-01-22T10:13:12.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.125+0000 7f5131ffb640 1 -- 172.21.15.88:0/1791786325 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979567450 0 0) 0x7f51340bd1c0 con 0x7f51340bbb00 2024-01-22T10:13:12.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.126+0000 7f51327fc640 1 --2- 172.21.15.88:0/1791786325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340b45a0 0x7f513414b580 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f51280097a0 tx=0x7f512802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f2c3bda6572924 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:12.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.126+0000 7f5131ffb640 1 -- 172.21.15.88:0/1791786325 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128031830 con 0x7f51340b45a0 2024-01-22T10:13:12.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.126+0000 7f5131ffb640 1 -- 172.21.15.88:0/1791786325 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5128031990 con 0x7f51340b45a0 2024-01-22T10:13:12.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.126+0000 7f5131ffb640 1 -- 172.21.15.88:0/1791786325 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128031d20 con 0x7f51340b45a0 2024-01-22T10:13:12.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.126+0000 7f513965c640 1 -- 172.21.15.88:0/1791786325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340b45a0 msgr2=0x7f513414b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.126+0000 7f513965c640 1 --2- 172.21.15.88:0/1791786325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340b45a0 0x7f513414b580 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f51280097a0 tx=0x7f512802b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.126+0000 7f513965c640 1 -- 172.21.15.88:0/1791786325 shutdown_connections 2024-01-22T10:13:12.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.126+0000 7f513965c640 1 --2- 172.21.15.88:0/1791786325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340b45a0 0x7f513414b580 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.126+0000 7f513965c640 1 -- 172.21.15.88:0/1791786325 >> 172.21.15.88:0/1791786325 conn(0x7f51340a2c20 msgr2=0x7f51340a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:12.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.126+0000 7f513965c640 1 -- 172.21.15.88:0/1791786325 shutdown_connections 2024-01-22T10:13:12.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.126+0000 7f513965c640 1 -- 172.21.15.88:0/1791786325 wait complete. 2024-01-22T10:13:12.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.127+0000 7f513965c640 1 Processor -- start 2024-01-22T10:13:12.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f513965c640 1 -- start start 2024-01-22T10:13:12.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f513965c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51340b45a0 0x7f51340ba850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f513965c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51340bbb00 0x7f51340b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f513965c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340bdde0 0x7f51340b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f513965c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51340b5a70 con 0x7f51340bdde0 2024-01-22T10:13:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f513965c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51340b7520 con 0x7f51340bbb00 2024-01-22T10:13:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f513965c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51340b7790 con 0x7f51340b45a0 2024-01-22T10:13:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f51337fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340bdde0 0x7f51340b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f51337fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340bdde0 0x7f51340b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44024/0 (socket says 172.21.15.88:44024) 2024-01-22T10:13:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f51337fe640 1 -- 172.21.15.88:0/251346362 learned_addr learned my addr 172.21.15.88:0/251346362 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f5132ffd640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51340b45a0 0x7f51340ba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f51327fc640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51340bbb00 0x7f51340b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f51337fe640 1 -- 172.21.15.88:0/251346362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51340b45a0 msgr2=0x7f51340ba850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f51337fe640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51340b45a0 0x7f51340ba850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f51337fe640 1 -- 172.21.15.88:0/251346362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51340bbb00 msgr2=0x7f51340b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f51337fe640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51340bbb00 0x7f51340b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.128+0000 7f51337fe640 1 -- 172.21.15.88:0/251346362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5128009400 con 0x7f51340bdde0 2024-01-22T10:13:12.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.129+0000 7f51337fe640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340bdde0 0x7f51340b5530 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f512c00b9a0 tx=0x7f512c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:12.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.129+0000 7f511b7fe640 1 -- 172.21.15.88:0/251346362 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c00cba0 con 0x7f51340bdde0 2024-01-22T10:13:12.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.129+0000 7f511b7fe640 1 -- 172.21.15.88:0/251346362 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c00cd00 con 0x7f51340bdde0 2024-01-22T10:13:12.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.129+0000 7f511b7fe640 1 -- 172.21.15.88:0/251346362 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c014680 con 0x7f51340bdde0 2024-01-22T10:13:12.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.129+0000 7f513965c640 1 -- 172.21.15.88:0/251346362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51340b7a70 con 0x7f51340bdde0 2024-01-22T10:13:12.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.129+0000 7f513965c640 1 -- 172.21.15.88:0/251346362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51340b6000 con 0x7f51340bdde0 2024-01-22T10:13:12.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.130+0000 7f513965c640 1 -- 172.21.15.88:0/251346362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5134067c40 con 0x7f51340bdde0 2024-01-22T10:13:12.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.130+0000 7f511b7fe640 1 -- 172.21.15.88:0/251346362 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f512c01d3b0 con 0x7f51340bdde0 2024-01-22T10:13:12.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.131+0000 7f511b7fe640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f512006b330 0x7f512006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.131+0000 7f5132ffd640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f512006b330 0x7f512006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.131+0000 7f511b7fe640 1 -- 172.21.15.88:0/251346362 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f512c089a30 con 0x7f51340bdde0 2024-01-22T10:13:12.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.131+0000 7f5132ffd640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f512006b330 0x7f512006d7f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5124000f60 tx=0x7f5124009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:12.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.135+0000 7f511b7fe640 1 -- 172.21.15.88:0/251346362 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f512c054750 con 0x7f51340bdde0 2024-01-22T10:13:12.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.301+0000 7f513965c640 1 -- 172.21.15.88:0/251346362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f513404ea30 con 0x7f51340bdde0 2024-01-22T10:13:12.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.301+0000 7f511b7fe640 1 -- 172.21.15.88:0/251346362 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f512c057d70 con 0x7f51340bdde0 2024-01-22T10:13:12.284 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-01-22T10:13:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.304+0000 7f513965c640 1 -- 172.21.15.88:0/251346362 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f512006b330 msgr2=0x7f512006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.304+0000 7f513965c640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f512006b330 0x7f512006d7f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5124000f60 tx=0x7f5124009040 comp rx=0 tx=0).stop 2024-01-22T10:13:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.304+0000 7f513965c640 1 -- 172.21.15.88:0/251346362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340bdde0 msgr2=0x7f51340b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.304+0000 7f513965c640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340bdde0 0x7f51340b5530 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f512c00b9a0 tx=0x7f512c00be60 comp rx=0 tx=0).stop 2024-01-22T10:13:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.304+0000 7f513965c640 1 -- 172.21.15.88:0/251346362 shutdown_connections 2024-01-22T10:13:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.304+0000 7f513965c640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f512006b330 0x7f512006d7f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.304+0000 7f513965c640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340bdde0 0x7f51340b5530 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.304+0000 7f513965c640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51340bbb00 0x7f51340b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.304+0000 7f513965c640 1 --2- 172.21.15.88:0/251346362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51340b45a0 0x7f51340ba850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.304+0000 7f513965c640 1 -- 172.21.15.88:0/251346362 >> 172.21.15.88:0/251346362 conn(0x7f51340a2c20 msgr2=0x7f5134149530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:12.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.304+0000 7f513965c640 1 -- 172.21.15.88:0/251346362 shutdown_connections 2024-01-22T10:13:12.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.304+0000 7f513965c640 1 -- 172.21.15.88:0/251346362 wait complete. 2024-01-22T10:13:12.296 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T10:13:12.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.416+0000 7f9660ddc640 1 Processor -- start 2024-01-22T10:13:12.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.416+0000 7f9660ddc640 1 -- start start 2024-01-22T10:13:12.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.416+0000 7f9660ddc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f965c0bded0 0x7f965c06aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.416+0000 7f9660ddc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f965c0b4590 0x7f965c148b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.416+0000 7f9660ddc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965c0c0830 con 0x7f965c149050 2024-01-22T10:13:12.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.416+0000 7f9660ddc640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965c0c0b10 con 0x7f965c0b4590 2024-01-22T10:13:12.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.416+0000 7f9660ddc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965c0bb890 con 0x7f965c0bded0 2024-01-22T10:13:12.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.417+0000 7f9653fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f965c0b4590 0x7f965c148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.417+0000 7f9653fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f965c0b4590 0x7f965c148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44026/0 (socket says 172.21.15.88:44026) 2024-01-22T10:13:12.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.417+0000 7f9653fff640 1 -- 172.21.15.88:0/1487918401 learned_addr learned my addr 172.21.15.88:0/1487918401 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:12.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.417+0000 7f965a59c640 1 --2- 172.21.15.88:0/1487918401 >> v2:172.21.15.119:3300/0 conn(0x7f965c0bded0 0x7f965c06aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.417+0000 7f9653fff640 1 -- 172.21.15.88:0/1487918401 >> v2:172.21.15.119:3300/0 conn(0x7f965c0bded0 msgr2=0x7f965c06aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:12.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.417+0000 7f9653fff640 1 --2- 172.21.15.88:0/1487918401 >> v2:172.21.15.119:3300/0 conn(0x7f965c0bded0 0x7f965c06aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.417+0000 7f9653fff640 1 -- 172.21.15.88:0/1487918401 >> v1:172.21.15.119:6789/0 conn(0x7f965c149050 legacy=0x7f965c14ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.417+0000 7f9653fff640 1 -- 172.21.15.88:0/1487918401 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c0bbb70 con 0x7f965c0b4590 2024-01-22T10:13:12.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.417+0000 7f965a59c640 1 --2- 172.21.15.88:0/1487918401 >> v2:172.21.15.119:3300/0 conn(0x7f965c0bded0 0x7f965c06aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:12.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.418+0000 7f9653fff640 1 --2- 172.21.15.88:0/1487918401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f965c0b4590 0x7f965c148b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f965c0be820 tx=0x7f964402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3809a31a214071f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:12.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.418+0000 7f9659d9b640 1 -- 172.21.15.88:0/1487918401 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644030860 con 0x7f965c0b4590 2024-01-22T10:13:12.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.418+0000 7f9659d9b640 1 -- 172.21.15.88:0/1487918401 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96440309c0 con 0x7f965c0b4590 2024-01-22T10:13:12.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.418+0000 7f9659d9b640 1 -- 172.21.15.88:0/1487918401 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644030d50 con 0x7f965c0b4590 2024-01-22T10:13:12.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.418+0000 7f9660ddc640 1 -- 172.21.15.88:0/1487918401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f965c0b4590 msgr2=0x7f965c148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.418+0000 7f9660ddc640 1 --2- 172.21.15.88:0/1487918401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f965c0b4590 0x7f965c148b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f965c0be820 tx=0x7f964402b9a0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.418+0000 7f9660ddc640 1 -- 172.21.15.88:0/1487918401 shutdown_connections 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.418+0000 7f9660ddc640 1 --2- 172.21.15.88:0/1487918401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f965c0b4590 0x7f965c148b10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.418+0000 7f9660ddc640 1 --2- 172.21.15.88:0/1487918401 >> v2:172.21.15.119:3300/0 conn(0x7f965c0bded0 0x7f965c06aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.418+0000 7f9660ddc640 1 -- 172.21.15.88:0/1487918401 >> 172.21.15.88:0/1487918401 conn(0x7f965c0a2d70 msgr2=0x7f965c0a3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.418+0000 7f9660ddc640 1 -- 172.21.15.88:0/1487918401 shutdown_connections 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.418+0000 7f9660ddc640 1 -- 172.21.15.88:0/1487918401 wait complete. 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.419+0000 7f9660ddc640 1 Processor -- start 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.419+0000 7f9660ddc640 1 -- start start 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f9660ddc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f965c0b4590 0x7f965c0b9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f9660ddc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f965c0bded0 0x7f965c149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f9660ddc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f965c149050 0x7f965c1e12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f9660ddc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0ba420 con 0x7f965c0b4590 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f9660ddc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c145240 con 0x7f965c149050 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f9660ddc640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965c14a8e0 con 0x7f965c0bded0 2024-01-22T10:13:12.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f965a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f965c0b4590 0x7f965c0b9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f965a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f965c0b4590 0x7f965c0b9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44038/0 (socket says 172.21.15.88:44038) 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f965a59c640 1 -- 172.21.15.88:0/2644562615 learned_addr learned my addr 172.21.15.88:0/2644562615 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f9653fff640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f965c0bded0 0x7f965c149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f965ad9d640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f965c149050 0x7f965c1e12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f965a59c640 1 -- 172.21.15.88:0/2644562615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f965c0bded0 msgr2=0x7f965c149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f965a59c640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f965c0bded0 0x7f965c149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f965a59c640 1 -- 172.21.15.88:0/2644562615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f965c149050 msgr2=0x7f965c1e12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f965a59c640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f965c149050 0x7f965c1e12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.420+0000 7f965a59c640 1 -- 172.21.15.88:0/2644562615 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96440094d0 con 0x7f965c0b4590 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.421+0000 7f965a59c640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f965c0b4590 0x7f965c0b9ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f964c00e7e0 tx=0x7f964c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.421+0000 7f9652ffd640 1 -- 172.21.15.88:0/2644562615 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c004030 con 0x7f965c0b4590 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.421+0000 7f9652ffd640 1 -- 172.21.15.88:0/2644562615 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c004190 con 0x7f965c0b4590 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.421+0000 7f9652ffd640 1 -- 172.21.15.88:0/2644562615 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c004520 con 0x7f965c0b4590 2024-01-22T10:13:12.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.421+0000 7f9660ddc640 1 -- 172.21.15.88:0/2644562615 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c0baff0 con 0x7f965c0b4590 2024-01-22T10:13:12.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.421+0000 7f9660ddc640 1 -- 172.21.15.88:0/2644562615 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965c14a4e0 con 0x7f965c0b4590 2024-01-22T10:13:12.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.422+0000 7f9660ddc640 1 -- 172.21.15.88:0/2644562615 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965c0bce30 con 0x7f965c0b4590 2024-01-22T10:13:12.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.422+0000 7f9652ffd640 1 -- 172.21.15.88:0/2644562615 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f964c00c6d0 con 0x7f965c0b4590 2024-01-22T10:13:12.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.422+0000 7f9652ffd640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f963c06b330 0x7f963c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.423+0000 7f9652ffd640 1 -- 172.21.15.88:0/2644562615 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f964c0898d0 con 0x7f965c0b4590 2024-01-22T10:13:12.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.423+0000 7f9653fff640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f963c06b330 0x7f963c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.423+0000 7f9653fff640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f963c06b330 0x7f963c06d7f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9644036000 tx=0x7f964403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:12.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.428+0000 7f9652ffd640 1 -- 172.21.15.88:0/2644562615 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f964c0545f0 con 0x7f965c0b4590 2024-01-22T10:13:12.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.596+0000 7f9660ddc640 1 -- 172.21.15.88:0/2644562615 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f965c04ea30 con 0x7f965c0b4590 2024-01-22T10:13:12.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.597+0000 7f9652ffd640 1 -- 172.21.15.88:0/2644562615 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f964c0200a0 con 0x7f965c0b4590 2024-01-22T10:13:12.579 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-01-22T10:13:12.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.598+0000 7f9660ddc640 1 -- 172.21.15.88:0/2644562615 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f963c06b330 msgr2=0x7f963c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.599+0000 7f9660ddc640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f963c06b330 0x7f963c06d7f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9644036000 tx=0x7f964403b040 comp rx=0 tx=0).stop 2024-01-22T10:13:12.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.599+0000 7f9660ddc640 1 -- 172.21.15.88:0/2644562615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f965c0b4590 msgr2=0x7f965c0b9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.599+0000 7f9660ddc640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f965c0b4590 0x7f965c0b9ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f964c00e7e0 tx=0x7f964c00eca0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.599+0000 7f9660ddc640 1 -- 172.21.15.88:0/2644562615 shutdown_connections 2024-01-22T10:13:12.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.599+0000 7f9660ddc640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f963c06b330 0x7f963c06d7f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.599+0000 7f9660ddc640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f965c0bded0 0x7f965c149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.599+0000 7f9660ddc640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f965c149050 0x7f965c1e12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.599+0000 7f9660ddc640 1 --2- 172.21.15.88:0/2644562615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f965c0b4590 0x7f965c0b9ee0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.599+0000 7f9660ddc640 1 -- 172.21.15.88:0/2644562615 >> 172.21.15.88:0/2644562615 conn(0x7f965c0a2d70 msgr2=0x7f965c0a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:12.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.599+0000 7f9660ddc640 1 -- 172.21.15.88:0/2644562615 shutdown_connections 2024-01-22T10:13:12.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.599+0000 7f9660ddc640 1 -- 172.21.15.88:0/2644562615 wait complete. 2024-01-22T10:13:12.592 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:13:12.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.709+0000 7f848b09b640 1 Processor -- start 2024-01-22T10:13:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.709+0000 7f848b09b640 1 -- start start 2024-01-22T10:13:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.709+0000 7f848b09b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84840bd490 0x7f84841433d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.709+0000 7f848b09b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8484149ad0 0x7f8484153d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f848b09b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84840b2960 con 0x7f8484143910 2024-01-22T10:13:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f848b09b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84840b3160 con 0x7f8484149ad0 2024-01-22T10:13:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f848b09b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84840b2df0 con 0x7f84840bd490 2024-01-22T10:13:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f8483fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8484143910 0x7f84841493c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42042/0 (socket says 172.21.15.88:42042) 2024-01-22T10:13:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f8483fff640 1 -- 172.21.15.88:0/1604082914 learned_addr learned my addr 172.21.15.88:0/1604082914 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807426774 0 0) 0x7f84840b2960 con 0x7f8484143910 2024-01-22T10:13:12.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8474003520 con 0x7f8484143910 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f8488e37640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84840bd490 0x7f84841433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f8489638640 1 --2- 172.21.15.88:0/1604082914 >> v2:172.21.15.119:3300/0 conn(0x7f8484149ad0 0x7f8484153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 450015412 0 0) 0x7f8474003520 con 0x7f8484143910 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84840bd490 msgr2=0x7f84841433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84840bd490 0x7f84841433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 >> v2:172.21.15.119:3300/0 conn(0x7f8484149ad0 msgr2=0x7f8484153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 --2- 172.21.15.88:0/1604082914 >> v2:172.21.15.119:3300/0 conn(0x7f8484149ad0 0x7f8484153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84840b2090 con 0x7f8484143910 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f8470001670 con 0x7f8484143910 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f8488e37640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84840bd490 0x7f84841433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 >> v1:172.21.15.88:6789/0 conn(0x7f8484143910 legacy=0x7f84841493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8474003a50 0x7f8474003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84740047c0 0x7f8474004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84840bd490 0x7f8474005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84840b3160 con 0x7f8474003a50 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84840b2df0 con 0x7f84740047c0 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847400bae0 con 0x7f84840bd490 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f8488e37640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8474003a50 0x7f8474003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f8483fff640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84740047c0 0x7f8474004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f8489638640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84840bd490 0x7f8474005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f8488e37640 1 -- 172.21.15.88:0/1604082914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84840bd490 msgr2=0x7f8474005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f8488e37640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84840bd490 0x7f8474005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f8488e37640 1 -- 172.21.15.88:0/1604082914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84740047c0 msgr2=0x7f8474004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.710+0000 7f8488e37640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84740047c0 0x7f8474004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.711+0000 7f8488e37640 1 -- 172.21.15.88:0/1604082914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8474003520 con 0x7f8474003a50 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.711+0000 7f8488e37640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8474003a50 0x7f8474003e70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8478006fd0 tx=0x7f84740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1b119825d7f244 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.711+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478004230 con 0x7f8474003a50 2024-01-22T10:13:12.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.711+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8478004390 con 0x7f8474003a50 2024-01-22T10:13:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.711+0000 7f84837fe640 1 -- 172.21.15.88:0/1604082914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478003830 con 0x7f8474003a50 2024-01-22T10:13:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.712+0000 7f848b09b640 1 -- 172.21.15.88:0/1604082914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8474003a50 msgr2=0x7f8474003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.712+0000 7f848b09b640 1 --2- 172.21.15.88:0/1604082914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8474003a50 0x7f8474003e70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8478006fd0 tx=0x7f84740057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.712+0000 7f8489638640 1 -- 172.21.15.88:0/1604082914 reap_dead start 2024-01-22T10:13:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.712+0000 7f848b09b640 1 -- 172.21.15.88:0/1604082914 shutdown_connections 2024-01-22T10:13:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.712+0000 7f848b09b640 1 -- 172.21.15.88:0/1604082914 >> 172.21.15.88:0/1604082914 conn(0x7f848406acf0 msgr2=0x7f84840bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.712+0000 7f848b09b640 1 -- 172.21.15.88:0/1604082914 shutdown_connections 2024-01-22T10:13:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.712+0000 7f848b09b640 1 -- 172.21.15.88:0/1604082914 wait complete. 2024-01-22T10:13:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.713+0000 7f848b09b640 1 Processor -- start 2024-01-22T10:13:12.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.713+0000 7f848b09b640 1 -- start start 2024-01-22T10:13:12.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f848b09b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8474003a50 0x7f8484146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f848b09b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f848406f6f0 0x7f84841deaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f848b09b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f848406fb50 0x7f84841defe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f848b09b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84841466b0 con 0x7f848406f6f0 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f848b09b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8484144e20 con 0x7f848406fb50 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f848b09b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8484145550 con 0x7f8474003a50 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f8483fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f848406f6f0 0x7f84841deaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f8483fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f848406f6f0 0x7f84841deaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44046/0 (socket says 172.21.15.88:44046) 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f8483fff640 1 -- 172.21.15.88:0/3278962393 learned_addr learned my addr 172.21.15.88:0/3278962393 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f8489638640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f848406fb50 0x7f84841defe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f8488e37640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8474003a50 0x7f8484146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f8483fff640 1 -- 172.21.15.88:0/3278962393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8474003a50 msgr2=0x7f8484146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f8483fff640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8474003a50 0x7f8484146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f8483fff640 1 -- 172.21.15.88:0/3278962393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f848406fb50 msgr2=0x7f84841defe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f8483fff640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f848406fb50 0x7f84841defe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f8483fff640 1 -- 172.21.15.88:0/3278962393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8484144af0 con 0x7f848406f6f0 2024-01-22T10:13:12.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f8483fff640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f848406f6f0 0x7f84841deaa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f847000e7b0 tx=0x7f847000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:12.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f84817fa640 1 -- 172.21.15.88:0/3278962393 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847000ee60 con 0x7f848406f6f0 2024-01-22T10:13:12.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f84817fa640 1 -- 172.21.15.88:0/3278962393 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847000c8d0 con 0x7f848406f6f0 2024-01-22T10:13:12.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f84817fa640 1 -- 172.21.15.88:0/3278962393 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847000cc60 con 0x7f848406f6f0 2024-01-22T10:13:12.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f848b09b640 1 -- 172.21.15.88:0/3278962393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8484070030 con 0x7f848406f6f0 2024-01-22T10:13:12.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.714+0000 7f848b09b640 1 -- 172.21.15.88:0/3278962393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8484146ad0 con 0x7f848406f6f0 2024-01-22T10:13:12.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.715+0000 7f848b09b640 1 -- 172.21.15.88:0/3278962393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8484144920 con 0x7f848406f6f0 2024-01-22T10:13:12.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.716+0000 7f84817fa640 1 -- 172.21.15.88:0/3278962393 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f847001d460 con 0x7f848406f6f0 2024-01-22T10:13:12.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.716+0000 7f84817fa640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f846806b330 0x7f846806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:12.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.716+0000 7f8488e37640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f846806b330 0x7f846806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:12.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.716+0000 7f84817fa640 1 -- 172.21.15.88:0/3278962393 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8470089af0 con 0x7f848406f6f0 2024-01-22T10:13:12.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.717+0000 7f8488e37640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f846806b330 0x7f846806d7f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8478035000 tx=0x7f847803a040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:12.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.720+0000 7f84817fa640 1 -- 172.21.15.88:0/3278962393 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f84700582a0 con 0x7f848406f6f0 2024-01-22T10:13:12.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.926+0000 7f848b09b640 1 -- 172.21.15.88:0/3278962393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f848404ea30 con 0x7f848406f6f0 2024-01-22T10:13:12.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.927+0000 7f84817fa640 1 -- 172.21.15.88:0/3278962393 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4145 (secure 0 0 0) 0x7f8470057e30 con 0x7f848406f6f0 2024-01-22T10:13:12.909 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:12.910 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3660245466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3660245466},{"type":"v1","addr":"172.21.15.119:6833","nonce":3660245466}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/3438486113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3438486113},{"type":"v1","addr":"172.21.15.88:6836","nonce":3438486113}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T10:13:02.851192+0000","modified":"2024-01-22T10:13:04.853526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/1505620357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1505620357},{"type":"v1","addr":"172.21.15.88:6837","nonce":1505620357}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-22T10:13:12.910 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 6 2024-01-22T10:13:12.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.930+0000 7f848b09b640 1 -- 172.21.15.88:0/3278962393 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f846806b330 msgr2=0x7f846806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.930+0000 7f848b09b640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f846806b330 0x7f846806d7f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8478035000 tx=0x7f847803a040 comp rx=0 tx=0).stop 2024-01-22T10:13:12.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.930+0000 7f848b09b640 1 -- 172.21.15.88:0/3278962393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f848406f6f0 msgr2=0x7f84841deaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:12.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.930+0000 7f848b09b640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f848406f6f0 0x7f84841deaa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f847000e7b0 tx=0x7f847000ec70 comp rx=0 tx=0).stop 2024-01-22T10:13:12.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.930+0000 7f848b09b640 1 -- 172.21.15.88:0/3278962393 shutdown_connections 2024-01-22T10:13:12.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.930+0000 7f848b09b640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f846806b330 0x7f846806d7f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.930+0000 7f848b09b640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f848406fb50 0x7f84841defe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.930+0000 7f848b09b640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f848406f6f0 0x7f84841deaa0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.930+0000 7f848b09b640 1 --2- 172.21.15.88:0/3278962393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8474003a50 0x7f8484146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:12.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.930+0000 7f848b09b640 1 -- 172.21.15.88:0/3278962393 >> 172.21.15.88:0/3278962393 conn(0x7f848406acf0 msgr2=0x7f8484141470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:12.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.930+0000 7f848b09b640 1 -- 172.21.15.88:0/3278962393 shutdown_connections 2024-01-22T10:13:12.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:12.930+0000 7f848b09b640 1 -- 172.21.15.88:0/3278962393 wait complete. 2024-01-22T10:13:12.922 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:13.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.039+0000 7fa5d4933640 1 Processor -- start 2024-01-22T10:13:13.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.039+0000 7fa5d4933640 1 -- start start 2024-01-22T10:13:13.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.039+0000 7fa5d4933640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5d006d2b0 0x7fa5d014bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.040+0000 7fa5d4933640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d014b700 con 0x7fa5d006baa0 2024-01-22T10:13:13.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.040+0000 7fa5d4933640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d006f340 con 0x7fa5d006bee0 2024-01-22T10:13:13.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.040+0000 7fa5d4933640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d006de90 con 0x7fa5d006d2b0 2024-01-22T10:13:13.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.040+0000 7fa5ce59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5d006d2b0 0x7fa5d014bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.040+0000 7fa5c7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa5d006baa0 0x7fa5d00a40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42054/0 (socket says 172.21.15.88:42054) 2024-01-22T10:13:13.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.040+0000 7fa5ce59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5d006d2b0 0x7fa5d014bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44050/0 (socket says 172.21.15.88:44050) 2024-01-22T10:13:13.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.040+0000 7fa5c7fff640 1 -- 172.21.15.88:0/2860629913 learned_addr learned my addr 172.21.15.88:0/2860629913 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:13.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.040+0000 7fa5ce59c640 1 -- 172.21.15.88:0/2860629913 >> v1:172.21.15.119:6789/0 conn(0x7fa5d006bee0 legacy=0x7fa5d0155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:13.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.040+0000 7fa5ce59c640 1 -- 172.21.15.88:0/2860629913 >> v1:172.21.15.88:6789/0 conn(0x7fa5d006baa0 legacy=0x7fa5d00a40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.040+0000 7fa5cdd9b640 1 -- 172.21.15.88:0/2860629913 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121628537 0 0) 0x7fa5d014b700 con 0x7fa5d006baa0 2024-01-22T10:13:13.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.040+0000 7fa5ce59c640 1 -- 172.21.15.88:0/2860629913 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d006f5e0 con 0x7fa5d006d2b0 2024-01-22T10:13:13.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.041+0000 7fa5ce59c640 1 --2- 172.21.15.88:0/2860629913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d006d2b0 0x7fa5d014bee0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00097a0 tx=0x7fa5c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f6473ddfa8bde2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:13.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.041+0000 7fa5cdd9b640 1 -- 172.21.15.88:0/2860629913 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0031830 con 0x7fa5d006d2b0 2024-01-22T10:13:13.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.041+0000 7fa5cdd9b640 1 -- 172.21.15.88:0/2860629913 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c0031990 con 0x7fa5d006d2b0 2024-01-22T10:13:13.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.041+0000 7fa5cdd9b640 1 -- 172.21.15.88:0/2860629913 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0031d20 con 0x7fa5d006d2b0 2024-01-22T10:13:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.041+0000 7fa5d4933640 1 -- 172.21.15.88:0/2860629913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d006d2b0 msgr2=0x7fa5d014bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.041+0000 7fa5d4933640 1 --2- 172.21.15.88:0/2860629913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d006d2b0 0x7fa5d014bee0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00097a0 tx=0x7fa5c002b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.041+0000 7fa5d4933640 1 -- 172.21.15.88:0/2860629913 shutdown_connections 2024-01-22T10:13:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.041+0000 7fa5d4933640 1 --2- 172.21.15.88:0/2860629913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d006d2b0 0x7fa5d014bee0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.041+0000 7fa5d4933640 1 -- 172.21.15.88:0/2860629913 >> 172.21.15.88:0/2860629913 conn(0x7fa5d00bb8d0 msgr2=0x7fa5d00bbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.041+0000 7fa5d4933640 1 -- 172.21.15.88:0/2860629913 shutdown_connections 2024-01-22T10:13:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.041+0000 7fa5d4933640 1 -- 172.21.15.88:0/2860629913 wait complete. 2024-01-22T10:13:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5d4933640 1 Processor -- start 2024-01-22T10:13:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5d4933640 1 -- start start 2024-01-22T10:13:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5d4933640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d006baa0 0x7fa5d01435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5d4933640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d006bee0 0x7fa5d01e4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5d4933640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5d006d2b0 0x7fa5d01e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5d4933640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0143af0 con 0x7fa5d006bee0 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5d4933640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d013e670 con 0x7fa5d006baa0 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5d4933640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d013e950 con 0x7fa5d006d2b0 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5c7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d006bee0 0x7fa5d01e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5c7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d006bee0 0x7fa5d01e4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44056/0 (socket says 172.21.15.88:44056) 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5c7fff640 1 -- 172.21.15.88:0/151813319 learned_addr learned my addr 172.21.15.88:0/151813319 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5c7fff640 1 -- 172.21.15.88:0/151813319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5d006d2b0 msgr2=0x7fa5d01e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5c7fff640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5d006d2b0 0x7fa5d01e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5c7fff640 1 -- 172.21.15.88:0/151813319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d006baa0 msgr2=0x7fa5d01435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.043+0000 7fa5ce59c640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d006baa0 0x7fa5d01435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.044+0000 7fa5c7fff640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d006baa0 0x7fa5d01435b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.044+0000 7fa5c7fff640 1 -- 172.21.15.88:0/151813319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0009400 con 0x7fa5d006bee0 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.044+0000 7fa5c7fff640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d006bee0 0x7fa5d01e4540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800c4d0 tx=0x7fa5b800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.044+0000 7fa5c6ffd640 1 -- 172.21.15.88:0/151813319 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80074e0 con 0x7fa5d006bee0 2024-01-22T10:13:13.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.044+0000 7fa5c6ffd640 1 -- 172.21.15.88:0/151813319 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b8007660 con 0x7fa5d006bee0 2024-01-22T10:13:13.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.044+0000 7fa5c6ffd640 1 -- 172.21.15.88:0/151813319 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8004a20 con 0x7fa5d006bee0 2024-01-22T10:13:13.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.044+0000 7fa5d4933640 1 -- 172.21.15.88:0/151813319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d013ec30 con 0x7fa5d006bee0 2024-01-22T10:13:13.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.044+0000 7fa5d4933640 1 -- 172.21.15.88:0/151813319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d013e290 con 0x7fa5d006bee0 2024-01-22T10:13:13.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.045+0000 7fa5d4933640 1 -- 172.21.15.88:0/151813319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d004ea30 con 0x7fa5d006bee0 2024-01-22T10:13:13.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.045+0000 7fa5c6ffd640 1 -- 172.21.15.88:0/151813319 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fa5b8004b80 con 0x7fa5d006bee0 2024-01-22T10:13:13.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.046+0000 7fa5c6ffd640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa5b006b330 0x7fa5b006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.046+0000 7fa5ce59c640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa5b006b330 0x7fa5b006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.046+0000 7fa5c6ffd640 1 -- 172.21.15.88:0/151813319 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5b8089120 con 0x7fa5d006bee0 2024-01-22T10:13:13.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.046+0000 7fa5ce59c640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa5b006b330 0x7fa5b006d7f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0036000 tx=0x7fa5c003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.050+0000 7fa5c6ffd640 1 -- 172.21.15.88:0/151813319 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa5b8053db0 con 0x7fa5d006bee0 2024-01-22T10:13:13.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.223+0000 7fa5d4933640 1 -- 172.21.15.88:0/151813319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5d00bb600 con 0x7fa5d006bee0 2024-01-22T10:13:13.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.224+0000 7fa5c6ffd640 1 -- 172.21.15.88:0/151813319 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fa5b80573d0 con 0x7fa5d006bee0 2024-01-22T10:13:13.206 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:13.206 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.226+0000 7fa5d4933640 1 -- 172.21.15.88:0/151813319 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa5b006b330 msgr2=0x7fa5b006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.226+0000 7fa5d4933640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa5b006b330 0x7fa5b006d7f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0036000 tx=0x7fa5c003c040 comp rx=0 tx=0).stop 2024-01-22T10:13:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.226+0000 7fa5d4933640 1 -- 172.21.15.88:0/151813319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d006bee0 msgr2=0x7fa5d01e4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.226+0000 7fa5d4933640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d006bee0 0x7fa5d01e4540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800c4d0 tx=0x7fa5b800c990 comp rx=0 tx=0).stop 2024-01-22T10:13:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.226+0000 7fa5d4933640 1 -- 172.21.15.88:0/151813319 shutdown_connections 2024-01-22T10:13:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.226+0000 7fa5d4933640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa5b006b330 0x7fa5b006d7f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.226+0000 7fa5d4933640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5d006d2b0 0x7fa5d01e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.226+0000 7fa5d4933640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5d006bee0 0x7fa5d01e4540 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.226+0000 7fa5d4933640 1 --2- 172.21.15.88:0/151813319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5d006baa0 0x7fa5d01435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.226+0000 7fa5d4933640 1 -- 172.21.15.88:0/151813319 >> 172.21.15.88:0/151813319 conn(0x7fa5d00bb8d0 msgr2=0x7fa5d00bde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.226+0000 7fa5d4933640 1 -- 172.21.15.88:0/151813319 shutdown_connections 2024-01-22T10:13:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.226+0000 7fa5d4933640 1 -- 172.21.15.88:0/151813319 wait complete. 2024-01-22T10:13:13.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T10:13:00.844842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T10:13:01.816849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:13:13.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:13:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.341+0000 7f40e29d0640 1 Processor -- start 2024-01-22T10:13:13.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.341+0000 7f40e29d0640 1 -- start start 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40e29d0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40dc06f850 0x7f40dc149420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40e29d0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40dc0b3b20 0x7f40dc13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40e29d0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f40dc13ff70 0x7f40dc06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40e29d0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40dc14d090 con 0x7f40dc06f850 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40e29d0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40dc06ddb0 con 0x7f40dc13ff70 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40e29d0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc14ca40 con 0x7f40dc0b3b20 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40dbfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40dc06f850 0x7f40dc149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40dbfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40dc06f850 0x7f40dc149420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44062/0 (socket says 172.21.15.88:44062) 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40dbfff640 1 -- 172.21.15.88:0/4017327055 learned_addr learned my addr 172.21.15.88:0/4017327055 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40e0f6d640 1 --2- 172.21.15.88:0/4017327055 >> v2:172.21.15.119:3300/0 conn(0x7f40dc13ff70 0x7f40dc06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40db7fe640 1 --2- 172.21.15.88:0/4017327055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40dc0b3b20 0x7f40dc13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40dbfff640 1 -- 172.21.15.88:0/4017327055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40dc0b3b20 msgr2=0x7f40dc13fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:13.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40dbfff640 1 --2- 172.21.15.88:0/4017327055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40dc0b3b20 0x7f40dc13fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40dbfff640 1 -- 172.21.15.88:0/4017327055 >> v2:172.21.15.119:3300/0 conn(0x7f40dc13ff70 msgr2=0x7f40dc06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40dbfff640 1 --2- 172.21.15.88:0/4017327055 >> v2:172.21.15.119:3300/0 conn(0x7f40dc13ff70 0x7f40dc06e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40dbfff640 1 -- 172.21.15.88:0/4017327055 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc14cd20 con 0x7f40dc06f850 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40e0f6d640 1 --2- 172.21.15.88:0/4017327055 >> v2:172.21.15.119:3300/0 conn(0x7f40dc13ff70 0x7f40dc06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.342+0000 7f40db7fe640 1 --2- 172.21.15.88:0/4017327055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40dc0b3b20 0x7f40dc13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.343+0000 7f40dbfff640 1 --2- 172.21.15.88:0/4017327055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40dc06f850 0x7f40dc149420 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0a4af0 tx=0x7f40cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f165bee6db85d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.343+0000 7f40daffd640 1 -- 172.21.15.88:0/4017327055 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc031870 con 0x7f40dc06f850 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.343+0000 7f40daffd640 1 -- 172.21.15.88:0/4017327055 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc0319d0 con 0x7f40dc06f850 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.343+0000 7f40daffd640 1 -- 172.21.15.88:0/4017327055 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc031d60 con 0x7f40dc06f850 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.344+0000 7f40e29d0640 1 -- 172.21.15.88:0/4017327055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40dc06f850 msgr2=0x7f40dc149420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.344+0000 7f40e29d0640 1 --2- 172.21.15.88:0/4017327055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40dc06f850 0x7f40dc149420 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0a4af0 tx=0x7f40cc02b910 comp rx=0 tx=0).stop 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.344+0000 7f40e29d0640 1 -- 172.21.15.88:0/4017327055 shutdown_connections 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.344+0000 7f40e29d0640 1 --2- 172.21.15.88:0/4017327055 >> v2:172.21.15.119:3300/0 conn(0x7f40dc13ff70 0x7f40dc06e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.344+0000 7f40e29d0640 1 --2- 172.21.15.88:0/4017327055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40dc0b3b20 0x7f40dc13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.344+0000 7f40e29d0640 1 --2- 172.21.15.88:0/4017327055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40dc06f850 0x7f40dc149420 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.344+0000 7f40e29d0640 1 -- 172.21.15.88:0/4017327055 >> 172.21.15.88:0/4017327055 conn(0x7f40dc0bec60 msgr2=0x7f40dc0bf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:13.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.344+0000 7f40e29d0640 1 -- 172.21.15.88:0/4017327055 shutdown_connections 2024-01-22T10:13:13.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.344+0000 7f40e29d0640 1 -- 172.21.15.88:0/4017327055 wait complete. 2024-01-22T10:13:13.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.345+0000 7f40e29d0640 1 Processor -- start 2024-01-22T10:13:13.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.345+0000 7f40e29d0640 1 -- start start 2024-01-22T10:13:13.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e29d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40dc06f850 0x7f40dc146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e29d0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40dc0b3b20 0x7f40dc0b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e29d0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40dc13ff70 0x7f40dc1debf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e29d0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc146bc0 con 0x7f40dc13ff70 2024-01-22T10:13:13.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e29d0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0b6af0 con 0x7f40dc06f850 2024-01-22T10:13:13.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e29d0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0b8c10 con 0x7f40dc0b3b20 2024-01-22T10:13:13.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e0f6d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40dc13ff70 0x7f40dc1debf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e0f6d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40dc13ff70 0x7f40dc1debf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44074/0 (socket says 172.21.15.88:44074) 2024-01-22T10:13:13.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e0f6d640 1 -- 172.21.15.88:0/3150061553 learned_addr learned my addr 172.21.15.88:0/3150061553 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:13.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40dbfff640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40dc06f850 0x7f40dc146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40db7fe640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40dc0b3b20 0x7f40dc0b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e0f6d640 1 -- 172.21.15.88:0/3150061553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40dc0b3b20 msgr2=0x7f40dc0b86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e0f6d640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40dc0b3b20 0x7f40dc0b86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e0f6d640 1 -- 172.21.15.88:0/3150061553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40dc06f850 msgr2=0x7f40dc146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e0f6d640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40dc06f850 0x7f40dc146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e0f6d640 1 -- 172.21.15.88:0/3150061553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0094d0 con 0x7f40dc13ff70 2024-01-22T10:13:13.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.346+0000 7f40e0f6d640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40dc13ff70 0x7f40dc1debf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f40d4007df0 tx=0x7f40d400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:13.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.347+0000 7f40d8ff9640 1 -- 172.21.15.88:0/3150061553 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4003990 con 0x7f40dc13ff70 2024-01-22T10:13:13.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.347+0000 7f40d8ff9640 1 -- 172.21.15.88:0/3150061553 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d400f040 con 0x7f40dc13ff70 2024-01-22T10:13:13.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.347+0000 7f40e29d0640 1 -- 172.21.15.88:0/3150061553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc0b61c0 con 0x7f40dc13ff70 2024-01-22T10:13:13.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.347+0000 7f40d8ff9640 1 -- 172.21.15.88:0/3150061553 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4003d30 con 0x7f40dc13ff70 2024-01-22T10:13:13.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.347+0000 7f40e29d0640 1 -- 172.21.15.88:0/3150061553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40dc0b7cf0 con 0x7f40dc13ff70 2024-01-22T10:13:13.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.348+0000 7f40e29d0640 1 -- 172.21.15.88:0/3150061553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40dc04ea30 con 0x7f40dc13ff70 2024-01-22T10:13:13.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.348+0000 7f40d8ff9640 1 -- 172.21.15.88:0/3150061553 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f40d4004030 con 0x7f40dc13ff70 2024-01-22T10:13:13.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.348+0000 7f40d8ff9640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f40c806b330 0x7f40c806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.348+0000 7f40d8ff9640 1 -- 172.21.15.88:0/3150061553 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40d4089ea0 con 0x7f40dc13ff70 2024-01-22T10:13:13.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.348+0000 7f40dbfff640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f40c806b330 0x7f40c806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.349+0000 7f40dbfff640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f40c806b330 0x7f40c806d7f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40cc036000 tx=0x7f40cc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:13.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.353+0000 7f40d8ff9640 1 -- 172.21.15.88:0/3150061553 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f40d4054b30 con 0x7f40dc13ff70 2024-01-22T10:13:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.521+0000 7f40e29d0640 1 -- 172.21.15.88:0/3150061553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40dc0be0b0 con 0x7f40dc13ff70 2024-01-22T10:13:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.522+0000 7f40d8ff9640 1 -- 172.21.15.88:0/3150061553 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40d401a0a0 con 0x7f40dc13ff70 2024-01-22T10:13:13.504 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:13:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.524+0000 7f40e29d0640 1 -- 172.21.15.88:0/3150061553 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f40c806b330 msgr2=0x7f40c806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.524+0000 7f40e29d0640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f40c806b330 0x7f40c806d7f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40cc036000 tx=0x7f40cc03c040 comp rx=0 tx=0).stop 2024-01-22T10:13:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.524+0000 7f40e29d0640 1 -- 172.21.15.88:0/3150061553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40dc13ff70 msgr2=0x7f40dc1debf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.524+0000 7f40e29d0640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40dc13ff70 0x7f40dc1debf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f40d4007df0 tx=0x7f40d400d4a0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.524+0000 7f40e29d0640 1 -- 172.21.15.88:0/3150061553 shutdown_connections 2024-01-22T10:13:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.524+0000 7f40e29d0640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f40c806b330 0x7f40c806d7f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.524+0000 7f40e29d0640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40dc0b3b20 0x7f40dc0b86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.524+0000 7f40e29d0640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40dc13ff70 0x7f40dc1debf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.524+0000 7f40e29d0640 1 --2- 172.21.15.88:0/3150061553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40dc06f850 0x7f40dc146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.524+0000 7f40e29d0640 1 -- 172.21.15.88:0/3150061553 >> 172.21.15.88:0/3150061553 conn(0x7f40dc0bec60 msgr2=0x7f40dc0bb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:13.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.524+0000 7f40e29d0640 1 -- 172.21.15.88:0/3150061553 shutdown_connections 2024-01-22T10:13:13.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.524+0000 7f40e29d0640 1 -- 172.21.15.88:0/3150061553 wait complete. 2024-01-22T10:13:13.516 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T10:13:13.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.636+0000 7f20b6875640 1 Processor -- start 2024-01-22T10:13:13.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.636+0000 7f20b6875640 1 -- start start 2024-01-22T10:13:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20b6875640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f20b00b6f90 0x7f20b00b7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20b6875640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b0148380 0x7f20b01487f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20b6875640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b0148d30 con 0x7f20b00be5a0 2024-01-22T10:13:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20b6875640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b00726a0 con 0x7f20b00b6f90 2024-01-22T10:13:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20b6875640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00b7960 con 0x7f20b0148380 2024-01-22T10:13:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20af7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f20b00b6f90 0x7f20b00b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20affff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f20b00be5a0 0x7f20b0071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42062/0 (socket says 172.21.15.88:42062) 2024-01-22T10:13:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20affff640 1 -- 172.21.15.88:0/429476259 learned_addr learned my addr 172.21.15.88:0/429476259 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20b4e12640 1 --2- 172.21.15.88:0/429476259 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b0148380 0x7f20b01487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20af7fe640 1 -- 172.21.15.88:0/429476259 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b0148380 msgr2=0x7f20b01487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:13.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20aeffd640 1 -- 172.21.15.88:0/429476259 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236360033 0 0) 0x7f20b0148d30 con 0x7f20b00be5a0 2024-01-22T10:13:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20af7fe640 1 --2- 172.21.15.88:0/429476259 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b0148380 0x7f20b01487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20af7fe640 1 -- 172.21.15.88:0/429476259 >> v1:172.21.15.88:6789/0 conn(0x7f20b00be5a0 legacy=0x7f20b0071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20af7fe640 1 -- 172.21.15.88:0/429476259 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b014bc70 con 0x7f20b00b6f90 2024-01-22T10:13:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.637+0000 7f20b4e12640 1 --2- 172.21.15.88:0/429476259 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b0148380 0x7f20b01487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.638+0000 7f20af7fe640 1 --2- 172.21.15.88:0/429476259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b00b6f90 0x7f20b00b7420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009800 tx=0x7f20a402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf0a31ca10873ba server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.638+0000 7f20aeffd640 1 -- 172.21.15.88:0/429476259 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4031800 con 0x7f20b00b6f90 2024-01-22T10:13:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.638+0000 7f20aeffd640 1 -- 172.21.15.88:0/429476259 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a4031960 con 0x7f20b00b6f90 2024-01-22T10:13:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.638+0000 7f20aeffd640 1 -- 172.21.15.88:0/429476259 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4031cf0 con 0x7f20b00b6f90 2024-01-22T10:13:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.639+0000 7f20b6875640 1 -- 172.21.15.88:0/429476259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b00b6f90 msgr2=0x7f20b00b7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.639+0000 7f20b6875640 1 --2- 172.21.15.88:0/429476259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b00b6f90 0x7f20b00b7420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009800 tx=0x7f20a402b8a0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.639+0000 7f20b6875640 1 -- 172.21.15.88:0/429476259 shutdown_connections 2024-01-22T10:13:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.639+0000 7f20b6875640 1 --2- 172.21.15.88:0/429476259 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b0148380 0x7f20b01487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.639+0000 7f20b6875640 1 --2- 172.21.15.88:0/429476259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b00b6f90 0x7f20b00b7420 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.639+0000 7f20b6875640 1 -- 172.21.15.88:0/429476259 >> 172.21.15.88:0/429476259 conn(0x7f20b006be30 msgr2=0x7f20b00bdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.639+0000 7f20b6875640 1 -- 172.21.15.88:0/429476259 shutdown_connections 2024-01-22T10:13:13.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.639+0000 7f20b6875640 1 -- 172.21.15.88:0/429476259 wait complete. 2024-01-22T10:13:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.640+0000 7f20b6875640 1 Processor -- start 2024-01-22T10:13:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.640+0000 7f20b6875640 1 -- start start 2024-01-22T10:13:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20b6875640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b00b6f90 0x7f20b00aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20b6875640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20b00be5a0 0x7f20b00a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20b6875640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b0148380 0x7f20b00a9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20b6875640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00aad40 con 0x7f20b00b6f90 2024-01-22T10:13:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20b6875640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00a8b10 con 0x7f20b00be5a0 2024-01-22T10:13:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20b6875640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b01e46b0 con 0x7f20b0148380 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20affff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b00b6f90 0x7f20b00aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20affff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b00b6f90 0x7f20b00aa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44092/0 (socket says 172.21.15.88:44092) 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20affff640 1 -- 172.21.15.88:0/3319154808 learned_addr learned my addr 172.21.15.88:0/3319154808 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20b4e12640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b0148380 0x7f20b00a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20af7fe640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20b00be5a0 0x7f20b00a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20affff640 1 -- 172.21.15.88:0/3319154808 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b0148380 msgr2=0x7f20b00a9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20affff640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b0148380 0x7f20b00a9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20affff640 1 -- 172.21.15.88:0/3319154808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20b00be5a0 msgr2=0x7f20b00a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20affff640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20b00be5a0 0x7f20b00a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20affff640 1 -- 172.21.15.88:0/3319154808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a4009400 con 0x7f20b00b6f90 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20af7fe640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20b00be5a0 0x7f20b00a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20affff640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b00b6f90 0x7f20b00aa800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f20a000c4d0 tx=0x7f20a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20acff9640 1 -- 172.21.15.88:0/3319154808 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a00074e0 con 0x7f20b00b6f90 2024-01-22T10:13:13.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20acff9640 1 -- 172.21.15.88:0/3319154808 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a0007660 con 0x7f20b00b6f90 2024-01-22T10:13:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20b6875640 1 -- 172.21.15.88:0/3319154808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b01e4990 con 0x7f20b00b6f90 2024-01-22T10:13:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20acff9640 1 -- 172.21.15.88:0/3319154808 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0004a20 con 0x7f20b00b6f90 2024-01-22T10:13:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.641+0000 7f20b6875640 1 -- 172.21.15.88:0/3319154808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b01e4c70 con 0x7f20b00b6f90 2024-01-22T10:13:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.643+0000 7f20b6875640 1 -- 172.21.15.88:0/3319154808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b00a8ce0 con 0x7f20b00b6f90 2024-01-22T10:13:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.643+0000 7f20acff9640 1 -- 172.21.15.88:0/3319154808 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f20a0004b80 con 0x7f20b00b6f90 2024-01-22T10:13:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.643+0000 7f20acff9640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f209c06b360 0x7f209c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.643+0000 7f20af7fe640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f209c06b360 0x7f209c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.643+0000 7f20acff9640 1 -- 172.21.15.88:0/3319154808 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20a0089180 con 0x7f20b00b6f90 2024-01-22T10:13:13.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.644+0000 7f20af7fe640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f209c06b360 0x7f209c06d820 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f20a4036000 tx=0x7f20a4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:13.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.648+0000 7f20acff9640 1 -- 172.21.15.88:0/3319154808 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f20a0053d80 con 0x7f20b00b6f90 2024-01-22T10:13:13.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.816+0000 7f20b6875640 1 -- 172.21.15.88:0/3319154808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20b004ea30 con 0x7f20b00b6f90 2024-01-22T10:13:13.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.816+0000 7f20acff9640 1 -- 172.21.15.88:0/3319154808 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20a0018020 con 0x7f20b00b6f90 2024-01-22T10:13:13.798 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-01-22T10:13:13.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.818+0000 7f20b6875640 1 -- 172.21.15.88:0/3319154808 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f209c06b360 msgr2=0x7f209c06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.818+0000 7f20b6875640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f209c06b360 0x7f209c06d820 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f20a4036000 tx=0x7f20a4008030 comp rx=0 tx=0).stop 2024-01-22T10:13:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.818+0000 7f20b6875640 1 -- 172.21.15.88:0/3319154808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b00b6f90 msgr2=0x7f20b00aa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.818+0000 7f20b6875640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b00b6f90 0x7f20b00aa800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f20a000c4d0 tx=0x7f20a000c990 comp rx=0 tx=0).stop 2024-01-22T10:13:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.818+0000 7f20b6875640 1 -- 172.21.15.88:0/3319154808 shutdown_connections 2024-01-22T10:13:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.818+0000 7f20b6875640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f209c06b360 0x7f209c06d820 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.818+0000 7f20b6875640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20b0148380 0x7f20b00a9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.818+0000 7f20b6875640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20b00be5a0 0x7f20b00a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.818+0000 7f20b6875640 1 --2- 172.21.15.88:0/3319154808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20b00b6f90 0x7f20b00aa800 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.818+0000 7f20b6875640 1 -- 172.21.15.88:0/3319154808 >> 172.21.15.88:0/3319154808 conn(0x7f20b006be30 msgr2=0x7f20b0070250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.818+0000 7f20b6875640 1 -- 172.21.15.88:0/3319154808 shutdown_connections 2024-01-22T10:13:13.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.818+0000 7f20b6875640 1 -- 172.21.15.88:0/3319154808 wait complete. 2024-01-22T10:13:13.810 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T10:13:13.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.930+0000 7fe1def9e640 1 Processor -- start 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.930+0000 7fe1def9e640 1 -- start start 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.931+0000 7fe1def9e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1d814d1c0 0x7fe1d8149a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.931+0000 7fe1def9e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d806f2e0 con 0x7fe1d8149f60 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.931+0000 7fe1def9e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d806f530 con 0x7fe1d80bc0e0 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.931+0000 7fe1def9e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d806f810 con 0x7fe1d814d1c0 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.931+0000 7fe1d7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1d814d1c0 0x7fe1d8149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.931+0000 7fe1dd53b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe1d8149f60 0x7fe1d8153de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42074/0 (socket says 172.21.15.88:42074) 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.931+0000 7fe1d7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1d814d1c0 0x7fe1d8149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44094/0 (socket says 172.21.15.88:44094) 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.931+0000 7fe1dd53b640 1 -- 172.21.15.88:0/1532868001 learned_addr learned my addr 172.21.15.88:0/1532868001 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.931+0000 7fe1d7fff640 1 -- 172.21.15.88:0/1532868001 >> v1:172.21.15.119:6789/0 conn(0x7fe1d80bc0e0 legacy=0x7fe1d814cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.931+0000 7fe1d7fff640 1 -- 172.21.15.88:0/1532868001 >> v1:172.21.15.88:6789/0 conn(0x7fe1d8149f60 legacy=0x7fe1d8153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.931+0000 7fe1d7fff640 1 -- 172.21.15.88:0/1532868001 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d806faf0 con 0x7fe1d814d1c0 2024-01-22T10:13:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.931+0000 7fe1d77fe640 1 -- 172.21.15.88:0/1532868001 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522025625 0 0) 0x7fe1d806f2e0 con 0x7fe1d8149f60 2024-01-22T10:13:13.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.932+0000 7fe1d7fff640 1 --2- 172.21.15.88:0/1532868001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d814d1c0 0x7fe1d8149a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40097a0 tx=0x7fe1c402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482fca99527e2bde server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:13.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.932+0000 7fe1d77fe640 1 -- 172.21.15.88:0/1532868001 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4030610 con 0x7fe1d814d1c0 2024-01-22T10:13:13.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.932+0000 7fe1d77fe640 1 -- 172.21.15.88:0/1532868001 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c4030770 con 0x7fe1d814d1c0 2024-01-22T10:13:13.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.932+0000 7fe1d77fe640 1 -- 172.21.15.88:0/1532868001 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4030b00 con 0x7fe1d814d1c0 2024-01-22T10:13:13.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.932+0000 7fe1def9e640 1 -- 172.21.15.88:0/1532868001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d814d1c0 msgr2=0x7fe1d8149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.932+0000 7fe1def9e640 1 --2- 172.21.15.88:0/1532868001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d814d1c0 0x7fe1d8149a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40097a0 tx=0x7fe1c402b960 comp rx=0 tx=0).stop 2024-01-22T10:13:13.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.932+0000 7fe1def9e640 1 -- 172.21.15.88:0/1532868001 shutdown_connections 2024-01-22T10:13:13.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.932+0000 7fe1def9e640 1 --2- 172.21.15.88:0/1532868001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d814d1c0 0x7fe1d8149a20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.932+0000 7fe1def9e640 1 -- 172.21.15.88:0/1532868001 >> 172.21.15.88:0/1532868001 conn(0x7fe1d80bf560 msgr2=0x7fe1d80bb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:13.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.933+0000 7fe1def9e640 1 -- 172.21.15.88:0/1532868001 shutdown_connections 2024-01-22T10:13:13.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.933+0000 7fe1def9e640 1 -- 172.21.15.88:0/1532868001 wait complete. 2024-01-22T10:13:13.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.933+0000 7fe1def9e640 1 Processor -- start 2024-01-22T10:13:13.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.934+0000 7fe1def9e640 1 -- start start 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.934+0000 7fe1def9e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1d80bc0e0 0x7fe1d814b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.934+0000 7fe1def9e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1d8149f60 0x7fe1d809b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.934+0000 7fe1def9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d814d1c0 0x7fe1d81deef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.934+0000 7fe1def9e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d814bbb0 con 0x7fe1d814d1c0 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.934+0000 7fe1def9e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d81dea60 con 0x7fe1d8149f60 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.934+0000 7fe1def9e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d809b700 con 0x7fe1d80bc0e0 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.934+0000 7fe1dd53b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d814d1c0 0x7fe1d81deef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.934+0000 7fe1dd53b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d814d1c0 0x7fe1d81deef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44108/0 (socket says 172.21.15.88:44108) 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.934+0000 7fe1dd53b640 1 -- 172.21.15.88:0/573057895 learned_addr learned my addr 172.21.15.88:0/573057895 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1dcd3a640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1d80bc0e0 0x7fe1d814b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1d7fff640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1d8149f60 0x7fe1d809b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1dd53b640 1 -- 172.21.15.88:0/573057895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1d80bc0e0 msgr2=0x7fe1d814b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1dd53b640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1d80bc0e0 0x7fe1d814b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1dd53b640 1 -- 172.21.15.88:0/573057895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1d8149f60 msgr2=0x7fe1d809b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:13.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1dd53b640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1d8149f60 0x7fe1d809b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:13.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1dd53b640 1 -- 172.21.15.88:0/573057895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c4009400 con 0x7fe1d814d1c0 2024-01-22T10:13:13.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1d7fff640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1d8149f60 0x7fe1d809b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:13.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1dd53b640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d814d1c0 0x7fe1d81deef0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000c7a0 tx=0x7fe1d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:13.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1d57fa640 1 -- 172.21.15.88:0/573057895 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000a640 con 0x7fe1d814d1c0 2024-01-22T10:13:13.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1d57fa640 1 -- 172.21.15.88:0/573057895 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d000a7a0 con 0x7fe1d814d1c0 2024-01-22T10:13:13.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1d57fa640 1 -- 172.21.15.88:0/573057895 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000abd0 con 0x7fe1d814d1c0 2024-01-22T10:13:13.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1def9e640 1 -- 172.21.15.88:0/573057895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d809b9d0 con 0x7fe1d814d1c0 2024-01-22T10:13:13.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.935+0000 7fe1def9e640 1 -- 172.21.15.88:0/573057895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d809a4a0 con 0x7fe1d814d1c0 2024-01-22T10:13:13.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.936+0000 7fe1def9e640 1 -- 172.21.15.88:0/573057895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d81debd0 con 0x7fe1d814d1c0 2024-01-22T10:13:13.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.937+0000 7fe1d57fa640 1 -- 172.21.15.88:0/573057895 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fe1d000ad30 con 0x7fe1d814d1c0 2024-01-22T10:13:13.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.937+0000 7fe1d57fa640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe1bc06b330 0x7fe1bc06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:13.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.937+0000 7fe1dcd3a640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe1bc06b330 0x7fe1bc06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:13.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.937+0000 7fe1d57fa640 1 -- 172.21.15.88:0/573057895 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1d0089380 con 0x7fe1d814d1c0 2024-01-22T10:13:13.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.937+0000 7fe1dcd3a640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe1bc06b330 0x7fe1bc06d7f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc000f60 tx=0x7fe1cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:13.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:13.941+0000 7fe1d57fa640 1 -- 172.21.15.88:0/573057895 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe1d00540a0 con 0x7fe1d814d1c0 2024-01-22T10:13:14.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.109+0000 7fe1def9e640 1 -- 172.21.15.88:0/573057895 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1d804ea30 con 0x7fe1d814d1c0 2024-01-22T10:13:14.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.109+0000 7fe1d57fa640 1 -- 172.21.15.88:0/573057895 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1d00576c0 con 0x7fe1d814d1c0 2024-01-22T10:13:14.091 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-01-22T10:13:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.111+0000 7fe1def9e640 1 -- 172.21.15.88:0/573057895 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe1bc06b330 msgr2=0x7fe1bc06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.111+0000 7fe1def9e640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe1bc06b330 0x7fe1bc06d7f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc000f60 tx=0x7fe1cc009040 comp rx=0 tx=0).stop 2024-01-22T10:13:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.111+0000 7fe1def9e640 1 -- 172.21.15.88:0/573057895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d814d1c0 msgr2=0x7fe1d81deef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.111+0000 7fe1def9e640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d814d1c0 0x7fe1d81deef0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000c7a0 tx=0x7fe1d000cc60 comp rx=0 tx=0).stop 2024-01-22T10:13:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.111+0000 7fe1def9e640 1 -- 172.21.15.88:0/573057895 shutdown_connections 2024-01-22T10:13:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.111+0000 7fe1def9e640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe1bc06b330 0x7fe1bc06d7f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.111+0000 7fe1def9e640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d814d1c0 0x7fe1d81deef0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.111+0000 7fe1def9e640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1d8149f60 0x7fe1d809b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.111+0000 7fe1def9e640 1 --2- 172.21.15.88:0/573057895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1d80bc0e0 0x7fe1d814b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.111+0000 7fe1def9e640 1 -- 172.21.15.88:0/573057895 >> 172.21.15.88:0/573057895 conn(0x7fe1d80bf560 msgr2=0x7fe1d80bcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.111+0000 7fe1def9e640 1 -- 172.21.15.88:0/573057895 shutdown_connections 2024-01-22T10:13:14.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.111+0000 7fe1def9e640 1 -- 172.21.15.88:0/573057895 wait complete. 2024-01-22T10:13:14.103 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:13:14.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.220+0000 7f1595e2b640 1 Processor -- start 2024-01-22T10:13:14.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.221+0000 7f1595e2b640 1 -- start start 2024-01-22T10:13:14.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.221+0000 7f1595e2b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1590072590 0x7f159014ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.221+0000 7f1595e2b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f159014f390 0x7f1590155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.221+0000 7f1595e2b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159014f7e0 con 0x7f15900baae0 2024-01-22T10:13:14.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.221+0000 7f1595e2b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1590071040 con 0x7f1590072590 2024-01-22T10:13:14.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.221+0000 7f1595e2b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15900703c0 con 0x7f159014f390 2024-01-22T10:13:14.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.221+0000 7f1586ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1590072590 0x7f159014ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.221+0000 7f158f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f15900baae0 0x7f1590141c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42090/0 (socket says 172.21.15.88:42090) 2024-01-22T10:13:14.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.221+0000 7f158f7fe640 1 -- 172.21.15.88:0/1127297804 learned_addr learned my addr 172.21.15.88:0/1127297804 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:14.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.221+0000 7f1586ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1590072590 0x7f159014ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44126/0 (socket says 172.21.15.88:44126) 2024-01-22T10:13:14.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.222+0000 7f1586ffd640 1 -- 172.21.15.88:0/1127297804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f159014f390 msgr2=0x7f1590155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:14.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.222+0000 7f1586ffd640 1 --2- 172.21.15.88:0/1127297804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f159014f390 0x7f1590155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.222+0000 7f1586ffd640 1 -- 172.21.15.88:0/1127297804 >> v1:172.21.15.88:6789/0 conn(0x7f15900baae0 legacy=0x7f1590141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.222+0000 7f158effd640 1 -- 172.21.15.88:0/1127297804 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888859615 0 0) 0x7f159014f7e0 con 0x7f15900baae0 2024-01-22T10:13:14.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.222+0000 7f1586ffd640 1 -- 172.21.15.88:0/1127297804 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15900706a0 con 0x7f1590072590 2024-01-22T10:13:14.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.222+0000 7f1586ffd640 1 --2- 172.21.15.88:0/1127297804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1590072590 0x7f159014ee50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f15780097a0 tx=0x7f157802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fb0ec70724d405 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:14.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.222+0000 7f158effd640 1 -- 172.21.15.88:0/1127297804 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578030610 con 0x7f1590072590 2024-01-22T10:13:14.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.222+0000 7f158effd640 1 -- 172.21.15.88:0/1127297804 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1578030770 con 0x7f1590072590 2024-01-22T10:13:14.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.222+0000 7f158effd640 1 -- 172.21.15.88:0/1127297804 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578030b00 con 0x7f1590072590 2024-01-22T10:13:14.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.223+0000 7f1595e2b640 1 -- 172.21.15.88:0/1127297804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1590072590 msgr2=0x7f159014ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.223+0000 7f1595e2b640 1 --2- 172.21.15.88:0/1127297804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1590072590 0x7f159014ee50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f15780097a0 tx=0x7f157802b960 comp rx=0 tx=0).stop 2024-01-22T10:13:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.223+0000 7f1595e2b640 1 -- 172.21.15.88:0/1127297804 shutdown_connections 2024-01-22T10:13:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.223+0000 7f1595e2b640 1 --2- 172.21.15.88:0/1127297804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f159014f390 0x7f1590155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.223+0000 7f1595e2b640 1 --2- 172.21.15.88:0/1127297804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1590072590 0x7f159014ee50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.223+0000 7f1595e2b640 1 -- 172.21.15.88:0/1127297804 >> 172.21.15.88:0/1127297804 conn(0x7f159006b9e0 msgr2=0x7f159006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.223+0000 7f1595e2b640 1 -- 172.21.15.88:0/1127297804 shutdown_connections 2024-01-22T10:13:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.223+0000 7f1595e2b640 1 -- 172.21.15.88:0/1127297804 wait complete. 2024-01-22T10:13:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.224+0000 7f1595e2b640 1 Processor -- start 2024-01-22T10:13:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.224+0000 7f1595e2b640 1 -- start start 2024-01-22T10:13:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f1595e2b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1590072590 0x7f159013a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f1595e2b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15900baae0 0x7f159014e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f1595e2b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f159014f390 0x7f15900bdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f1595e2b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159014e7d0 con 0x7f1590072590 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f1595e2b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1590138bf0 con 0x7f15900baae0 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f1595e2b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1590137e30 con 0x7f159014f390 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f158f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1590072590 0x7f159013a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f158f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1590072590 0x7f159013a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44138/0 (socket says 172.21.15.88:44138) 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f158f7fe640 1 -- 172.21.15.88:0/4010514799 learned_addr learned my addr 172.21.15.88:0/4010514799 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f158f7fe640 1 -- 172.21.15.88:0/4010514799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f159014f390 msgr2=0x7f15900bdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f158f7fe640 1 --2- 172.21.15.88:0/4010514799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f159014f390 0x7f15900bdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f158f7fe640 1 -- 172.21.15.88:0/4010514799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15900baae0 msgr2=0x7f159014e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f158f7fe640 1 --2- 172.21.15.88:0/4010514799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15900baae0 0x7f159014e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f158f7fe640 1 -- 172.21.15.88:0/4010514799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578009400 con 0x7f1590072590 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f158f7fe640 1 --2- 172.21.15.88:0/4010514799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1590072590 0x7f159013a590 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f158000c4d0 tx=0x7f158000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f158cff9640 1 -- 172.21.15.88:0/4010514799 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15800074e0 con 0x7f1590072590 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f158cff9640 1 -- 172.21.15.88:0/4010514799 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1580007660 con 0x7f1590072590 2024-01-22T10:13:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f158cff9640 1 -- 172.21.15.88:0/4010514799 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580004a20 con 0x7f1590072590 2024-01-22T10:13:14.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.225+0000 7f1595e2b640 1 -- 172.21.15.88:0/4010514799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1590138110 con 0x7f1590072590 2024-01-22T10:13:14.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.226+0000 7f1595e2b640 1 -- 172.21.15.88:0/4010514799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15901386d0 con 0x7f1590072590 2024-01-22T10:13:14.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.227+0000 7f1595e2b640 1 -- 172.21.15.88:0/4010514799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15901388c0 con 0x7f1590072590 2024-01-22T10:13:14.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.227+0000 7f158cff9640 1 -- 172.21.15.88:0/4010514799 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f1580004b80 con 0x7f1590072590 2024-01-22T10:13:14.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.227+0000 7f158cff9640 1 --2- 172.21.15.88:0/4010514799 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f157006b330 0x7f157006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.227+0000 7f1586ffd640 1 --2- 172.21.15.88:0/4010514799 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f157006b330 0x7f157006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.227+0000 7f158cff9640 1 -- 172.21.15.88:0/4010514799 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1580089040 con 0x7f1590072590 2024-01-22T10:13:14.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.228+0000 7f1586ffd640 1 --2- 172.21.15.88:0/4010514799 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f157006b330 0x7f157006d7f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1578036000 tx=0x7f157803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:14.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.232+0000 7f158cff9640 1 -- 172.21.15.88:0/4010514799 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1580053d60 con 0x7f1590072590 2024-01-22T10:13:14.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.433+0000 7f1595e2b640 1 -- 172.21.15.88:0/4010514799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f159004ea30 con 0x7f1590072590 2024-01-22T10:13:14.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.434+0000 7f158cff9640 1 -- 172.21.15.88:0/4010514799 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4145 (secure 0 0 0) 0x7f1580018090 con 0x7f1590072590 2024-01-22T10:13:14.416 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:14.416 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3660245466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3660245466},{"type":"v1","addr":"172.21.15.119:6833","nonce":3660245466}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/3438486113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3438486113},{"type":"v1","addr":"172.21.15.88:6836","nonce":3438486113}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T10:13:02.851192+0000","modified":"2024-01-22T10:13:04.853526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/1505620357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1505620357},{"type":"v1","addr":"172.21.15.88:6837","nonce":1505620357}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-22T10:13:14.416 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 6 2024-01-22T10:13:14.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.436+0000 7f1595e2b640 1 -- 172.21.15.88:0/4010514799 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f157006b330 msgr2=0x7f157006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.436+0000 7f1595e2b640 1 --2- 172.21.15.88:0/4010514799 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f157006b330 0x7f157006d7f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1578036000 tx=0x7f157803b040 comp rx=0 tx=0).stop 2024-01-22T10:13:14.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.436+0000 7f1595e2b640 1 -- 172.21.15.88:0/4010514799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1590072590 msgr2=0x7f159013a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.436+0000 7f1595e2b640 1 --2- 172.21.15.88:0/4010514799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1590072590 0x7f159013a590 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f158000c4d0 tx=0x7f158000c990 comp rx=0 tx=0).stop 2024-01-22T10:13:14.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.436+0000 7f1595e2b640 1 -- 172.21.15.88:0/4010514799 shutdown_connections 2024-01-22T10:13:14.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.436+0000 7f1595e2b640 1 --2- 172.21.15.88:0/4010514799 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f157006b330 0x7f157006d7f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.436+0000 7f1595e2b640 1 --2- 172.21.15.88:0/4010514799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f159014f390 0x7f15900bdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.436+0000 7f1595e2b640 1 --2- 172.21.15.88:0/4010514799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15900baae0 0x7f159014e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.436+0000 7f1595e2b640 1 --2- 172.21.15.88:0/4010514799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1590072590 0x7f159013a590 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.436+0000 7f1595e2b640 1 -- 172.21.15.88:0/4010514799 >> 172.21.15.88:0/4010514799 conn(0x7f159006b9e0 msgr2=0x7f15900b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:14.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.436+0000 7f1595e2b640 1 -- 172.21.15.88:0/4010514799 shutdown_connections 2024-01-22T10:13:14.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.436+0000 7f1595e2b640 1 -- 172.21.15.88:0/4010514799 wait complete. 2024-01-22T10:13:14.428 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:14.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.545+0000 7fadddaa6640 1 Processor -- start 2024-01-22T10:13:14.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.545+0000 7fadddaa6640 1 -- start start 2024-01-22T10:13:14.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.546+0000 7fadddaa6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadd806ba70 0x7fadd814c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.546+0000 7fadddaa6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fadd80bb400 0x7fadd80b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.546+0000 7fadddaa6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd8145d20 con 0x7fadd8141db0 2024-01-22T10:13:14.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.546+0000 7fadddaa6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd80b5e10 con 0x7fadd80bb400 2024-01-22T10:13:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.546+0000 7fadddaa6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd814b680 con 0x7fadd806ba70 2024-01-22T10:13:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.546+0000 7fadd77fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadd806ba70 0x7fadd814c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.546+0000 7fadd6ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fadd80bb400 0x7fadd80b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.546+0000 7fadd77fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadd806ba70 0x7fadd814c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:50240/0 (socket says 172.21.15.88:50240) 2024-01-22T10:13:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.546+0000 7fadd77fe640 1 -- 172.21.15.88:0/4219613520 learned_addr learned my addr 172.21.15.88:0/4219613520 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.547+0000 7fadd77fe640 1 -- 172.21.15.88:0/4219613520 >> v2:172.21.15.119:3300/0 conn(0x7fadd80bb400 msgr2=0x7fadd80b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.547+0000 7fadd77fe640 1 --2- 172.21.15.88:0/4219613520 >> v2:172.21.15.119:3300/0 conn(0x7fadd80bb400 0x7fadd80b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.547+0000 7fadd77fe640 1 -- 172.21.15.88:0/4219613520 >> v1:172.21.15.119:6789/0 conn(0x7fadd8141db0 legacy=0x7fadd814ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.547+0000 7fadd67fc640 1 -- 172.21.15.88:0/4219613520 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716557039 0 0) 0x7fadd8145d20 con 0x7fadd8141db0 2024-01-22T10:13:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.547+0000 7fadd77fe640 1 -- 172.21.15.88:0/4219613520 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd814b960 con 0x7fadd806ba70 2024-01-22T10:13:14.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.547+0000 7fadd6ffd640 1 --2- 172.21.15.88:0/4219613520 >> v2:172.21.15.119:3300/0 conn(0x7fadd80bb400 0x7fadd80b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.547+0000 7fadd77fe640 1 --2- 172.21.15.88:0/4219613520 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadd806ba70 0x7fadd814c160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009870 tx=0x7fadc802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db98d92ab169ca4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.548+0000 7fadd67fc640 1 -- 172.21.15.88:0/4219613520 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8030840 con 0x7fadd806ba70 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.548+0000 7fadd67fc640 1 -- 172.21.15.88:0/4219613520 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc80309a0 con 0x7fadd806ba70 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.548+0000 7fadd67fc640 1 -- 172.21.15.88:0/4219613520 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8030d30 con 0x7fadd806ba70 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.548+0000 7fadddaa6640 1 -- 172.21.15.88:0/4219613520 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadd806ba70 msgr2=0x7fadd814c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.548+0000 7fadddaa6640 1 --2- 172.21.15.88:0/4219613520 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadd806ba70 0x7fadd814c160 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009870 tx=0x7fadc802b980 comp rx=0 tx=0).stop 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.548+0000 7fadddaa6640 1 -- 172.21.15.88:0/4219613520 shutdown_connections 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.548+0000 7fadddaa6640 1 --2- 172.21.15.88:0/4219613520 >> v2:172.21.15.119:3300/0 conn(0x7fadd80bb400 0x7fadd80b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.548+0000 7fadddaa6640 1 --2- 172.21.15.88:0/4219613520 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadd806ba70 0x7fadd814c160 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.548+0000 7fadddaa6640 1 -- 172.21.15.88:0/4219613520 >> 172.21.15.88:0/4219613520 conn(0x7fadd80bb840 msgr2=0x7fadd80bbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.548+0000 7fadddaa6640 1 -- 172.21.15.88:0/4219613520 shutdown_connections 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.548+0000 7fadddaa6640 1 -- 172.21.15.88:0/4219613520 wait complete. 2024-01-22T10:13:14.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.549+0000 7fadddaa6640 1 Processor -- start 2024-01-22T10:13:14.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.549+0000 7fadddaa6640 1 -- start start 2024-01-22T10:13:14.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadddaa6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd806ba70 0x7fadd8143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadddaa6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd80bb400 0x7fadd80b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadddaa6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadd8141db0 0x7fadd8140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadddaa6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd81440b0 con 0x7fadd80bb400 2024-01-22T10:13:14.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadddaa6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd81424d0 con 0x7fadd806ba70 2024-01-22T10:13:14.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadddaa6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd81434a0 con 0x7fadd8141db0 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadd6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd80bb400 0x7fadd80b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadd6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd80bb400 0x7fadd80b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44154/0 (socket says 172.21.15.88:44154) 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadd6ffd640 1 -- 172.21.15.88:0/2160219298 learned_addr learned my addr 172.21.15.88:0/2160219298 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadd77fe640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd806ba70 0x7fadd8143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadd7fff640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadd8141db0 0x7fadd8140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadd6ffd640 1 -- 172.21.15.88:0/2160219298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadd8141db0 msgr2=0x7fadd8140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadd6ffd640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadd8141db0 0x7fadd8140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadd6ffd640 1 -- 172.21.15.88:0/2160219298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd806ba70 msgr2=0x7fadd8143b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadd6ffd640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd806ba70 0x7fadd8143b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.550+0000 7fadd6ffd640 1 -- 172.21.15.88:0/2160219298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc009400 con 0x7fadd80bb400 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.551+0000 7fadd6ffd640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd80bb400 0x7fadd80b7170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00e960 tx=0x7fadcc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.551+0000 7fadbffff640 1 -- 172.21.15.88:0/2160219298 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00ca00 con 0x7fadd80bb400 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.551+0000 7fadbffff640 1 -- 172.21.15.88:0/2160219298 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc00cb60 con 0x7fadd80bb400 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.551+0000 7fadbffff640 1 -- 172.21.15.88:0/2160219298 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc013470 con 0x7fadd80bb400 2024-01-22T10:13:14.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.551+0000 7fadddaa6640 1 -- 172.21.15.88:0/2160219298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc80094d0 con 0x7fadd80bb400 2024-01-22T10:13:14.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.551+0000 7fadddaa6640 1 -- 172.21.15.88:0/2160219298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd8142ca0 con 0x7fadd80bb400 2024-01-22T10:13:14.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.552+0000 7fadddaa6640 1 -- 172.21.15.88:0/2160219298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd804ea30 con 0x7fadd80bb400 2024-01-22T10:13:14.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.552+0000 7fadbffff640 1 -- 172.21.15.88:0/2160219298 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fadcc0135d0 con 0x7fadd80bb400 2024-01-22T10:13:14.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.552+0000 7fadbffff640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fadc406b330 0x7fadc406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.553+0000 7fadbffff640 1 -- 172.21.15.88:0/2160219298 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadcc089da0 con 0x7fadd80bb400 2024-01-22T10:13:14.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.553+0000 7fadd77fe640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fadc406b330 0x7fadc406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.553+0000 7fadd77fe640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fadc406b330 0x7fadc406d7f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fadc8036000 tx=0x7fadc8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:14.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.557+0000 7fadbffff640 1 -- 172.21.15.88:0/2160219298 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fadcc054ae0 con 0x7fadd80bb400 2024-01-22T10:13:14.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.726+0000 7fadddaa6640 1 -- 172.21.15.88:0/2160219298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadd80b9a50 con 0x7fadd80bb400 2024-01-22T10:13:14.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.727+0000 7fadbffff640 1 -- 172.21.15.88:0/2160219298 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fadcc058100 con 0x7fadd80bb400 2024-01-22T10:13:14.709 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:14.709 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:14.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.729+0000 7fadddaa6640 1 -- 172.21.15.88:0/2160219298 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fadc406b330 msgr2=0x7fadc406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.729+0000 7fadddaa6640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fadc406b330 0x7fadc406d7f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fadc8036000 tx=0x7fadc8008030 comp rx=0 tx=0).stop 2024-01-22T10:13:14.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.729+0000 7fadddaa6640 1 -- 172.21.15.88:0/2160219298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd80bb400 msgr2=0x7fadd80b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.729+0000 7fadddaa6640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd80bb400 0x7fadd80b7170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00e960 tx=0x7fadcc00ee20 comp rx=0 tx=0).stop 2024-01-22T10:13:14.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.729+0000 7fadddaa6640 1 -- 172.21.15.88:0/2160219298 shutdown_connections 2024-01-22T10:13:14.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.729+0000 7fadddaa6640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fadc406b330 0x7fadc406d7f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.729+0000 7fadddaa6640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadd8141db0 0x7fadd8140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.729+0000 7fadddaa6640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd80bb400 0x7fadd80b7170 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.729+0000 7fadddaa6640 1 --2- 172.21.15.88:0/2160219298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadd806ba70 0x7fadd8143b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.729+0000 7fadddaa6640 1 -- 172.21.15.88:0/2160219298 >> 172.21.15.88:0/2160219298 conn(0x7fadd80bb840 msgr2=0x7fadd8149ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:14.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.729+0000 7fadddaa6640 1 -- 172.21.15.88:0/2160219298 shutdown_connections 2024-01-22T10:13:14.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.729+0000 7fadddaa6640 1 -- 172.21.15.88:0/2160219298 wait complete. 2024-01-22T10:13:14.722 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:13:14.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.839+0000 7f7e868cf640 1 Processor -- start 2024-01-22T10:13:14.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.839+0000 7f7e868cf640 1 -- start start 2024-01-22T10:13:14.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e868cf640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7e8014c070 0x7f7e80153d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e868cf640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e800bd930 con 0x7f7e800b49c0 2024-01-22T10:13:14.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e868cf640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e800b4e80 con 0x7f7e800b3630 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e868cf640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e800b5370 con 0x7f7e8014c070 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7e800b49c0 0x7f7e8014b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42102/0 (socket says 172.21.15.88:42102) 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7f7fe640 1 -- 172.21.15.88:0/1338468842 learned_addr learned my addr 172.21.15.88:0/1338468842 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e84e6c640 1 --2- 172.21.15.88:0/1338468842 >> v2:172.21.15.119:3300/0 conn(0x7f7e8014c070 0x7f7e80153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23437252 0 0) 0x7f7e800bd930 con 0x7f7e800b49c0 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e68003520 con 0x7f7e800b49c0 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1949515393 0 0) 0x7f7e68003520 con 0x7f7e800b49c0 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 >> v2:172.21.15.119:3300/0 conn(0x7f7e8014c070 msgr2=0x7f7e80153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 --2- 172.21.15.88:0/1338468842 >> v2:172.21.15.119:3300/0 conn(0x7f7e8014c070 0x7f7e80153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 >> v1:172.21.15.119:6789/0 conn(0x7f7e800b3630 legacy=0x7f7e800bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e800b5fd0 con 0x7f7e800b49c0 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f7e74001670 con 0x7f7e800b49c0 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 >> v1:172.21.15.88:6789/0 conn(0x7f7e800b49c0 legacy=0x7f7e8014b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 --2- 172.21.15.88:0/1338468842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 0x7f7e68003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 --2- 172.21.15.88:0/1338468842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e680047c0 0x7f7e68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 --2- 172.21.15.88:0/1338468842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e680051d0 0x7f7e6800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6800c0d0 con 0x7f7e68003a50 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6800c240 con 0x7f7e680047c0 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6800c400 con 0x7f7e680051d0 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.840+0000 7f7e7ffff640 1 --2- 172.21.15.88:0/1338468842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 0x7f7e68003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.841+0000 7f7e7f7fe640 1 --2- 172.21.15.88:0/1338468842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e680047c0 0x7f7e68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.841+0000 7f7e84e6c640 1 --2- 172.21.15.88:0/1338468842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e680051d0 0x7f7e6800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.841+0000 7f7e7ffff640 1 -- 172.21.15.88:0/1338468842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e680051d0 msgr2=0x7f7e6800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.841+0000 7f7e7ffff640 1 --2- 172.21.15.88:0/1338468842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e680051d0 0x7f7e6800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.841+0000 7f7e7ffff640 1 -- 172.21.15.88:0/1338468842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e680047c0 msgr2=0x7f7e68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.841+0000 7f7e7ffff640 1 --2- 172.21.15.88:0/1338468842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e680047c0 0x7f7e68004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.841+0000 7f7e7ffff640 1 -- 172.21.15.88:0/1338468842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68003520 con 0x7f7e68003a50 2024-01-22T10:13:14.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.841+0000 7f7e84e6c640 1 -- 172.21.15.88:0/1338468842 reap_dead start 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.841+0000 7f7e7f7fe640 1 --2- 172.21.15.88:0/1338468842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e680047c0 0x7f7e68004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.841+0000 7f7e7ffff640 1 --2- 172.21.15.88:0/1338468842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 0x7f7e68003e70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e70001720 tx=0x7f7e680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406d85e92b303909 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.842+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700052d0 con 0x7f7e68003a50 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.842+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7002e050 con 0x7f7e68003a50 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.842+0000 7f7e7effd640 1 -- 172.21.15.88:0/1338468842 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70003830 con 0x7f7e68003a50 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.842+0000 7f7e868cf640 1 -- 172.21.15.88:0/1338468842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 msgr2=0x7f7e68003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.842+0000 7f7e868cf640 1 --2- 172.21.15.88:0/1338468842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 0x7f7e68003e70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e70001720 tx=0x7f7e680057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.842+0000 7f7e868cf640 1 -- 172.21.15.88:0/1338468842 shutdown_connections 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.842+0000 7f7e868cf640 1 --2- 172.21.15.88:0/1338468842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 0x7f7e68003e70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.842+0000 7f7e868cf640 1 -- 172.21.15.88:0/1338468842 >> 172.21.15.88:0/1338468842 conn(0x7f7e8006acf0 msgr2=0x7f7e800bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.842+0000 7f7e868cf640 1 -- 172.21.15.88:0/1338468842 shutdown_connections 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.842+0000 7f7e868cf640 1 -- 172.21.15.88:0/1338468842 wait complete. 2024-01-22T10:13:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.843+0000 7f7e868cf640 1 Processor -- start 2024-01-22T10:13:14.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.843+0000 7f7e868cf640 1 -- start start 2024-01-22T10:13:14.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e868cf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 0x7f7e80140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e868cf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e801e2f80 0x7f7e8006ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e868cf640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e801dedb0 0x7f7e8013cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e868cf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80145da0 con 0x7f7e68003a50 2024-01-22T10:13:14.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e868cf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e801408a0 con 0x7f7e801e2f80 2024-01-22T10:13:14.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e868cf640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80070520 con 0x7f7e801dedb0 2024-01-22T10:13:14.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e7ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 0x7f7e80140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e7ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 0x7f7e80140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44174/0 (socket says 172.21.15.88:44174) 2024-01-22T10:13:14.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e7ffff640 1 -- 172.21.15.88:0/683298741 learned_addr learned my addr 172.21.15.88:0/683298741 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:14.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e84e6c640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e801dedb0 0x7f7e8013cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e7f7fe640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e801e2f80 0x7f7e8006ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e7ffff640 1 -- 172.21.15.88:0/683298741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e801dedb0 msgr2=0x7f7e8013cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e7ffff640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e801dedb0 0x7f7e8013cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e7ffff640 1 -- 172.21.15.88:0/683298741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e801e2f80 msgr2=0x7f7e8006ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e7ffff640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e801e2f80 0x7f7e8006ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e7ffff640 1 -- 172.21.15.88:0/683298741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e80145ac0 con 0x7f7e68003a50 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e7f7fe640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e801e2f80 0x7f7e8006ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.844+0000 7f7e7ffff640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 0x7f7e80140360 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e70005040 tx=0x7f7e70001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.845+0000 7f7e7cff9640 1 -- 172.21.15.88:0/683298741 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700076c0 con 0x7f7e68003a50 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.845+0000 7f7e7cff9640 1 -- 172.21.15.88:0/683298741 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e70007a30 con 0x7f7e68003a50 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.845+0000 7f7e868cf640 1 -- 172.21.15.88:0/683298741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e801e24a0 con 0x7f7e68003a50 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.845+0000 7f7e7cff9640 1 -- 172.21.15.88:0/683298741 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70006be0 con 0x7f7e68003a50 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.845+0000 7f7e868cf640 1 -- 172.21.15.88:0/683298741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e801e2a60 con 0x7f7e68003a50 2024-01-22T10:13:14.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.846+0000 7f7e868cf640 1 -- 172.21.15.88:0/683298741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e800b24e0 con 0x7f7e68003a50 2024-01-22T10:13:14.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.846+0000 7f7e7cff9640 1 -- 172.21.15.88:0/683298741 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f7e70006d40 con 0x7f7e68003a50 2024-01-22T10:13:14.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.846+0000 7f7e7cff9640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7e6c06b360 0x7f7e6c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:14.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.847+0000 7f7e7f7fe640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7e6c06b360 0x7f7e6c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:14.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.847+0000 7f7e7cff9640 1 -- 172.21.15.88:0/683298741 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e700abba0 con 0x7f7e68003a50 2024-01-22T10:13:14.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.847+0000 7f7e7f7fe640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7e6c06b360 0x7f7e6c06d820 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7e80141950 tx=0x7f7e74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:14.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:14.851+0000 7f7e7cff9640 1 -- 172.21.15.88:0/683298741 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7e70076a90 con 0x7f7e68003a50 2024-01-22T10:13:15.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.056+0000 7f7e868cf640 1 -- 172.21.15.88:0/683298741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e8004ea30 con 0x7f7e68003a50 2024-01-22T10:13:15.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.056+0000 7f7e7cff9640 1 -- 172.21.15.88:0/683298741 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4145 (secure 0 0 0) 0x7f7e7004b020 con 0x7f7e68003a50 2024-01-22T10:13:15.038 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:15.038 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3660245466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3660245466},{"type":"v1","addr":"172.21.15.119:6833","nonce":3660245466}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/3438486113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3438486113},{"type":"v1","addr":"172.21.15.88:6836","nonce":3438486113}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T10:13:02.851192+0000","modified":"2024-01-22T10:13:04.853526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/1505620357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1505620357},{"type":"v1","addr":"172.21.15.88:6837","nonce":1505620357}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-22T10:13:15.039 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 6 2024-01-22T10:13:15.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.058+0000 7f7e868cf640 1 -- 172.21.15.88:0/683298741 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7e6c06b360 msgr2=0x7f7e6c06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.058+0000 7f7e868cf640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7e6c06b360 0x7f7e6c06d820 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7e80141950 tx=0x7f7e74009040 comp rx=0 tx=0).stop 2024-01-22T10:13:15.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.058+0000 7f7e868cf640 1 -- 172.21.15.88:0/683298741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 msgr2=0x7f7e80140360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.058+0000 7f7e868cf640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 0x7f7e80140360 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e70005040 tx=0x7f7e70001120 comp rx=0 tx=0).stop 2024-01-22T10:13:15.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.058+0000 7f7e868cf640 1 -- 172.21.15.88:0/683298741 shutdown_connections 2024-01-22T10:13:15.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.058+0000 7f7e868cf640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7e6c06b360 0x7f7e6c06d820 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.058+0000 7f7e868cf640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e801dedb0 0x7f7e8013cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.058+0000 7f7e868cf640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e801e2f80 0x7f7e8006ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.058+0000 7f7e868cf640 1 --2- 172.21.15.88:0/683298741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e68003a50 0x7f7e80140360 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.059+0000 7f7e868cf640 1 -- 172.21.15.88:0/683298741 >> 172.21.15.88:0/683298741 conn(0x7f7e8006acf0 msgr2=0x7f7e800b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:15.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.059+0000 7f7e868cf640 1 -- 172.21.15.88:0/683298741 shutdown_connections 2024-01-22T10:13:15.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.059+0000 7f7e868cf640 1 -- 172.21.15.88:0/683298741 wait complete. 2024-01-22T10:13:15.353 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T10:13:02.851192+0000', 'modified': '2024-01-22T10:13:04.853526+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6837/1505620357', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6835', 'nonce': 1505620357}, {'type': 'v1', 'addr': '172.21.15.88:6837', 'nonce': 1505620357}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-22T10:13:15.353 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T10:13:15.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-22T10:13:15.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.472+0000 7ff93c256640 1 Processor -- start 2024-01-22T10:13:15.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.473+0000 7ff93c256640 1 -- start start 2024-01-22T10:13:15.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.473+0000 7ff93c256640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff93414c3b0 0x7ff93406ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.473+0000 7ff93c256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff93414b930 0x7ff934156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.473+0000 7ff93c256640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9340c0ab0 con 0x7ff93406b730 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.473+0000 7ff93c256640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93406b290 con 0x7ff93414c3b0 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.473+0000 7ff93c256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340bc170 con 0x7ff93414b930 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.473+0000 7ff939ff2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff93414c3b0 0x7ff93406ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.473+0000 7ff9397f1640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff93406b730 0x7ff9340c03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42106/0 (socket says 172.21.15.88:42106) 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.473+0000 7ff9397f1640 1 -- 172.21.15.88:0/3701266007 learned_addr learned my addr 172.21.15.88:0/3701266007 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.473+0000 7ff93a7f3640 1 --2- 172.21.15.88:0/3701266007 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff93414b930 0x7ff934156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.474+0000 7ff939ff2640 1 -- 172.21.15.88:0/3701266007 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff93414b930 msgr2=0x7ff934156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.474+0000 7ff939ff2640 1 --2- 172.21.15.88:0/3701266007 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff93414b930 0x7ff934156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.474+0000 7ff939ff2640 1 -- 172.21.15.88:0/3701266007 >> v1:172.21.15.88:6789/0 conn(0x7ff93406b730 legacy=0x7ff9340c03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.474+0000 7ff939ff2640 1 -- 172.21.15.88:0/3701266007 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340bb840 con 0x7ff93414c3b0 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.474+0000 7ff938ff0640 1 -- 172.21.15.88:0/3701266007 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532636550 0 0) 0x7ff9340c0ab0 con 0x7ff93406b730 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.474+0000 7ff93a7f3640 1 --2- 172.21.15.88:0/3701266007 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff93414b930 0x7ff934156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:15.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.474+0000 7ff939ff2640 1 --2- 172.21.15.88:0/3701266007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93414c3b0 0x7ff93406ad50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff9240097a0 tx=0x7ff92402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a564d6f369273215 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:15.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.474+0000 7ff938ff0640 1 -- 172.21.15.88:0/3701266007 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924031830 con 0x7ff93414c3b0 2024-01-22T10:13:15.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.474+0000 7ff938ff0640 1 -- 172.21.15.88:0/3701266007 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff924031990 con 0x7ff93414c3b0 2024-01-22T10:13:15.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.474+0000 7ff938ff0640 1 -- 172.21.15.88:0/3701266007 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924031d20 con 0x7ff93414c3b0 2024-01-22T10:13:15.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.475+0000 7ff93c256640 1 -- 172.21.15.88:0/3701266007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93414c3b0 msgr2=0x7ff93406ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.475+0000 7ff93c256640 1 --2- 172.21.15.88:0/3701266007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93414c3b0 0x7ff93406ad50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff9240097a0 tx=0x7ff92402b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.475+0000 7ff93c256640 1 -- 172.21.15.88:0/3701266007 shutdown_connections 2024-01-22T10:13:15.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.475+0000 7ff93c256640 1 --2- 172.21.15.88:0/3701266007 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff93414b930 0x7ff934156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.475+0000 7ff93c256640 1 --2- 172.21.15.88:0/3701266007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93414c3b0 0x7ff93406ad50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.475+0000 7ff93c256640 1 -- 172.21.15.88:0/3701266007 >> 172.21.15.88:0/3701266007 conn(0x7ff9340bd940 msgr2=0x7ff9340bdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:15.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.475+0000 7ff93c256640 1 -- 172.21.15.88:0/3701266007 shutdown_connections 2024-01-22T10:13:15.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.475+0000 7ff93c256640 1 -- 172.21.15.88:0/3701266007 wait complete. 2024-01-22T10:13:15.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.476+0000 7ff93c256640 1 Processor -- start 2024-01-22T10:13:15.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.476+0000 7ff93c256640 1 -- start start 2024-01-22T10:13:15.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93c256640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff93414b930 0x7ff934147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93c256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff93414c3b0 0x7ff9341e4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93c256640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93409a590 0x7ff93414ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93c256640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93409b9f0 con 0x7ff93409a590 2024-01-22T10:13:15.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93c256640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9341e4200 con 0x7ff93414b930 2024-01-22T10:13:15.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93c256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9341e44e0 con 0x7ff93414c3b0 2024-01-22T10:13:15.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93a7f3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93409a590 0x7ff93414ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93a7f3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93409a590 0x7ff93414ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44198/0 (socket says 172.21.15.88:44198) 2024-01-22T10:13:15.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93a7f3640 1 -- 172.21.15.88:0/2045875009 learned_addr learned my addr 172.21.15.88:0/2045875009 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:15.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff9397f1640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff93414c3b0 0x7ff9341e4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff939ff2640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff93414b930 0x7ff934147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93a7f3640 1 -- 172.21.15.88:0/2045875009 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff93414c3b0 msgr2=0x7ff9341e4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93a7f3640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff93414c3b0 0x7ff9341e4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93a7f3640 1 -- 172.21.15.88:0/2045875009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff93414b930 msgr2=0x7ff934147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93a7f3640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff93414b930 0x7ff934147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93a7f3640 1 -- 172.21.15.88:0/2045875009 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924009400 con 0x7ff93409a590 2024-01-22T10:13:15.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff9397f1640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff93414c3b0 0x7ff9341e4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:15.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93a7f3640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93409a590 0x7ff93414ee00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00ce70 tx=0x7ff92c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:15.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff92a7fc640 1 -- 172.21.15.88:0/2045875009 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c003b90 con 0x7ff93409a590 2024-01-22T10:13:15.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff92a7fc640 1 -- 172.21.15.88:0/2045875009 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c003d10 con 0x7ff93409a590 2024-01-22T10:13:15.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff93c256640 1 -- 172.21.15.88:0/2045875009 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9341e47c0 con 0x7ff93409a590 2024-01-22T10:13:15.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.477+0000 7ff92a7fc640 1 -- 172.21.15.88:0/2045875009 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c004260 con 0x7ff93409a590 2024-01-22T10:13:15.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.478+0000 7ff93c256640 1 -- 172.21.15.88:0/2045875009 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93409ab00 con 0x7ff93409a590 2024-01-22T10:13:15.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.479+0000 7ff92a7fc640 1 -- 172.21.15.88:0/2045875009 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7ff92c0043c0 con 0x7ff93409a590 2024-01-22T10:13:15.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.479+0000 7ff92a7fc640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff91806b330 0x7ff91806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.479+0000 7ff92a7fc640 1 -- 172.21.15.88:0/2045875009 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff92c08a450 con 0x7ff93409a590 2024-01-22T10:13:15.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.479+0000 7ff939ff2640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff91806b330 0x7ff91806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.480+0000 7ff939ff2640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff91806b330 0x7ff91806d7f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff924036000 tx=0x7ff924008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:15.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.480+0000 7ff93ee1a740 1 Processor -- start 2024-01-22T10:13:15.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.480+0000 7ff93ee1a740 1 -- start start 2024-01-22T10:13:15.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff93ee1a740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 0x558256ea3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff93ee1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ea3ec0 0x558256ed48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff93ee1a740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed4e00 0x558256ed5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff93ee1a740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558256e644f0 con 0x558256edf520 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff93ee1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x558256e15e60 con 0x558256ea3ec0 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff93ee1a740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x558256e13550 con 0x558256ed4e00 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff939ff2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 0x558256ea3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff939ff2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 0x558256ea3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44208/0 (socket says 172.21.15.88:44208) 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff939ff2640 1 -- 172.21.15.88:0/2174920741 learned_addr learned my addr 172.21.15.88:0/2174920741 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff9397f1640 1 --2- 172.21.15.88:0/2174920741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ea3ec0 0x558256ed48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff93a7f3640 1 --2- 172.21.15.88:0/2174920741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed4e00 0x558256ed5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff939ff2640 1 -- 172.21.15.88:0/2174920741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed4e00 msgr2=0x558256ed5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff939ff2640 1 --2- 172.21.15.88:0/2174920741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed4e00 0x558256ed5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff939ff2640 1 -- 172.21.15.88:0/2174920741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ea3ec0 msgr2=0x558256ed48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff939ff2640 1 --2- 172.21.15.88:0/2174920741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ea3ec0 0x558256ed48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff939ff2640 1 -- 172.21.15.88:0/2174920741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558256e06b00 con 0x558256edf520 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.481+0000 7ff939ff2640 1 --2- 172.21.15.88:0/2174920741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 0x558256ea3980 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff924009890 tx=0x7ff924030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d73163e27dd062 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.482+0000 7ff9177fe640 1 -- 172.21.15.88:0/2174920741 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924040070 con 0x558256edf520 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.482+0000 7ff9177fe640 1 -- 172.21.15.88:0/2174920741 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff924031cb0 con 0x558256edf520 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.482+0000 7ff9177fe640 1 -- 172.21.15.88:0/2174920741 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924003d90 con 0x558256edf520 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.482+0000 7ff93ee1a740 1 -- 172.21.15.88:0/2174920741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 msgr2=0x558256ea3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.482+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/2174920741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 0x558256ea3980 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff924009890 tx=0x7ff924030000 comp rx=0 tx=0).stop 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.482+0000 7ff93ee1a740 1 -- 172.21.15.88:0/2174920741 shutdown_connections 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.482+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/2174920741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed4e00 0x558256ed5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.482+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/2174920741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ea3ec0 0x558256ed48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.482+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/2174920741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 0x558256ea3980 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.482+0000 7ff93ee1a740 1 -- 172.21.15.88:0/2174920741 >> 172.21.15.88:0/2174920741 conn(0x558256ea5310 msgr2=0x558256edec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.482+0000 7ff93ee1a740 1 -- 172.21.15.88:0/2174920741 shutdown_connections 2024-01-22T10:13:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.482+0000 7ff93ee1a740 1 -- 172.21.15.88:0/2174920741 wait complete. 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.483+0000 7ff93ee1a740 1 -- start start 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.483+0000 7ff93ee1a740 1 Processor -- start 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff93ee1a740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 0x558256ea7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff93ee1a740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256edf520 0x558256eeeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff93ee1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ed1570 0x558256ed44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff93ee1a740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558256e0ee40 con 0x558256ed4e00 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff93ee1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x558256dc8250 con 0x558256ed1570 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff93ee1a740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x558256dc7ef0 con 0x558256edf520 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff939ff2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 0x558256ea7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff93ee1a740 10 client.0 _ll_register_callbacks cb 0x558256b1fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff939ff2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 0x558256ea7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44222/0 (socket says 172.21.15.88:44222) 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff939ff2640 1 -- 172.21.15.88:0/3593794353 learned_addr learned my addr 172.21.15.88:0/3593794353 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:15.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff93a7f3640 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ed1570 0x558256ed44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff9397f1640 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256edf520 0x558256eeeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff939ff2640 1 -- 172.21.15.88:0/3593794353 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256edf520 msgr2=0x558256eeeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff939ff2640 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256edf520 0x558256eeeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff939ff2640 1 -- 172.21.15.88:0/3593794353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ed1570 msgr2=0x558256ed44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff939ff2640 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ed1570 0x558256ed44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff939ff2640 1 -- 172.21.15.88:0/3593794353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9340bb840 con 0x558256ed4e00 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff9397f1640 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256edf520 0x558256eeeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff939ff2640 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 0x558256ea7330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff924042040 tx=0x7ff924004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7069ca7d21343aaf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff914ff9640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff914ff9640 1 -- 172.21.15.88:0/3593794353 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924052630 con 0x558256ed4e00 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff914ff9640 1 -- 172.21.15.88:0/3593794353 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff92405daa0 con 0x558256ed4e00 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3593794353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558256e07cd0 con 0x558256ed4e00 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff914ff9640 1 -- 172.21.15.88:0/3593794353 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff92405dc60 con 0x558256ed4e00 2024-01-22T10:13:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff93ee1a740 10 client.4674 fetch_fsmap learned FSMap version 6 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3593794353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x558256e0d4c0 con 0x558256ed4e00 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.484+0000 7ff914ff9640 1 -- 172.21.15.88:0/3593794353 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558256e07cd0 con 0x558256ed4e00 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.485+0000 7ff914ff9640 1 -- 172.21.15.88:0/3593794353 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 6) v1 ==== 2719+0+0 (secure 0 0 0) 0x7ff924052790 con 0x558256ed4e00 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.485+0000 7ff93ee1a740 10 client.4674 fetch_fsmap finished waiting for FSMap version 6 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.485+0000 7ff93ee1a740 10 client.4674 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.485+0000 7ff93ee1a740 20 client.4674 populate_metadata read hostname 'smithi088' 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.485+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.88:6835/1505620357,v1:172.21.15.88:6837/1505620357] conn(0x558256ede1a0 0x558256ef9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.485+0000 7ff93ee1a740 4 client.4674 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.485+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3593794353 --> [v2:172.21.15.88:6835/1505620357,v1:172.21.15.88:6837/1505620357] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558256e079f0 con 0x558256ede1a0 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.485+0000 7ff9397f1640 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.88:6835/1505620357,v1:172.21.15.88:6837/1505620357] conn(0x558256ede1a0 0x558256ef9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.485+0000 7ff914ff9640 10 client.4674 ms_handle_connect on v2:172.21.15.88:6835/1505620357 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.485+0000 7ff9397f1640 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.88:6835/1505620357,v1:172.21.15.88:6837/1505620357] conn(0x558256ede1a0 0x558256ef9d30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1caef758d32669cd server_cookie=f18dc4a15e9dc87 in_seq=0 out_seq=0 2024-01-22T10:13:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff914ff9640 1 -- 172.21.15.88:0/3593794353 <== mds.0 v2:172.21.15.88:6835/1505620357 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558256e079f0 con 0x558256ede1a0 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff914ff9640 10 client.4674 handle_command_reply: tid=0 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff93ee1a740 1 client.4674 shutdown 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3593794353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 msgr2=0x558256ea7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 0x558256ea7330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff924042040 tx=0x7ff924004730 comp rx=0 tx=0).stop 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3593794353 shutdown_connections 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.88:6835/1505620357,v1:172.21.15.88:6837/1505620357] conn(0x558256ede1a0 0x558256ef9d30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256edf520 0x558256eeeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ed1570 0x558256ed44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff914ff9640 0 client.4674 ms_handle_reset on v2:172.21.15.88:6835/1505620357 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/3593794353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 0x558256ea7330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3593794353 >> 172.21.15.88:0/3593794353 conn(0x558256ea3ec0 msgr2=0x558256ea28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3593794353 shutdown_connections 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3593794353 wait complete. 2024-01-22T10:13:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.486+0000 7ff93ee1a740 20 client.4674 trim_cache size 0 max 16384 2024-01-22T10:13:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.501+0000 7ff93ee1a740 1 Processor -- start 2024-01-22T10:13:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.501+0000 7ff93ee1a740 1 -- start start 2024-01-22T10:13:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff93ee1a740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed1570 0x558256ed4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff93ee1a740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 0x558256ea6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff93ee1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256edf520 0x558256efdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff93ee1a740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558256d8d300 con 0x558256ed4e00 2024-01-22T10:13:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff93ee1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x558256eeb740 con 0x558256edf520 2024-01-22T10:13:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff93ee1a740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x558256ed48a0 con 0x558256ed1570 2024-01-22T10:13:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff9397f1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 0x558256ea6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff9397f1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 0x558256ea6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44224/0 (socket says 172.21.15.88:44224) 2024-01-22T10:13:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff9397f1640 1 -- 172.21.15.88:0/1529048574 learned_addr learned my addr 172.21.15.88:0/1529048574 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff9397f1640 1 -- 172.21.15.88:0/1529048574 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed1570 msgr2=0x558256ed4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff9397f1640 1 --2- 172.21.15.88:0/1529048574 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed1570 0x558256ed4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff9397f1640 1 -- 172.21.15.88:0/1529048574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256edf520 msgr2=0x558256efdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff9397f1640 1 --2- 172.21.15.88:0/1529048574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256edf520 0x558256efdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff9397f1640 1 -- 172.21.15.88:0/1529048574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558256e3fca0 con 0x558256ed4e00 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff9397f1640 1 --2- 172.21.15.88:0/1529048574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 0x558256ea6ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff930000fb0 tx=0x7ff930009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b4443fd10984e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.502+0000 7ff916ffd640 1 -- 172.21.15.88:0/1529048574 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff930005e40 con 0x558256ed4e00 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.503+0000 7ff916ffd640 1 -- 172.21.15.88:0/1529048574 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93000d040 con 0x558256ed4e00 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.503+0000 7ff916ffd640 1 -- 172.21.15.88:0/1529048574 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff930015630 con 0x558256ed4e00 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.503+0000 7ff93ee1a740 1 -- 172.21.15.88:0/1529048574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 msgr2=0x558256ea6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.503+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/1529048574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 0x558256ea6ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff930000fb0 tx=0x7ff930009040 comp rx=0 tx=0).stop 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.503+0000 7ff93ee1a740 1 -- 172.21.15.88:0/1529048574 shutdown_connections 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.503+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/1529048574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256edf520 0x558256efdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.503+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/1529048574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256ed4e00 0x558256ea6ba0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.503+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/1529048574 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed1570 0x558256ed4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.503+0000 7ff93ee1a740 1 -- 172.21.15.88:0/1529048574 >> 172.21.15.88:0/1529048574 conn(0x558256ea3ec0 msgr2=0x558256ed97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:15.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.503+0000 7ff93ee1a740 1 -- 172.21.15.88:0/1529048574 shutdown_connections 2024-01-22T10:13:15.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.503+0000 7ff93ee1a740 1 -- 172.21.15.88:0/1529048574 wait complete. 2024-01-22T10:13:15.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.504+0000 7ff93ee1a740 1 -- start start 2024-01-22T10:13:15.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.504+0000 7ff93ee1a740 1 Processor -- start 2024-01-22T10:13:15.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.504+0000 7ff93ee1a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ed1570 0x558256efe1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.504+0000 7ff93ee1a740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed4e00 0x558256f40150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.504+0000 7ff93ee1a740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 0x558256f40690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.504+0000 7ff93ee1a740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x558256d96650 con 0x558256edf520 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.504+0000 7ff93ee1a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x558256edd1f0 con 0x558256ed1570 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.504+0000 7ff93ee1a740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x558256f49e30 con 0x558256ed4e00 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.504+0000 7ff93ee1a740 10 client.0 _ll_register_callbacks cb 0x7ff924009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.504+0000 7ff93a7f3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 0x558256f40690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93a7f3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 0x558256f40690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44234/0 (socket says 172.21.15.88:44234) 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93a7f3640 1 -- 172.21.15.88:0/3931294380 learned_addr learned my addr 172.21.15.88:0/3931294380 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93a7f3640 1 -- 172.21.15.88:0/3931294380 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed4e00 msgr2=0x558256f40150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93a7f3640 1 --2- 172.21.15.88:0/3931294380 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed4e00 0x558256f40150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93a7f3640 1 -- 172.21.15.88:0/3931294380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ed1570 msgr2=0x558256efe1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93a7f3640 1 --2- 172.21.15.88:0/3931294380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ed1570 0x558256efe1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93a7f3640 1 -- 172.21.15.88:0/3931294380 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff930007300 con 0x558256edf520 2024-01-22T10:13:15.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93a7f3640 1 --2- 172.21.15.88:0/3931294380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 0x558256f40690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff92c007b10 tx=0x7ff92c0595f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80ac794b742c0a3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff914ff9640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff914ff9640 1 -- 172.21.15.88:0/3931294380 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c061130 con 0x558256edf520 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff914ff9640 1 -- 172.21.15.88:0/3931294380 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff92c004670 con 0x558256edf520 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3931294380 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff924031cb0 con 0x558256edf520 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff914ff9640 1 -- 172.21.15.88:0/3931294380 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff92c004830 con 0x558256edf520 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93ee1a740 10 client.4680 fetch_fsmap learned FSMap version 6 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3931294380 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x558256daa150 con 0x558256edf520 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff914ff9640 1 -- 172.21.15.88:0/3931294380 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff924031cb0 con 0x558256edf520 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff914ff9640 1 -- 172.21.15.88:0/3931294380 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 6) v1 ==== 2719+0+0 (secure 0 0 0) 0x7ff92c008040 con 0x558256edf520 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93ee1a740 10 client.4680 fetch_fsmap finished waiting for FSMap version 6 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93ee1a740 10 client.4680 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93ee1a740 20 client.4680 populate_metadata read hostname 'smithi088' 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/3931294380 >> [v2:172.21.15.88:6835/1505620357,v1:172.21.15.88:6837/1505620357] conn(0x558256edb320 0x558256edb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93ee1a740 4 client.4680 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3931294380 --> [v2:172.21.15.88:6835/1505620357,v1:172.21.15.88:6837/1505620357] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558256b0e6c0 con 0x558256edb320 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.505+0000 7ff939ff2640 1 --2- 172.21.15.88:0/3931294380 >> [v2:172.21.15.88:6835/1505620357,v1:172.21.15.88:6837/1505620357] conn(0x558256edb320 0x558256edb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff914ff9640 10 client.4680 ms_handle_connect on v2:172.21.15.88:6835/1505620357 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff939ff2640 1 --2- 172.21.15.88:0/3931294380 >> [v2:172.21.15.88:6835/1505620357,v1:172.21.15.88:6837/1505620357] conn(0x558256edb320 0x558256edb700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43cf76fdc3dd69ee server_cookie=f4be9844c7072021 in_seq=0 out_seq=0 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff914ff9640 1 -- 172.21.15.88:0/3931294380 <== mds.0 v2:172.21.15.88:6835/1505620357 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x558256b0e6c0 con 0x558256edb320 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff914ff9640 10 client.4680 handle_command_reply: tid=0 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93ee1a740 1 client.4680 shutdown 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3931294380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 msgr2=0x558256f40690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/3931294380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 0x558256f40690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff92c007b10 tx=0x7ff92c0595f0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3931294380 shutdown_connections 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/3931294380 >> [v2:172.21.15.88:6835/1505620357,v1:172.21.15.88:6837/1505620357] conn(0x558256edb320 0x558256edb700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/3931294380 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x558256ed4e00 0x558256f40150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/3931294380 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x558256edf520 0x558256f40690 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff914ff9640 0 client.4680 ms_handle_reset on v2:172.21.15.88:6835/1505620357 2024-01-22T10:13:15.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93ee1a740 1 --2- 172.21.15.88:0/3931294380 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x558256ed1570 0x558256efe1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3931294380 >> 172.21.15.88:0/3931294380 conn(0x558256ea3ec0 msgr2=0x558256eeecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:15.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3931294380 shutdown_connections 2024-01-22T10:13:15.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93ee1a740 1 -- 172.21.15.88:0/3931294380 wait complete. 2024-01-22T10:13:15.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93ee1a740 20 client.4680 trim_cache size 0 max 16384 2024-01-22T10:13:15.494 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-01-22T10:13:15.494 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "f2d9b200-f96e-479f-bf7c-16080c3af8a6", 2024-01-22T10:13:15.494 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2024-01-22T10:13:15.494 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4287, 2024-01-22T10:13:15.494 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2024-01-22T10:13:15.495 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2024-01-22T10:13:15.495 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2024-01-22T10:13:15.495 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 11.989312309000001, 2024-01-22T10:13:15.495 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 6, 2024-01-22T10:13:15.495 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 20, 2024-01-22T10:13:15.495 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 20, 2024-01-22T10:13:15.495 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 19.036543042000002 2024-01-22T10:13:15.495 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-01-22T10:13:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93c256640 1 -- 172.21.15.88:0/2045875009 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff91806b330 msgr2=0x7ff91806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93c256640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff91806b330 0x7ff91806d7f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff924036000 tx=0x7ff924008030 comp rx=0 tx=0).stop 2024-01-22T10:13:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93c256640 1 -- 172.21.15.88:0/2045875009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93409a590 msgr2=0x7ff93414ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93c256640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93409a590 0x7ff93414ee00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00ce70 tx=0x7ff92c00a710 comp rx=0 tx=0).stop 2024-01-22T10:13:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93c256640 1 -- 172.21.15.88:0/2045875009 shutdown_connections 2024-01-22T10:13:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93c256640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff91806b330 0x7ff91806d7f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93c256640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff93414c3b0 0x7ff9341e4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93c256640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93409a590 0x7ff93414ee00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93c256640 1 --2- 172.21.15.88:0/2045875009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff93414b930 0x7ff934147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93c256640 1 -- 172.21.15.88:0/2045875009 >> 172.21.15.88:0/2045875009 conn(0x7ff9340bd940 msgr2=0x7ff9340a2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:15.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93c256640 1 -- 172.21.15.88:0/2045875009 shutdown_connections 2024-01-22T10:13:15.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.506+0000 7ff93c256640 1 -- 172.21.15.88:0/2045875009 wait complete. 2024-01-22T10:13:15.499 INFO:teuthology.run_tasks:Running task kclient... 2024-01-22T10:13:15.522 INFO:tasks.kclient:Mounting kernel clients... 2024-01-22T10:13:15.522 INFO:tasks.kclient:config is {'client.0': {}} 2024-01-22T10:13:15.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:15.522 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-01-22T10:13:15.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:15.568 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-01-22T10:13:15.687 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2024-01-22T10:13:15.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:13:15.690 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-01-22T10:13:15.690 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-22T10:13:15.690 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T10:13:15.691 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-22T10:13:15.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.807+0000 7f9bd2943640 1 Processor -- start 2024-01-22T10:13:15.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.808+0000 7f9bd2943640 1 -- start start 2024-01-22T10:13:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.808+0000 7f9bd2943640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9bcc141920 0x7f9bcc148550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.808+0000 7f9bd2943640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bcc1480c0 con 0x7f9bcc0b3f70 2024-01-22T10:13:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.808+0000 7f9bd2943640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bcc0b4500 con 0x7f9bcc0b22c0 2024-01-22T10:13:15.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.808+0000 7f9bd2943640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bcc0b2750 con 0x7f9bcc141920 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.808+0000 7f9bcb7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9bcc0b3f70 0x7f9bcc0b69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42114/0 (socket says 172.21.15.88:42114) 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.808+0000 7f9bcb7fe640 1 -- 172.21.15.88:0/54514943 learned_addr learned my addr 172.21.15.88:0/54514943 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692846064 0 0) 0x7f9bcc1480c0 con 0x7f9bcc0b3f70 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bb4004630 con 0x7f9bcc0b3f70 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcbfff640 1 --2- 172.21.15.88:0/54514943 >> v2:172.21.15.119:3300/0 conn(0x7f9bcc141920 0x7f9bcc148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2471467381 0 0) 0x7f9bb4004630 con 0x7f9bcc0b3f70 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 >> v2:172.21.15.119:3300/0 conn(0x7f9bcc141920 msgr2=0x7f9bcc148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 --2- 172.21.15.88:0/54514943 >> v2:172.21.15.119:3300/0 conn(0x7f9bcc141920 0x7f9bcc148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 >> v1:172.21.15.119:6789/0 conn(0x7f9bcc0b22c0 legacy=0x7f9bcc0b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc147a70 con 0x7f9bcc0b3f70 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f9bbc001670 con 0x7f9bcc0b3f70 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 >> v1:172.21.15.88:6789/0 conn(0x7f9bcc0b3f70 legacy=0x7f9bcc0b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 --2- 172.21.15.88:0/54514943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bb4004b60 0x7f9bb4004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 --2- 172.21.15.88:0/54514943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb40058d0 0x7f9bb4005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 --2- 172.21.15.88:0/54514943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 0x7f9bb400ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc0b2750 con 0x7f9bb40062e0 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb400d210 con 0x7f9bb4004b60 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb400d3d0 con 0x7f9bb40058d0 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bd0ee0640 1 --2- 172.21.15.88:0/54514943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 0x7f9bb400ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcbfff640 1 --2- 172.21.15.88:0/54514943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bb4004b60 0x7f9bb4004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcb7fe640 1 --2- 172.21.15.88:0/54514943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb40058d0 0x7f9bb4005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bd0ee0640 1 -- 172.21.15.88:0/54514943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb40058d0 msgr2=0x7f9bb4005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bd0ee0640 1 --2- 172.21.15.88:0/54514943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb40058d0 0x7f9bb4005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bd0ee0640 1 -- 172.21.15.88:0/54514943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bb4004b60 msgr2=0x7f9bb4004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bd0ee0640 1 --2- 172.21.15.88:0/54514943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bb4004b60 0x7f9bb4004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bd0ee0640 1 -- 172.21.15.88:0/54514943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4004630 con 0x7f9bb40062e0 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.809+0000 7f9bcb7fe640 1 --2- 172.21.15.88:0/54514943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb40058d0 0x7f9bb4005d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:15.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.810+0000 7f9bd0ee0640 1 -- 172.21.15.88:0/54514943 reap_dead start 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.810+0000 7f9bd0ee0640 1 --2- 172.21.15.88:0/54514943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 0x7f9bb400ca90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4001e20 tx=0x7f9bb4006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b81907120824b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.810+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4003b70 con 0x7f9bb40062e0 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.810+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc4003cd0 con 0x7f9bb40062e0 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.810+0000 7f9bcaffd640 1 -- 172.21.15.88:0/54514943 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4005310 con 0x7f9bb40062e0 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.811+0000 7f9bd2943640 1 -- 172.21.15.88:0/54514943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 msgr2=0x7f9bb400ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.811+0000 7f9bd2943640 1 --2- 172.21.15.88:0/54514943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 0x7f9bb400ca90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4001e20 tx=0x7f9bb4006900 comp rx=0 tx=0).stop 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.811+0000 7f9bd2943640 1 -- 172.21.15.88:0/54514943 shutdown_connections 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.811+0000 7f9bd2943640 1 --2- 172.21.15.88:0/54514943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 0x7f9bb400ca90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.811+0000 7f9bd2943640 1 -- 172.21.15.88:0/54514943 >> 172.21.15.88:0/54514943 conn(0x7f9bcc06acf0 msgr2=0x7f9bcc0bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.811+0000 7f9bd2943640 1 -- 172.21.15.88:0/54514943 shutdown_connections 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.811+0000 7f9bd2943640 1 -- 172.21.15.88:0/54514943 wait complete. 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.812+0000 7f9bd2943640 1 Processor -- start 2024-01-22T10:13:15.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.812+0000 7f9bd2943640 1 -- start start 2024-01-22T10:13:15.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.812+0000 7f9bd2943640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 0x7f9bcc0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.812+0000 7f9bd2943640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc071ec0 0x7f9bcc06f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bd2943640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bcc1dcc50 0x7f9bcc1dd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bd2943640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc070930 con 0x7f9bb40062e0 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bd2943640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc1446c0 con 0x7f9bcc071ec0 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bd2943640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc071b10 con 0x7f9bcc1dcc50 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bcbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 0x7f9bcc0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bcbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 0x7f9bcc0703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44258/0 (socket says 172.21.15.88:44258) 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bcbfff640 1 -- 172.21.15.88:0/2726254053 learned_addr learned my addr 172.21.15.88:0/2726254053 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bd0ee0640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bcc1dcc50 0x7f9bcc1dd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bcb7fe640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc071ec0 0x7f9bcc06f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bcbfff640 1 -- 172.21.15.88:0/2726254053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bcc1dcc50 msgr2=0x7f9bcc1dd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bcbfff640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bcc1dcc50 0x7f9bcc1dd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bcbfff640 1 -- 172.21.15.88:0/2726254053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc071ec0 msgr2=0x7f9bcc06f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bcbfff640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc071ec0 0x7f9bcc06f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bcbfff640 1 -- 172.21.15.88:0/2726254053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc1dd620 con 0x7f9bb40062e0 2024-01-22T10:13:15.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bcb7fe640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc071ec0 0x7f9bcc06f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bd0ee0640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bcc1dcc50 0x7f9bcc1dd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bcbfff640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 0x7f9bcc0703f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0011910 tx=0x7f9bc0011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bc8ff9640 1 -- 172.21.15.88:0/2726254053 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc000faf0 con 0x7f9bb40062e0 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bc8ff9640 1 -- 172.21.15.88:0/2726254053 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc000fc50 con 0x7f9bb40062e0 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bc8ff9640 1 -- 172.21.15.88:0/2726254053 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0014440 con 0x7f9bb40062e0 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bd2943640 1 -- 172.21.15.88:0/2726254053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bcc144910 con 0x7f9bb40062e0 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.813+0000 7f9bd2943640 1 -- 172.21.15.88:0/2726254053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bcc144ed0 con 0x7f9bb40062e0 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.814+0000 7f9bd2943640 1 -- 172.21.15.88:0/2726254053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bcc04ea30 con 0x7f9bb40062e0 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.815+0000 7f9bc8ff9640 1 -- 172.21.15.88:0/2726254053 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f9bc00145a0 con 0x7f9bb40062e0 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.815+0000 7f9bc8ff9640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9bb806b330 0x7f9bb806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.815+0000 7f9bc8ff9640 1 -- 172.21.15.88:0/2726254053 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bc008a470 con 0x7f9bb40062e0 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.815+0000 7f9bcb7fe640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9bb806b330 0x7f9bb806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.815+0000 7f9bcb7fe640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9bb806b330 0x7f9bb806d7f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0b6ae0 tx=0x7f9bbc001e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:15.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:15.819+0000 7f9bc8ff9640 1 -- 172.21.15.88:0/2726254053 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9bc0055100 con 0x7f9bb40062e0 2024-01-22T10:13:16.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.022+0000 7f9bd2943640 1 -- 172.21.15.88:0/2726254053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9bcc145320 con 0x7f9bb40062e0 2024-01-22T10:13:16.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.022+0000 7f9bc8ff9640 1 -- 172.21.15.88:0/2726254053 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9bc0058720 con 0x7f9bb40062e0 2024-01-22T10:13:16.005 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T10:13:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.024+0000 7f9bd2943640 1 -- 172.21.15.88:0/2726254053 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9bb806b330 msgr2=0x7f9bb806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.024+0000 7f9bd2943640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9bb806b330 0x7f9bb806d7f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0b6ae0 tx=0x7f9bbc001e70 comp rx=0 tx=0).stop 2024-01-22T10:13:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.024+0000 7f9bd2943640 1 -- 172.21.15.88:0/2726254053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 msgr2=0x7f9bcc0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.024+0000 7f9bd2943640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 0x7f9bcc0703f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0011910 tx=0x7f9bc0011dd0 comp rx=0 tx=0).stop 2024-01-22T10:13:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.024+0000 7f9bd2943640 1 -- 172.21.15.88:0/2726254053 shutdown_connections 2024-01-22T10:13:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.024+0000 7f9bd2943640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9bb806b330 0x7f9bb806d7f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.024+0000 7f9bd2943640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bcc1dcc50 0x7f9bcc1dd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:16.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.024+0000 7f9bd2943640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bcc071ec0 0x7f9bcc06f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:16.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.024+0000 7f9bd2943640 1 --2- 172.21.15.88:0/2726254053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bb40062e0 0x7f9bcc0703f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:16.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.024+0000 7f9bd2943640 1 -- 172.21.15.88:0/2726254053 >> 172.21.15.88:0/2726254053 conn(0x7f9bcc06acf0 msgr2=0x7f9bcc145eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:16.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.024+0000 7f9bd2943640 1 -- 172.21.15.88:0/2726254053 shutdown_connections 2024-01-22T10:13:16.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:16.024+0000 7f9bd2943640 1 -- 172.21.15.88:0/2726254053 wait complete. 2024-01-22T10:13:16.017 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-22T10:13:16.017 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T10:13:16.017 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2024-01-22T10:13:16.018 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T10:13:16.018 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T10:13:16.018 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-22T10:13:16.018 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-22T10:13:16.018 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T10:13:16.018 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T10:13:16.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:16.018 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2024-01-22T10:13:16.076 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T10:13:16.076 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T10:13:16.076 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T10:13:16.076 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-22T10:13:16.076 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42666sec preferred_lft 42666sec 2024-01-22T10:13:16.077 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2024-01-22T10:13:16.078 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-22T10:13:16.078 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-22T10:13:16.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:16.078 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-22T10:13:16.078 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-22T10:13:16.078 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2024-01-22T10:13:16.078 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2024-01-22T10:13:16.078 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2024-01-22T10:13:16.079 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-22T10:13:16.079 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-22T10:13:16.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:16.558 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T10:13:16.636 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-01-22T10:13:16.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:16.640 DEBUG:teuthology.orchestra.run.smithi161:> route 2024-01-22T10:13:16.709 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2024-01-22T10:13:16.709 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T10:13:16.709 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T10:13:16.709 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-22T10:13:16.710 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T10:13:16.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:16.713 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-22T10:13:16.713 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-22T10:13:16.713 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T10:13:16.713 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T10:13:16.713 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T10:13:16.713 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-22T10:13:17.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:17.455 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-01-22T10:13:17.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:17.510 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2024-01-22T10:13:17.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:17.560 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-22T10:13:17.560 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-22T10:13:17.560 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T10:13:17.560 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-22T10:13:17.560 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-22T10:13:17.696 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-22T10:13:17.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:17.696 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-22T10:13:17.696 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-22T10:13:17.696 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-22T10:13:17.696 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-22T10:13:17.696 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-22T10:13:17.697 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-22T10:13:17.697 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-22T10:13:17.697 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-22T10:13:17.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:17.972 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-22T10:13:17.973 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-22T10:13:17.973 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2024-01-22T10:13:17.973 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2024-01-22T10:13:17.973 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-22T10:13:18.136 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-22T10:13:18.136 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-22T10:13:18.180 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-22T10:13:18.180 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-22T10:13:18.180 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-22T10:13:18.273 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-22T10:13:18.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:18.274 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-22T10:13:18.416 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-22T10:13:18.417 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-22T10:13:18.417 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2024-01-22T10:13:19.035 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-22T10:13:19.036 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-22T10:13:19.036 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2024-01-22T10:13:19.036 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.119:3300,172.21.15.119:3301" 2024-01-22T10:13:19.036 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-22T10:13:19.067 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-22T10:13:19.067 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-22T10:13:19.067 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2024-01-22T10:13:19.067 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.119:3300,172.21.15.119:3301" 2024-01-22T10:13:19.067 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-22T10:13:19.067 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.88:6789,172.21.15.119:6789,172.21.15.119:6790" 2024-01-22T10:13:19.067 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.88:6789,172.21.15.119:6789,172.21.15.119:6790:/ 2024-01-22T10:13:19.067 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2d9b200-f96e-479f-bf7c-16080c3af8a6" will pass to kernel 2024-01-22T10:13:19.070 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-22T10:13:19.070 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2024-01-22T10:13:19.071 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-22T10:13:19.071 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2024-01-22T10:13:19.071 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-22T10:13:19.077 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T10:13:19.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:19.077 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T10:13:19.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:19.170 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-22T10:13:19.234 INFO:teuthology.orchestra.run.smithi161.stdout:client4689 2024-01-22T10:13:19.234 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:13:19.234 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-22T10:13:19.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:19.288 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-22T10:13:19.354 INFO:teuthology.orchestra.run.smithi161.stdout:client4689 2024-01-22T10:13:19.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:19.354 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-22T10:13:19.423 INFO:teuthology.orchestra.run.smithi161.stdout:client4689 2024-01-22T10:13:19.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:19.424 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f2d9b200-f96e-479f-bf7c-16080c3af8a6.client4689/status') 2024-01-22T10:13:19.525 INFO:teuthology.orchestra.run.smithi161.stdout:instance: client.4689 (3)172.21.15.161:0/617153904 2024-01-22T10:13:19.526 INFO:teuthology.orchestra.run.smithi161.stdout:blocklisted: false 2024-01-22T10:13:19.526 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2024-01-22T10:13:19.526 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2024-01-22T10:13:19.526 INFO:teuthology.orchestra.run.smithi161.stderr:70 bytes copied, 6.4029e-05 s, 1.1 MB/s 2024-01-22T10:13:19.531 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-22T10:13:19.558 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.685+0000 7fac02f0f640 1 Processor -- start 2024-01-22T10:13:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.685+0000 7fac02f0f640 1 -- start start 2024-01-22T10:13:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.686+0000 7fac02f0f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc06ecb0 0x7fabfc06f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.686+0000 7fac02f0f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc0b5460 con 0x7fabfc14c9a0 2024-01-22T10:13:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.686+0000 7fac02f0f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc0b5700 con 0x7fabfc06e360 2024-01-22T10:13:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.686+0000 7fac02f0f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0b59e0 con 0x7fabfc06ecb0 2024-01-22T10:13:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.686+0000 7fac014ac640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fabfc14c9a0 0x7fabfc14ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58442/0 (socket says 172.21.15.88:58442) 2024-01-22T10:13:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.686+0000 7fac014ac640 1 -- 172.21.15.88:0/3577758208 learned_addr learned my addr 172.21.15.88:0/3577758208 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.686+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196310150 0 0) 0x7fabfc0b5460 con 0x7fabfc14c9a0 2024-01-22T10:13:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.686+0000 7fac00cab640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc06ecb0 0x7fabfc06f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.686+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe4003520 con 0x7fabfc14c9a0 2024-01-22T10:13:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1934873779 0 0) 0x7fabe4003520 con 0x7fabfc14c9a0 2024-01-22T10:13:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc06ecb0 msgr2=0x7fabfc06f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc06ecb0 0x7fabfc06f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 >> v1:172.21.15.119:6789/0 conn(0x7fabfc06e360 legacy=0x7fabfc1432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc06f090 con 0x7fabfc14c9a0 2024-01-22T10:13:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fabf40019f0 con 0x7fabfc14c9a0 2024-01-22T10:13:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 >> v1:172.21.15.88:6789/0 conn(0x7fabfc14c9a0 legacy=0x7fabfc14ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc06ecb0 0x7fabe4003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabe4004000 0x7fabe40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabe4004d00 0x7fabe4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0b59e0 con 0x7fabe4004000 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe400bb70 con 0x7fabe4004d00 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe400bd30 con 0x7fabfc06ecb0 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfbfff640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabe4004000 0x7fabe40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fac00cab640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc06ecb0 0x7fabe4003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fac014ac640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabe4004d00 0x7fabe4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfbfff640 1 -- 172.21.15.88:0/3577758208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc06ecb0 msgr2=0x7fabe4003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfbfff640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc06ecb0 0x7fabe4003a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfbfff640 1 -- 172.21.15.88:0/3577758208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabe4004d00 msgr2=0x7fabe4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfbfff640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabe4004d00 0x7fabe4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fabfbfff640 1 -- 172.21.15.88:0/3577758208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe4003520 con 0x7fabe4004000 2024-01-22T10:13:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.687+0000 7fac00cab640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc06ecb0 0x7fabe4003a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.688+0000 7fabfbfff640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabe4004000 0x7fabe40047c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fabf0001750 tx=0x7fabe40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f1dbc371624dfd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.688+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00052d0 con 0x7fabe4004000 2024-01-22T10:13:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.688+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf002e050 con 0x7fabe4004000 2024-01-22T10:13:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.688+0000 7fabfb7fe640 1 -- 172.21.15.88:0/3577758208 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0003830 con 0x7fabe4004000 2024-01-22T10:13:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.688+0000 7fac02f0f640 1 -- 172.21.15.88:0/3577758208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabe4004000 msgr2=0x7fabe40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.688+0000 7fac02f0f640 1 --2- 172.21.15.88:0/3577758208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabe4004000 0x7fabe40047c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fabf0001750 tx=0x7fabe40057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.688+0000 7fac014ac640 1 -- 172.21.15.88:0/3577758208 reap_dead start 2024-01-22T10:13:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.688+0000 7fac02f0f640 1 -- 172.21.15.88:0/3577758208 shutdown_connections 2024-01-22T10:13:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.688+0000 7fac02f0f640 1 -- 172.21.15.88:0/3577758208 >> 172.21.15.88:0/3577758208 conn(0x7fabfc0bb8d0 msgr2=0x7fabfc0bbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.688+0000 7fac02f0f640 1 -- 172.21.15.88:0/3577758208 shutdown_connections 2024-01-22T10:13:19.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.688+0000 7fac02f0f640 1 -- 172.21.15.88:0/3577758208 wait complete. 2024-01-22T10:13:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.689+0000 7fac02f0f640 1 Processor -- start 2024-01-22T10:13:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.690+0000 7fac02f0f640 1 -- start start 2024-01-22T10:13:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.690+0000 7fac02f0f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabe4004000 0x7fabfc13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.690+0000 7fac02f0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabfc13b7e0 0x7fabfc1df2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.690+0000 7fac02f0f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc0bdd90 0x7fabfc139400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.690+0000 7fac02f0f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0be210 con 0x7fabfc13b7e0 2024-01-22T10:13:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.690+0000 7fac02f0f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc14c520 con 0x7fabe4004000 2024-01-22T10:13:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.690+0000 7fac02f0f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc13bd10 con 0x7fabfc0bdd90 2024-01-22T10:13:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.690+0000 7fabfbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabfc13b7e0 0x7fabfc1df2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.690+0000 7fabfbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabfc13b7e0 0x7fabfc1df2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35986/0 (socket says 172.21.15.88:35986) 2024-01-22T10:13:19.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.690+0000 7fabfbfff640 1 -- 172.21.15.88:0/3155390973 learned_addr learned my addr 172.21.15.88:0/3155390973 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fac00cab640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabe4004000 0x7fabfc13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fac014ac640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc0bdd90 0x7fabfc139400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fabfbfff640 1 -- 172.21.15.88:0/3155390973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc0bdd90 msgr2=0x7fabfc139400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fabfbfff640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc0bdd90 0x7fabfc139400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fabfbfff640 1 -- 172.21.15.88:0/3155390973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabe4004000 msgr2=0x7fabfc13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fabfbfff640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabe4004000 0x7fabfc13ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fabfbfff640 1 -- 172.21.15.88:0/3155390973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc14b930 con 0x7fabfc13b7e0 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fac00cab640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabe4004000 0x7fabfc13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fac014ac640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc0bdd90 0x7fabfc139400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fabfbfff640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabfc13b7e0 0x7fabfc1df2b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fabf0008fd0 tx=0x7fabf0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fabf97fa640 1 -- 172.21.15.88:0/3155390973 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00076c0 con 0x7fabfc13b7e0 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fabf97fa640 1 -- 172.21.15.88:0/3155390973 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf0007a30 con 0x7fabfc13b7e0 2024-01-22T10:13:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fac02f0f640 1 -- 172.21.15.88:0/3155390973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc13c510 con 0x7fabfc13b7e0 2024-01-22T10:13:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fabf97fa640 1 -- 172.21.15.88:0/3155390973 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0006c20 con 0x7fabfc13b7e0 2024-01-22T10:13:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.691+0000 7fac02f0f640 1 -- 172.21.15.88:0/3155390973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc13cad0 con 0x7fabfc13b7e0 2024-01-22T10:13:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.692+0000 7fac02f0f640 1 -- 172.21.15.88:0/3155390973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabfc0b4bc0 con 0x7fabfc13b7e0 2024-01-22T10:13:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.693+0000 7fabf97fa640 1 -- 172.21.15.88:0/3155390973 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fabf00035f0 con 0x7fabfc13b7e0 2024-01-22T10:13:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.693+0000 7fabf97fa640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fabe806b330 0x7fabe806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.693+0000 7fac00cab640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fabe806b330 0x7fabe806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.693+0000 7fabf97fa640 1 -- 172.21.15.88:0/3155390973 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabf00ab8a0 con 0x7fabfc13b7e0 2024-01-22T10:13:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.693+0000 7fac00cab640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fabe806b330 0x7fabe806d7f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fabec009b50 tx=0x7fabec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.697+0000 7fabf97fa640 1 -- 172.21.15.88:0/3155390973 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fabf0076530 con 0x7fabfc13b7e0 2024-01-22T10:13:19.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.866+0000 7fac02f0f640 1 -- 172.21.15.88:0/3155390973 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabfc04ea30 con 0x7fabfc13b7e0 2024-01-22T10:13:19.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.868+0000 7fabf97fa640 1 -- 172.21.15.88:0/3155390973 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fabf004b090 con 0x7fabfc13b7e0 2024-01-22T10:13:19.850 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:19.851 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:19.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.869+0000 7fac02f0f640 1 -- 172.21.15.88:0/3155390973 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fabe806b330 msgr2=0x7fabe806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:19.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.869+0000 7fac02f0f640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fabe806b330 0x7fabe806d7f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fabec009b50 tx=0x7fabec008040 comp rx=0 tx=0).stop 2024-01-22T10:13:19.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.869+0000 7fac02f0f640 1 -- 172.21.15.88:0/3155390973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabfc13b7e0 msgr2=0x7fabfc1df2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.869+0000 7fac02f0f640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabfc13b7e0 0x7fabfc1df2b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fabf0008fd0 tx=0x7fabf0001120 comp rx=0 tx=0).stop 2024-01-22T10:13:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.870+0000 7fac02f0f640 1 -- 172.21.15.88:0/3155390973 shutdown_connections 2024-01-22T10:13:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.870+0000 7fac02f0f640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fabe806b330 0x7fabe806d7f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.870+0000 7fac02f0f640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fabfc0bdd90 0x7fabfc139400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.870+0000 7fac02f0f640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabfc13b7e0 0x7fabfc1df2b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.870+0000 7fac02f0f640 1 --2- 172.21.15.88:0/3155390973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabe4004000 0x7fabfc13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.870+0000 7fac02f0f640 1 -- 172.21.15.88:0/3155390973 >> 172.21.15.88:0/3155390973 conn(0x7fabfc0bb8d0 msgr2=0x7fabfc13f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.870+0000 7fac02f0f640 1 -- 172.21.15.88:0/3155390973 shutdown_connections 2024-01-22T10:13:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.870+0000 7fac02f0f640 1 -- 172.21.15.88:0/3155390973 wait complete. 2024-01-22T10:13:19.863 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T10:13:00.844842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T10:13:01.816849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:13:19.863 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:13:19.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.983+0000 7fb7b5864640 1 Processor -- start 2024-01-22T10:13:19.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.983+0000 7fb7b5864640 1 -- start start 2024-01-22T10:13:19.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7b5864640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b0149010 0x7fb7b014b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7b5864640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b00bb7e0 con 0x7fb7b00b44f0 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7b5864640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b00c04e0 con 0x7fb7b00bbc70 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7b5864640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00a3150 con 0x7fb7b0149010 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7a7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb7b00b44f0 0x7fb7b00a2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58456/0 (socket says 172.21.15.88:58456) 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7a7fff640 1 -- 172.21.15.88:0/2384118154 learned_addr learned my addr 172.21.15.88:0/2384118154 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7aeffd640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b0149010 0x7fb7b014b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205582963 0 0) 0x7fb7b00bb7e0 con 0x7fb7b00b44f0 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb79c003520 con 0x7fb7b00b44f0 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2468641112 0 0) 0x7fb79c003520 con 0x7fb7b00b44f0 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b0149010 msgr2=0x7fb7b014b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b0149010 0x7fb7b014b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 >> v1:172.21.15.119:6789/0 conn(0x7fb7b00bbc70 legacy=0x7fb7b0156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:19.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b01493f0 con 0x7fb7b00b44f0 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fb798001670 con 0x7fb7b00b44f0 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 >> v1:172.21.15.88:6789/0 conn(0x7fb7b00b44f0 legacy=0x7fb7b00a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb79c0039a0 0x7fb79c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b0149010 0x7fb79c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb79c004d00 0x7fb79c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00a3150 con 0x7fb79c004d00 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c00b980 con 0x7fb79c0039a0 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c00bb40 con 0x7fb7b0149010 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.984+0000 7fb7af7fe640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb79c004d00 0x7fb79c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.985+0000 7fb7aeffd640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb79c0039a0 0x7fb79c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.985+0000 7fb7a7fff640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b0149010 0x7fb79c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.985+0000 7fb7af7fe640 1 -- 172.21.15.88:0/2384118154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b0149010 msgr2=0x7fb79c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:19.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.985+0000 7fb7af7fe640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b0149010 0x7fb79c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.985+0000 7fb7af7fe640 1 -- 172.21.15.88:0/2384118154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb79c0039a0 msgr2=0x7fb79c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.985+0000 7fb7af7fe640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb79c0039a0 0x7fb79c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.985+0000 7fb7af7fe640 1 -- 172.21.15.88:0/2384118154 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c003520 con 0x7fb79c004d00 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.985+0000 7fb7a7fff640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b0149010 0x7fb79c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.985+0000 7fb7af7fe640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb79c004d00 0x7fb79c005180 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8002010 tx=0x7fb79c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3190056307c6d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.986+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a802c750 con 0x7fb79c004d00 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.986+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a802c8b0 con 0x7fb79c004d00 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.986+0000 7fb7ae7fc640 1 -- 172.21.15.88:0/2384118154 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a802cc40 con 0x7fb79c004d00 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.986+0000 7fb7b5864640 1 -- 172.21.15.88:0/2384118154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb79c004d00 msgr2=0x7fb79c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.986+0000 7fb7b5864640 1 --2- 172.21.15.88:0/2384118154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb79c004d00 0x7fb79c005180 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8002010 tx=0x7fb79c0057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.986+0000 7fb7af7fe640 1 -- 172.21.15.88:0/2384118154 reap_dead start 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.986+0000 7fb7b5864640 1 -- 172.21.15.88:0/2384118154 shutdown_connections 2024-01-22T10:13:19.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.986+0000 7fb7b5864640 1 -- 172.21.15.88:0/2384118154 >> 172.21.15.88:0/2384118154 conn(0x7fb7b00c1040 msgr2=0x7fb7b00c1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.986+0000 7fb7b5864640 1 -- 172.21.15.88:0/2384118154 shutdown_connections 2024-01-22T10:13:19.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.986+0000 7fb7b5864640 1 -- 172.21.15.88:0/2384118154 wait complete. 2024-01-22T10:13:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.987+0000 7fb7b5864640 1 Processor -- start 2024-01-22T10:13:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.987+0000 7fb7b5864640 1 -- start start 2024-01-22T10:13:19.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7b5864640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb79c004d00 0x7fb7b00b8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7b5864640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b009f4f0 0x7fb7b00b9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7b5864640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7b00ba080 0x7fb7b00b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7b5864640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00bae80 con 0x7fb7b00ba080 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7b5864640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b01e1510 con 0x7fb79c004d00 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7b5864640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b01e17f0 con 0x7fb7b009f4f0 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7af7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7b00ba080 0x7fb7b00b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7af7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7b00ba080 0x7fb7b00b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36010/0 (socket says 172.21.15.88:36010) 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7af7fe640 1 -- 172.21.15.88:0/1596494834 learned_addr learned my addr 172.21.15.88:0/1596494834 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7aeffd640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb79c004d00 0x7fb7b00b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7a7fff640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b009f4f0 0x7fb7b00b9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7af7fe640 1 -- 172.21.15.88:0/1596494834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b009f4f0 msgr2=0x7fb7b00b9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7af7fe640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b009f4f0 0x7fb7b00b9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7af7fe640 1 -- 172.21.15.88:0/1596494834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb79c004d00 msgr2=0x7fb7b00b8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7af7fe640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb79c004d00 0x7fb7b00b8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7af7fe640 1 -- 172.21.15.88:0/1596494834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b01e1ad0 con 0x7fb7b00ba080 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7af7fe640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7b00ba080 0x7fb7b00b6960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8037040 tx=0x7fb7a8001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7acff9640 1 -- 172.21.15.88:0/1596494834 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8003b70 con 0x7fb7b00ba080 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7acff9640 1 -- 172.21.15.88:0/1596494834 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a8003cd0 con 0x7fb7b00ba080 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.988+0000 7fb7acff9640 1 -- 172.21.15.88:0/1596494834 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80052b0 con 0x7fb7b00ba080 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.989+0000 7fb7b5864640 1 -- 172.21.15.88:0/1596494834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b01e1db0 con 0x7fb7b00ba080 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.989+0000 7fb7b5864640 1 -- 172.21.15.88:0/1596494834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b00a00b0 con 0x7fb7b00ba080 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.989+0000 7fb7b5864640 1 -- 172.21.15.88:0/1596494834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b004ea30 con 0x7fb7b00ba080 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.990+0000 7fb7acff9640 1 -- 172.21.15.88:0/1596494834 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fb7a803b040 con 0x7fb7b00ba080 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.990+0000 7fb7acff9640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb79006b330 0x7fb79006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.990+0000 7fb7acff9640 1 -- 172.21.15.88:0/1596494834 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7a80ab1b0 con 0x7fb7b00ba080 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.990+0000 7fb7aeffd640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb79006b330 0x7fb79006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:19.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.991+0000 7fb7aeffd640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb79006b330 0x7fb79006d7f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009a80 tx=0x7fb7a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:19.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:19.994+0000 7fb7acff9640 1 -- 172.21.15.88:0/1596494834 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb7a8075e40 con 0x7fb7b00ba080 2024-01-22T10:13:20.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.162+0000 7fb7b5864640 1 -- 172.21.15.88:0/1596494834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7b01e1fa0 con 0x7fb7b00ba080 2024-01-22T10:13:20.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.162+0000 7fb7acff9640 1 -- 172.21.15.88:0/1596494834 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7a8007df0 con 0x7fb7b00ba080 2024-01-22T10:13:20.145 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:13:20.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.164+0000 7fb7b5864640 1 -- 172.21.15.88:0/1596494834 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb79006b330 msgr2=0x7fb79006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.164+0000 7fb7b5864640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb79006b330 0x7fb79006d7f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009a80 tx=0x7fb7a0008040 comp rx=0 tx=0).stop 2024-01-22T10:13:20.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.164+0000 7fb7b5864640 1 -- 172.21.15.88:0/1596494834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7b00ba080 msgr2=0x7fb7b00b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.164+0000 7fb7b5864640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7b00ba080 0x7fb7b00b6960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8037040 tx=0x7fb7a8001630 comp rx=0 tx=0).stop 2024-01-22T10:13:20.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.164+0000 7fb7b5864640 1 -- 172.21.15.88:0/1596494834 shutdown_connections 2024-01-22T10:13:20.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.164+0000 7fb7b5864640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb79006b330 0x7fb79006d7f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.164+0000 7fb7b5864640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b009f4f0 0x7fb7b00b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.164+0000 7fb7b5864640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7b00ba080 0x7fb7b00b6960 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.164+0000 7fb7b5864640 1 --2- 172.21.15.88:0/1596494834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb79c004d00 0x7fb7b00b8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.164+0000 7fb7b5864640 1 -- 172.21.15.88:0/1596494834 >> 172.21.15.88:0/1596494834 conn(0x7fb7b00c1040 msgr2=0x7fb7b006b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:20.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.164+0000 7fb7b5864640 1 -- 172.21.15.88:0/1596494834 shutdown_connections 2024-01-22T10:13:20.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.164+0000 7fb7b5864640 1 -- 172.21.15.88:0/1596494834 wait complete. 2024-01-22T10:13:20.161 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T10:13:20.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.280+0000 7fcb97f41640 1 Processor -- start 2024-01-22T10:13:20.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.281+0000 7fcb97f41640 1 -- start start 2024-01-22T10:13:20.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.281+0000 7fcb97f41640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb9014c1d0 0x7fcb9006f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.281+0000 7fcb97f41640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcb9006fc00 0x7fcb900b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.281+0000 7fcb97f41640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcb9006e700 0x7fcb9014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.281+0000 7fcb97f41640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9006c140 con 0x7fcb9006fc00 2024-01-22T10:13:20.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.281+0000 7fcb97f41640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9006cd90 con 0x7fcb9006e700 2024-01-22T10:13:20.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.281+0000 7fcb97f41640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9006d1b0 con 0x7fcb9014c1d0 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.281+0000 7fcb954dc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcb9006fc00 0x7fcb900b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.281+0000 7fcb954dc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcb9006fc00 0x7fcb900b5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36022/0 (socket says 172.21.15.88:36022) 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.281+0000 7fcb954dc640 1 -- 172.21.15.88:0/4011241374 learned_addr learned my addr 172.21.15.88:0/4011241374 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.282+0000 7fcb964de640 1 --2- 172.21.15.88:0/4011241374 >> v2:172.21.15.119:3300/0 conn(0x7fcb9006e700 0x7fcb9014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.282+0000 7fcb95cdd640 1 --2- 172.21.15.88:0/4011241374 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb9014c1d0 0x7fcb9006f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.282+0000 7fcb954dc640 1 -- 172.21.15.88:0/4011241374 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb9014c1d0 msgr2=0x7fcb9006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.282+0000 7fcb954dc640 1 --2- 172.21.15.88:0/4011241374 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb9014c1d0 0x7fcb9006f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.282+0000 7fcb954dc640 1 -- 172.21.15.88:0/4011241374 >> v2:172.21.15.119:3300/0 conn(0x7fcb9006e700 msgr2=0x7fcb9014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.282+0000 7fcb954dc640 1 --2- 172.21.15.88:0/4011241374 >> v2:172.21.15.119:3300/0 conn(0x7fcb9006e700 0x7fcb9014ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.282+0000 7fcb954dc640 1 -- 172.21.15.88:0/4011241374 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9006d470 con 0x7fcb9006fc00 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.282+0000 7fcb954dc640 1 --2- 172.21.15.88:0/4011241374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb9006fc00 0x7fcb900b5680 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcb9006e0b0 tx=0x7fcb8002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288a3e9e7601e233 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.283+0000 7fcb94cdb640 1 -- 172.21.15.88:0/4011241374 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80031870 con 0x7fcb9006fc00 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.283+0000 7fcb94cdb640 1 -- 172.21.15.88:0/4011241374 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb800319d0 con 0x7fcb9006fc00 2024-01-22T10:13:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.283+0000 7fcb94cdb640 1 -- 172.21.15.88:0/4011241374 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80031d60 con 0x7fcb9006fc00 2024-01-22T10:13:20.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.283+0000 7fcb97f41640 1 -- 172.21.15.88:0/4011241374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb9006fc00 msgr2=0x7fcb900b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.283+0000 7fcb97f41640 1 --2- 172.21.15.88:0/4011241374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb9006fc00 0x7fcb900b5680 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcb9006e0b0 tx=0x7fcb8002b910 comp rx=0 tx=0).stop 2024-01-22T10:13:20.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.283+0000 7fcb97f41640 1 -- 172.21.15.88:0/4011241374 shutdown_connections 2024-01-22T10:13:20.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.283+0000 7fcb97f41640 1 --2- 172.21.15.88:0/4011241374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb9006fc00 0x7fcb900b5680 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.283+0000 7fcb97f41640 1 --2- 172.21.15.88:0/4011241374 >> v2:172.21.15.119:3300/0 conn(0x7fcb9006e700 0x7fcb9014ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.283+0000 7fcb97f41640 1 --2- 172.21.15.88:0/4011241374 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb9014c1d0 0x7fcb9006f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.283+0000 7fcb97f41640 1 -- 172.21.15.88:0/4011241374 >> 172.21.15.88:0/4011241374 conn(0x7fcb900bb780 msgr2=0x7fcb900bbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.283+0000 7fcb97f41640 1 -- 172.21.15.88:0/4011241374 shutdown_connections 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.283+0000 7fcb97f41640 1 -- 172.21.15.88:0/4011241374 wait complete. 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.284+0000 7fcb97f41640 1 Processor -- start 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.284+0000 7fcb97f41640 1 -- start start 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb97f41640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb9006e700 0x7fcb901487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb97f41640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb9006fc00 0x7fcb901d4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb97f41640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb9014c1d0 0x7fcb901d5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb97f41640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb901e42d0 con 0x7fcb9006fc00 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb97f41640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90148cf0 con 0x7fcb9006e700 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb97f41640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb901e44e0 con 0x7fcb9014c1d0 2024-01-22T10:13:20.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb954dc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb9006fc00 0x7fcb901d4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb954dc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb9006fc00 0x7fcb901d4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36028/0 (socket says 172.21.15.88:36028) 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb954dc640 1 -- 172.21.15.88:0/3347785832 learned_addr learned my addr 172.21.15.88:0/3347785832 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb95cdd640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb9006e700 0x7fcb901487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb964de640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb9014c1d0 0x7fcb901d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb954dc640 1 -- 172.21.15.88:0/3347785832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb9014c1d0 msgr2=0x7fcb901d5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb954dc640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb9014c1d0 0x7fcb901d5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb954dc640 1 -- 172.21.15.88:0/3347785832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb9006e700 msgr2=0x7fcb901487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb954dc640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb9006e700 0x7fcb901487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb954dc640 1 -- 172.21.15.88:0/3347785832 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800094d0 con 0x7fcb9006fc00 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb954dc640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb9006fc00 0x7fcb901d4b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcb80000c00 tx=0x7fcb800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb867fc640 1 -- 172.21.15.88:0/3347785832 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80031860 con 0x7fcb9006fc00 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.285+0000 7fcb867fc640 1 -- 172.21.15.88:0/3347785832 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb800443f0 con 0x7fcb9006fc00 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.286+0000 7fcb97f41640 1 -- 172.21.15.88:0/3347785832 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb901e47c0 con 0x7fcb9006fc00 2024-01-22T10:13:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.286+0000 7fcb867fc640 1 -- 172.21.15.88:0/3347785832 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800447a0 con 0x7fcb9006fc00 2024-01-22T10:13:20.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.286+0000 7fcb97f41640 1 -- 172.21.15.88:0/3347785832 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb901e4d80 con 0x7fcb9006fc00 2024-01-22T10:13:20.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.286+0000 7fcb97f41640 1 -- 172.21.15.88:0/3347785832 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb900bb2d0 con 0x7fcb9006fc00 2024-01-22T10:13:20.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.287+0000 7fcb867fc640 1 -- 172.21.15.88:0/3347785832 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fcb80044900 con 0x7fcb9006fc00 2024-01-22T10:13:20.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.287+0000 7fcb867fc640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcb7406b330 0x7fcb7406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.287+0000 7fcb867fc640 1 -- 172.21.15.88:0/3347785832 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb8002d040 con 0x7fcb9006fc00 2024-01-22T10:13:20.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.287+0000 7fcb95cdd640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcb7406b330 0x7fcb7406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.288+0000 7fcb95cdd640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcb7406b330 0x7fcb7406d7f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00aa20 tx=0x7fcb8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:20.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.292+0000 7fcb867fc640 1 -- 172.21.15.88:0/3347785832 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcb800771b0 con 0x7fcb9006fc00 2024-01-22T10:13:20.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.459+0000 7fcb97f41640 1 -- 172.21.15.88:0/3347785832 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb9006c5a0 con 0x7fcb9006fc00 2024-01-22T10:13:20.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.459+0000 7fcb867fc640 1 -- 172.21.15.88:0/3347785832 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb8007a7d0 con 0x7fcb9006fc00 2024-01-22T10:13:20.442 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-01-22T10:13:20.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.461+0000 7fcb97f41640 1 -- 172.21.15.88:0/3347785832 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcb7406b330 msgr2=0x7fcb7406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.461+0000 7fcb97f41640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcb7406b330 0x7fcb7406d7f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00aa20 tx=0x7fcb8c008040 comp rx=0 tx=0).stop 2024-01-22T10:13:20.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.461+0000 7fcb97f41640 1 -- 172.21.15.88:0/3347785832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb9006fc00 msgr2=0x7fcb901d4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.461+0000 7fcb97f41640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb9006fc00 0x7fcb901d4b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcb80000c00 tx=0x7fcb800046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.461+0000 7fcb97f41640 1 -- 172.21.15.88:0/3347785832 shutdown_connections 2024-01-22T10:13:20.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.461+0000 7fcb97f41640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcb7406b330 0x7fcb7406d7f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.461+0000 7fcb97f41640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb9014c1d0 0x7fcb901d5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.461+0000 7fcb97f41640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb9006fc00 0x7fcb901d4b00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.461+0000 7fcb97f41640 1 --2- 172.21.15.88:0/3347785832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb9006e700 0x7fcb901487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.461+0000 7fcb97f41640 1 -- 172.21.15.88:0/3347785832 >> 172.21.15.88:0/3347785832 conn(0x7fcb900bb780 msgr2=0x7fcb9014ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:20.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.461+0000 7fcb97f41640 1 -- 172.21.15.88:0/3347785832 shutdown_connections 2024-01-22T10:13:20.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.461+0000 7fcb97f41640 1 -- 172.21.15.88:0/3347785832 wait complete. 2024-01-22T10:13:20.454 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T10:13:20.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.574+0000 7fbe752b4640 1 Processor -- start 2024-01-22T10:13:20.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.574+0000 7fbe752b4640 1 -- start start 2024-01-22T10:13:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe752b4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbe7006fc00 0x7fbe7006f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe752b4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe7006e700 0x7fbe70156070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe752b4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7006cd90 con 0x7fbe7014c1d0 2024-01-22T10:13:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe752b4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7006c140 con 0x7fbe7006fc00 2024-01-22T10:13:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe752b4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700b5d90 con 0x7fbe7006e700 2024-01-22T10:13:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe6effd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbe7014c1d0 0x7fbe700b5680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58468/0 (socket says 172.21.15.88:58468) 2024-01-22T10:13:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe6effd640 1 -- 172.21.15.88:0/1353557650 learned_addr learned my addr 172.21.15.88:0/1353557650 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe6e7fc640 1 --2- 172.21.15.88:0/1353557650 >> v2:172.21.15.88:3300/0 conn(0x7fbe7006fc00 0x7fbe7006f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe6dffb640 1 -- 172.21.15.88:0/1353557650 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104073276 0 0) 0x7fbe7006cd90 con 0x7fbe7014c1d0 2024-01-22T10:13:20.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe6dffb640 1 -- 172.21.15.88:0/1353557650 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe58003520 con 0x7fbe7014c1d0 2024-01-22T10:13:20.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe6f7fe640 1 --2- 172.21.15.88:0/1353557650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe7006e700 0x7fbe70156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe6e7fc640 1 -- 172.21.15.88:0/1353557650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe7006e700 msgr2=0x7fbe70156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:20.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe6e7fc640 1 --2- 172.21.15.88:0/1353557650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe7006e700 0x7fbe70156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.575+0000 7fbe6e7fc640 1 -- 172.21.15.88:0/1353557650 >> v1:172.21.15.88:6789/0 conn(0x7fbe7014c1d0 legacy=0x7fbe700b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.576+0000 7fbe6e7fc640 1 -- 172.21.15.88:0/1353557650 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7006d1b0 con 0x7fbe7006fc00 2024-01-22T10:13:20.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.576+0000 7fbe6f7fe640 1 --2- 172.21.15.88:0/1353557650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe7006e700 0x7fbe70156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:20.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.576+0000 7fbe6e7fc640 1 --2- 172.21.15.88:0/1353557650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7006fc00 0x7fbe7006f0f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbe7006cf20 tx=0x7fbe6402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346ac3d349128eb4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:20.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.576+0000 7fbe6dffb640 1 -- 172.21.15.88:0/1353557650 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64031800 con 0x7fbe7006fc00 2024-01-22T10:13:20.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.576+0000 7fbe6dffb640 1 -- 172.21.15.88:0/1353557650 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe64031960 con 0x7fbe7006fc00 2024-01-22T10:13:20.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.576+0000 7fbe6dffb640 1 -- 172.21.15.88:0/1353557650 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64031cf0 con 0x7fbe7006fc00 2024-01-22T10:13:20.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.577+0000 7fbe752b4640 1 -- 172.21.15.88:0/1353557650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7006fc00 msgr2=0x7fbe7006f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.577+0000 7fbe752b4640 1 --2- 172.21.15.88:0/1353557650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7006fc00 0x7fbe7006f0f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbe7006cf20 tx=0x7fbe6402b8a0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.577+0000 7fbe752b4640 1 -- 172.21.15.88:0/1353557650 shutdown_connections 2024-01-22T10:13:20.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.577+0000 7fbe752b4640 1 --2- 172.21.15.88:0/1353557650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe7006e700 0x7fbe70156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.577+0000 7fbe752b4640 1 --2- 172.21.15.88:0/1353557650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7006fc00 0x7fbe7006f0f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.577+0000 7fbe752b4640 1 -- 172.21.15.88:0/1353557650 >> 172.21.15.88:0/1353557650 conn(0x7fbe700bb780 msgr2=0x7fbe700bbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:20.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.577+0000 7fbe752b4640 1 -- 172.21.15.88:0/1353557650 shutdown_connections 2024-01-22T10:13:20.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.577+0000 7fbe752b4640 1 -- 172.21.15.88:0/1353557650 wait complete. 2024-01-22T10:13:20.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.578+0000 7fbe752b4640 1 Processor -- start 2024-01-22T10:13:20.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.578+0000 7fbe752b4640 1 -- start start 2024-01-22T10:13:20.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe752b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe7006e700 0x7fbe701495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe752b4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe7006fc00 0x7fbe700b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe752b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7014c1d0 0x7fbe700b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe752b4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700bcae0 con 0x7fbe7014c1d0 2024-01-22T10:13:20.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe752b4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700b68b0 con 0x7fbe7006e700 2024-01-22T10:13:20.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe752b4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7013b0b0 con 0x7fbe7006fc00 2024-01-22T10:13:20.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe6f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7014c1d0 0x7fbe700b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe6f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7014c1d0 0x7fbe700b79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36036/0 (socket says 172.21.15.88:36036) 2024-01-22T10:13:20.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe6f7fe640 1 -- 172.21.15.88:0/1464044390 learned_addr learned my addr 172.21.15.88:0/1464044390 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe6f7fe640 1 -- 172.21.15.88:0/1464044390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe7006fc00 msgr2=0x7fbe700b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe6f7fe640 1 --2- 172.21.15.88:0/1464044390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe7006fc00 0x7fbe700b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe6f7fe640 1 -- 172.21.15.88:0/1464044390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe7006e700 msgr2=0x7fbe701495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe6f7fe640 1 --2- 172.21.15.88:0/1464044390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe7006e700 0x7fbe701495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe6f7fe640 1 -- 172.21.15.88:0/1464044390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe64009400 con 0x7fbe7014c1d0 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe6f7fe640 1 --2- 172.21.15.88:0/1464044390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7014c1d0 0x7fbe700b79b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800c7f0 tx=0x7fbe6800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe577fe640 1 -- 172.21.15.88:0/1464044390 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68007820 con 0x7fbe7014c1d0 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe577fe640 1 -- 172.21.15.88:0/1464044390 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe68007980 con 0x7fbe7014c1d0 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe752b4640 1 -- 172.21.15.88:0/1464044390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe700b84f0 con 0x7fbe7014c1d0 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe577fe640 1 -- 172.21.15.88:0/1464044390 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68007d30 con 0x7fbe7014c1d0 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.579+0000 7fbe752b4640 1 -- 172.21.15.88:0/1464044390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7013c700 con 0x7fbe7014c1d0 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.581+0000 7fbe752b4640 1 -- 172.21.15.88:0/1464044390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe700bb2d0 con 0x7fbe7014c1d0 2024-01-22T10:13:20.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.581+0000 7fbe577fe640 1 -- 172.21.15.88:0/1464044390 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fbe680113f0 con 0x7fbe7014c1d0 2024-01-22T10:13:20.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.581+0000 7fbe577fe640 1 --2- 172.21.15.88:0/1464044390 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbe5c06b330 0x7fbe5c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.581+0000 7fbe577fe640 1 -- 172.21.15.88:0/1464044390 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe68089fd0 con 0x7fbe7014c1d0 2024-01-22T10:13:20.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.581+0000 7fbe6effd640 1 --2- 172.21.15.88:0/1464044390 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbe5c06b330 0x7fbe5c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.581+0000 7fbe6effd640 1 --2- 172.21.15.88:0/1464044390 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbe5c06b330 0x7fbe5c06d7f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbe600012e0 tx=0x7fbe600015b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:20.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.585+0000 7fbe577fe640 1 -- 172.21.15.88:0/1464044390 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fbe68054c60 con 0x7fbe7014c1d0 2024-01-22T10:13:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.755+0000 7fbe752b4640 1 -- 172.21.15.88:0/1464044390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe7006c5a0 con 0x7fbe7014c1d0 2024-01-22T10:13:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.756+0000 7fbe577fe640 1 -- 172.21.15.88:0/1464044390 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe68058280 con 0x7fbe7014c1d0 2024-01-22T10:13:20.738 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-01-22T10:13:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.758+0000 7fbe752b4640 1 -- 172.21.15.88:0/1464044390 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbe5c06b330 msgr2=0x7fbe5c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.758+0000 7fbe752b4640 1 --2- 172.21.15.88:0/1464044390 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbe5c06b330 0x7fbe5c06d7f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbe600012e0 tx=0x7fbe600015b0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.758+0000 7fbe752b4640 1 -- 172.21.15.88:0/1464044390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7014c1d0 msgr2=0x7fbe700b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.758+0000 7fbe752b4640 1 --2- 172.21.15.88:0/1464044390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7014c1d0 0x7fbe700b79b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800c7f0 tx=0x7fbe6800ccb0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.758+0000 7fbe752b4640 1 -- 172.21.15.88:0/1464044390 shutdown_connections 2024-01-22T10:13:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.758+0000 7fbe752b4640 1 --2- 172.21.15.88:0/1464044390 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbe5c06b330 0x7fbe5c06d7f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.758+0000 7fbe752b4640 1 --2- 172.21.15.88:0/1464044390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe7006fc00 0x7fbe700b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.758+0000 7fbe752b4640 1 --2- 172.21.15.88:0/1464044390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7014c1d0 0x7fbe700b79b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.758+0000 7fbe752b4640 1 --2- 172.21.15.88:0/1464044390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe7006e700 0x7fbe701495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.758+0000 7fbe752b4640 1 -- 172.21.15.88:0/1464044390 >> 172.21.15.88:0/1464044390 conn(0x7fbe700bb780 msgr2=0x7fbe700bbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:20.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.758+0000 7fbe752b4640 1 -- 172.21.15.88:0/1464044390 shutdown_connections 2024-01-22T10:13:20.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.758+0000 7fbe752b4640 1 -- 172.21.15.88:0/1464044390 wait complete. 2024-01-22T10:13:20.752 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.868+0000 7f33440cf640 1 Processor -- start 2024-01-22T10:13:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.868+0000 7f33440cf640 1 -- start start 2024-01-22T10:13:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f33440cf640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f333c148c30 0x7f333c149080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f33440cf640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f333c154000 0x7f333c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f33440cf640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c0bb800 con 0x7f333c0bdee0 2024-01-22T10:13:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f33440cf640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c0bbb50 con 0x7f333c154000 2024-01-22T10:13:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f33440cf640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c0bc520 con 0x7f333c148c30 2024-01-22T10:13:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f334266c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f333c154000 0x7f333c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f334266c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f333c154000 0x7f333c1563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36048/0 (socket says 172.21.15.88:36048) 2024-01-22T10:13:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f334266c640 1 -- 172.21.15.88:0/198260071 learned_addr learned my addr 172.21.15.88:0/198260071 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f334166a640 1 --2- 172.21.15.88:0/198260071 >> v2:172.21.15.119:3300/0 conn(0x7f333c148c30 0x7f333c149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f334266c640 1 -- 172.21.15.88:0/198260071 >> v2:172.21.15.119:3300/0 conn(0x7f333c148c30 msgr2=0x7f333c149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:20.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f334266c640 1 --2- 172.21.15.88:0/198260071 >> v2:172.21.15.119:3300/0 conn(0x7f333c148c30 0x7f333c149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f334266c640 1 -- 172.21.15.88:0/198260071 >> v1:172.21.15.119:6789/0 conn(0x7f333c0bdee0 legacy=0x7f333c14b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:20.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.869+0000 7f334266c640 1 -- 172.21.15.88:0/198260071 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c0bf820 con 0x7f333c154000 2024-01-22T10:13:20.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.870+0000 7f334266c640 1 --2- 172.21.15.88:0/198260071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f333c154000 0x7f333c1563f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f333c0befc0 tx=0x7f333402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51111752ade14f19 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:20.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.870+0000 7f3340e69640 1 -- 172.21.15.88:0/198260071 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333402ca80 con 0x7f333c154000 2024-01-22T10:13:20.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.870+0000 7f3340e69640 1 -- 172.21.15.88:0/198260071 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333402cbe0 con 0x7f333c154000 2024-01-22T10:13:20.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.870+0000 7f3340e69640 1 -- 172.21.15.88:0/198260071 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340343f0 con 0x7f333c154000 2024-01-22T10:13:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.871+0000 7f33440cf640 1 -- 172.21.15.88:0/198260071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f333c154000 msgr2=0x7f333c1563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.871+0000 7f33440cf640 1 --2- 172.21.15.88:0/198260071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f333c154000 0x7f333c1563f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f333c0befc0 tx=0x7f333402bee0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.871+0000 7f33440cf640 1 -- 172.21.15.88:0/198260071 shutdown_connections 2024-01-22T10:13:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.871+0000 7f33440cf640 1 --2- 172.21.15.88:0/198260071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f333c154000 0x7f333c1563f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.871+0000 7f33440cf640 1 --2- 172.21.15.88:0/198260071 >> v2:172.21.15.119:3300/0 conn(0x7f333c148c30 0x7f333c149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.871+0000 7f33440cf640 1 -- 172.21.15.88:0/198260071 >> 172.21.15.88:0/198260071 conn(0x7f333c0a2d80 msgr2=0x7f333c0a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.871+0000 7f33440cf640 1 -- 172.21.15.88:0/198260071 shutdown_connections 2024-01-22T10:13:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.871+0000 7f33440cf640 1 -- 172.21.15.88:0/198260071 wait complete. 2024-01-22T10:13:20.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.872+0000 7f33440cf640 1 Processor -- start 2024-01-22T10:13:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.872+0000 7f33440cf640 1 -- start start 2024-01-22T10:13:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.872+0000 7f33440cf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f333c0bdee0 0x7f333c0a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.872+0000 7f33440cf640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f333c148c30 0x7f333c143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.872+0000 7f33440cf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f333c154000 0x7f333c0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.872+0000 7f33440cf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0b2dc0 con 0x7f333c154000 2024-01-22T10:13:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.872+0000 7f33440cf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c144d30 con 0x7f333c0bdee0 2024-01-22T10:13:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.872+0000 7f33440cf640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c145010 con 0x7f333c148c30 2024-01-22T10:13:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f334266c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f333c154000 0x7f333c0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f334266c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f333c154000 0x7f333c0b1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36064/0 (socket says 172.21.15.88:36064) 2024-01-22T10:13:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f334266c640 1 -- 172.21.15.88:0/2727974128 learned_addr learned my addr 172.21.15.88:0/2727974128 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f3341e6b640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f333c0bdee0 0x7f333c0a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f334166a640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f333c148c30 0x7f333c143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f334266c640 1 -- 172.21.15.88:0/2727974128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f333c148c30 msgr2=0x7f333c143e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f334266c640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f333c148c30 0x7f333c143e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f334266c640 1 -- 172.21.15.88:0/2727974128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f333c0bdee0 msgr2=0x7f333c0a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f334266c640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f333c0bdee0 0x7f333c0a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f334266c640 1 -- 172.21.15.88:0/2727974128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3334009b30 con 0x7f333c154000 2024-01-22T10:13:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f334166a640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f333c148c30 0x7f333c143e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f3341e6b640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f333c0bdee0 0x7f333c0a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f334266c640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f333c154000 0x7f333c0b1f40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3334036040 tx=0x7f3334004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f33327fc640 1 -- 172.21.15.88:0/2727974128 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334009510 con 0x7f333c154000 2024-01-22T10:13:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f33327fc640 1 -- 172.21.15.88:0/2727974128 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333403e450 con 0x7f333c154000 2024-01-22T10:13:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f33327fc640 1 -- 172.21.15.88:0/2727974128 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333403e800 con 0x7f333c154000 2024-01-22T10:13:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f33440cf640 1 -- 172.21.15.88:0/2727974128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333c144370 con 0x7f333c154000 2024-01-22T10:13:20.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.873+0000 7f33440cf640 1 -- 172.21.15.88:0/2727974128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c0b2660 con 0x7f333c154000 2024-01-22T10:13:20.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.874+0000 7f33440cf640 1 -- 172.21.15.88:0/2727974128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333c04ea30 con 0x7f333c154000 2024-01-22T10:13:20.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.875+0000 7f33327fc640 1 -- 172.21.15.88:0/2727974128 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f333402cd50 con 0x7f333c154000 2024-01-22T10:13:20.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.875+0000 7f33327fc640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f332006b330 0x7f332006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:20.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.875+0000 7f33327fc640 1 -- 172.21.15.88:0/2727974128 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33340ac6d0 con 0x7f333c154000 2024-01-22T10:13:20.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.875+0000 7f3341e6b640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f332006b330 0x7f332006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:20.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.875+0000 7f3341e6b640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f332006b330 0x7f332006d7f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3338001680 tx=0x7f3338009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:20.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:20.879+0000 7f33327fc640 1 -- 172.21.15.88:0/2727974128 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f33340773f0 con 0x7f333c154000 2024-01-22T10:13:21.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.048+0000 7f33440cf640 1 -- 172.21.15.88:0/2727974128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f333c0bff70 con 0x7f333c154000 2024-01-22T10:13:21.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.049+0000 7f33327fc640 1 -- 172.21.15.88:0/2727974128 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f333407aa10 con 0x7f333c154000 2024-01-22T10:13:21.032 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:21.032 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:21.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.051+0000 7f33440cf640 1 -- 172.21.15.88:0/2727974128 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f332006b330 msgr2=0x7f332006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.051+0000 7f33440cf640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f332006b330 0x7f332006d7f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3338001680 tx=0x7f3338009040 comp rx=0 tx=0).stop 2024-01-22T10:13:21.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.051+0000 7f33440cf640 1 -- 172.21.15.88:0/2727974128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f333c154000 msgr2=0x7f333c0b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.051+0000 7f33440cf640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f333c154000 0x7f333c0b1f40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3334036040 tx=0x7f3334004a40 comp rx=0 tx=0).stop 2024-01-22T10:13:21.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.051+0000 7f33440cf640 1 -- 172.21.15.88:0/2727974128 shutdown_connections 2024-01-22T10:13:21.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.051+0000 7f33440cf640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f332006b330 0x7f332006d7f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.051+0000 7f33440cf640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f333c148c30 0x7f333c143e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.051+0000 7f33440cf640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f333c154000 0x7f333c0b1f40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.051+0000 7f33440cf640 1 --2- 172.21.15.88:0/2727974128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f333c0bdee0 0x7f333c0a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.051+0000 7f33440cf640 1 -- 172.21.15.88:0/2727974128 >> 172.21.15.88:0/2727974128 conn(0x7f333c0a2d80 msgr2=0x7f333c0a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:21.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.051+0000 7f33440cf640 1 -- 172.21.15.88:0/2727974128 shutdown_connections 2024-01-22T10:13:21.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.051+0000 7f33440cf640 1 -- 172.21.15.88:0/2727974128 wait complete. 2024-01-22T10:13:21.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T10:13:00.844842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T10:13:01.816849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:13:21.045 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:13:21.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.165+0000 7f765abd5640 1 Processor -- start 2024-01-22T10:13:21.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.165+0000 7f765abd5640 1 -- start start 2024-01-22T10:13:21.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f765abd5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f765406d2c0 0x7f765414b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f765abd5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76540b1f20 0x7f76540b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f765abd5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76540b96f0 con 0x7f76540b8ea0 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f765abd5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765406d6a0 con 0x7f76540b1f20 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f765abd5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7654072690 con 0x7f765406d2c0 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f7659172640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76540b1f20 0x7f76540b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f7653fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f76540b8ea0 0x7f7654145690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58484/0 (socket says 172.21.15.88:58484) 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f7653fff640 1 -- 172.21.15.88:0/1642029603 learned_addr learned my addr 172.21.15.88:0/1642029603 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f7658971640 1 --2- 172.21.15.88:0/1642029603 >> v2:172.21.15.119:3300/0 conn(0x7f765406d2c0 0x7f765414b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f7659172640 1 -- 172.21.15.88:0/1642029603 >> v2:172.21.15.119:3300/0 conn(0x7f765406d2c0 msgr2=0x7f765414b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f7659172640 1 --2- 172.21.15.88:0/1642029603 >> v2:172.21.15.119:3300/0 conn(0x7f765406d2c0 0x7f765414b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f7659172640 1 -- 172.21.15.88:0/1642029603 >> v1:172.21.15.88:6789/0 conn(0x7f76540b8ea0 legacy=0x7f7654145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f7659172640 1 -- 172.21.15.88:0/1642029603 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76540b9410 con 0x7f76540b1f20 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f76537fe640 1 -- 172.21.15.88:0/1642029603 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342025195 0 0) 0x7f76540b96f0 con 0x7f76540b8ea0 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.166+0000 7f7658971640 1 --2- 172.21.15.88:0/1642029603 >> v2:172.21.15.119:3300/0 conn(0x7f765406d2c0 0x7f765414b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.167+0000 7f7659172640 1 --2- 172.21.15.88:0/1642029603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76540b1f20 0x7f76540b2f60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f765406f3b0 tx=0x7f764c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc5d4854cf39482 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:21.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.167+0000 7f76537fe640 1 -- 172.21.15.88:0/1642029603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c02cc80 con 0x7f76540b1f20 2024-01-22T10:13:21.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.167+0000 7f76537fe640 1 -- 172.21.15.88:0/1642029603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c02cde0 con 0x7f76540b1f20 2024-01-22T10:13:21.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.167+0000 7f76537fe640 1 -- 172.21.15.88:0/1642029603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c034660 con 0x7f76540b1f20 2024-01-22T10:13:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.167+0000 7f765abd5640 1 -- 172.21.15.88:0/1642029603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76540b1f20 msgr2=0x7f76540b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.167+0000 7f765abd5640 1 --2- 172.21.15.88:0/1642029603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76540b1f20 0x7f76540b2f60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f765406f3b0 tx=0x7f764c02bed0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.167+0000 7f765abd5640 1 -- 172.21.15.88:0/1642029603 shutdown_connections 2024-01-22T10:13:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.167+0000 7f765abd5640 1 --2- 172.21.15.88:0/1642029603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76540b1f20 0x7f76540b2f60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.167+0000 7f765abd5640 1 --2- 172.21.15.88:0/1642029603 >> v2:172.21.15.119:3300/0 conn(0x7f765406d2c0 0x7f765414b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.167+0000 7f765abd5640 1 -- 172.21.15.88:0/1642029603 >> 172.21.15.88:0/1642029603 conn(0x7f76540bcf40 msgr2=0x7f76540bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.167+0000 7f765abd5640 1 -- 172.21.15.88:0/1642029603 shutdown_connections 2024-01-22T10:13:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.167+0000 7f765abd5640 1 -- 172.21.15.88:0/1642029603 wait complete. 2024-01-22T10:13:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.168+0000 7f765abd5640 1 Processor -- start 2024-01-22T10:13:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.168+0000 7f765abd5640 1 -- start start 2024-01-22T10:13:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.169+0000 7f765abd5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f765406d2c0 0x7f7654140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.169+0000 7f765abd5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76540b1f20 0x7f765413d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.169+0000 7f765abd5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76540b8ea0 0x7f765413a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.169+0000 7f765abd5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765413e750 con 0x7f76540b8ea0 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.169+0000 7f765abd5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7654140ac0 con 0x7f76540b1f20 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.169+0000 7f765abd5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7654141590 con 0x7f765406d2c0 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.169+0000 7f7659172640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76540b8ea0 0x7f765413a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.169+0000 7f7659172640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76540b8ea0 0x7f765413a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36086/0 (socket says 172.21.15.88:36086) 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.169+0000 7f7659172640 1 -- 172.21.15.88:0/1396128492 learned_addr learned my addr 172.21.15.88:0/1396128492 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.170+0000 7f7659172640 1 -- 172.21.15.88:0/1396128492 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f765406d2c0 msgr2=0x7f7654140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.170+0000 7f7659172640 1 --2- 172.21.15.88:0/1396128492 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f765406d2c0 0x7f7654140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.170+0000 7f7659172640 1 -- 172.21.15.88:0/1396128492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76540b1f20 msgr2=0x7f765413d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.170+0000 7f7659172640 1 --2- 172.21.15.88:0/1396128492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76540b1f20 0x7f765413d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.170+0000 7f7659172640 1 -- 172.21.15.88:0/1396128492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c009a70 con 0x7f76540b8ea0 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.170+0000 7f7659172640 1 --2- 172.21.15.88:0/1396128492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76540b8ea0 0x7f765413a220 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f764c037040 tx=0x7f764c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:21.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.170+0000 7f76517fa640 1 -- 172.21.15.88:0/1396128492 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c003b90 con 0x7f76540b8ea0 2024-01-22T10:13:21.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.170+0000 7f76517fa640 1 -- 172.21.15.88:0/1396128492 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c003cf0 con 0x7f76540b8ea0 2024-01-22T10:13:21.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.170+0000 7f765abd5640 1 -- 172.21.15.88:0/1396128492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7654141870 con 0x7f76540b8ea0 2024-01-22T10:13:21.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.170+0000 7f76517fa640 1 -- 172.21.15.88:0/1396128492 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c004230 con 0x7f76540b8ea0 2024-01-22T10:13:21.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.170+0000 7f765abd5640 1 -- 172.21.15.88:0/1396128492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765413ded0 con 0x7f76540b8ea0 2024-01-22T10:13:21.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.171+0000 7f765abd5640 1 -- 172.21.15.88:0/1396128492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765404ea30 con 0x7f76540b8ea0 2024-01-22T10:13:21.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.171+0000 7f76517fa640 1 -- 172.21.15.88:0/1396128492 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f764c004390 con 0x7f76540b8ea0 2024-01-22T10:13:21.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.172+0000 7f76517fa640 1 --2- 172.21.15.88:0/1396128492 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f763806b330 0x7f763806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.172+0000 7f76517fa640 1 -- 172.21.15.88:0/1396128492 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f764c0ac7e0 con 0x7f76540b8ea0 2024-01-22T10:13:21.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.172+0000 7f7658971640 1 --2- 172.21.15.88:0/1396128492 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f763806b330 0x7f763806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.172+0000 7f7658971640 1 --2- 172.21.15.88:0/1396128492 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f763806b330 0x7f763806d7f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7648006fd0 tx=0x7f7648008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:21.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.176+0000 7f76517fa640 1 -- 172.21.15.88:0/1396128492 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f764c077500 con 0x7f76540b8ea0 2024-01-22T10:13:21.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.343+0000 7f765abd5640 1 -- 172.21.15.88:0/1396128492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f765413e890 con 0x7f76540b8ea0 2024-01-22T10:13:21.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.343+0000 7f76517fa640 1 -- 172.21.15.88:0/1396128492 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f764c07ab20 con 0x7f76540b8ea0 2024-01-22T10:13:21.326 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:13:21.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.345+0000 7f765abd5640 1 -- 172.21.15.88:0/1396128492 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f763806b330 msgr2=0x7f763806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.345+0000 7f765abd5640 1 --2- 172.21.15.88:0/1396128492 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f763806b330 0x7f763806d7f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7648006fd0 tx=0x7f7648008040 comp rx=0 tx=0).stop 2024-01-22T10:13:21.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.345+0000 7f765abd5640 1 -- 172.21.15.88:0/1396128492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76540b8ea0 msgr2=0x7f765413a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.345+0000 7f765abd5640 1 --2- 172.21.15.88:0/1396128492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76540b8ea0 0x7f765413a220 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f764c037040 tx=0x7f764c004a40 comp rx=0 tx=0).stop 2024-01-22T10:13:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.346+0000 7f765abd5640 1 -- 172.21.15.88:0/1396128492 shutdown_connections 2024-01-22T10:13:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.346+0000 7f765abd5640 1 --2- 172.21.15.88:0/1396128492 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f763806b330 0x7f763806d7f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.346+0000 7f765abd5640 1 --2- 172.21.15.88:0/1396128492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76540b8ea0 0x7f765413a220 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.346+0000 7f765abd5640 1 --2- 172.21.15.88:0/1396128492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76540b1f20 0x7f765413d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.346+0000 7f765abd5640 1 --2- 172.21.15.88:0/1396128492 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f765406d2c0 0x7f7654140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.346+0000 7f765abd5640 1 -- 172.21.15.88:0/1396128492 >> 172.21.15.88:0/1396128492 conn(0x7f76540bcf40 msgr2=0x7f765414b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.346+0000 7f765abd5640 1 -- 172.21.15.88:0/1396128492 shutdown_connections 2024-01-22T10:13:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.346+0000 7f765abd5640 1 -- 172.21.15.88:0/1396128492 wait complete. 2024-01-22T10:13:21.338 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T10:13:21.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.457+0000 7f5ad3a9b640 1 Processor -- start 2024-01-22T10:13:21.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.457+0000 7f5ad3a9b640 1 -- start start 2024-01-22T10:13:21.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.458+0000 7f5ad3a9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5acc0be5a0 0x7f5acc071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.458+0000 7f5ad3a9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5acc148a90 0x7f5acc0b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.458+0000 7f5ad3a9b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5acc0b7930 con 0x7f5acc0b6f90 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.458+0000 7f5ad3a9b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5acc14bc70 con 0x7f5acc148a90 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.458+0000 7f5ad3a9b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc14bf50 con 0x7f5acc0be5a0 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.458+0000 7f5ad1036640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5acc0b6f90 0x7f5acc148380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58486/0 (socket says 172.21.15.88:58486) 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.458+0000 7f5ad1036640 1 -- 172.21.15.88:0/1935481165 learned_addr learned my addr 172.21.15.88:0/1935481165 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.458+0000 7f5ad1837640 1 --2- 172.21.15.88:0/1935481165 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5acc0be5a0 0x7f5acc071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.458+0000 7f5ad2038640 1 --2- 172.21.15.88:0/1935481165 >> v2:172.21.15.119:3300/0 conn(0x7f5acc148a90 0x7f5acc0b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.458+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604626372 0 0) 0x7f5acc0b7930 con 0x7f5acc0b6f90 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.458+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ab8003520 con 0x7f5acc0b6f90 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2243594453 0 0) 0x7f5ab8003520 con 0x7f5acc0b6f90 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5acc0be5a0 msgr2=0x7f5acc071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 --2- 172.21.15.88:0/1935481165 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5acc0be5a0 0x7f5acc071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 >> v2:172.21.15.119:3300/0 conn(0x7f5acc148a90 msgr2=0x7f5acc0b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 --2- 172.21.15.88:0/1935481165 >> v2:172.21.15.119:3300/0 conn(0x7f5acc148a90 0x7f5acc0b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc14c230 con 0x7f5acc0b6f90 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f5abc001670 con 0x7f5acc0b6f90 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad2038640 1 --2- 172.21.15.88:0/1935481165 >> v2:172.21.15.119:3300/0 conn(0x7f5acc148a90 0x7f5acc0b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 >> v1:172.21.15.88:6789/0 conn(0x7f5acc0b6f90 legacy=0x7f5acc148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 --2- 172.21.15.88:0/1935481165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab8003a50 0x7f5ab8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 --2- 172.21.15.88:0/1935481165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ab80047c0 0x7f5ab8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 --2- 172.21.15.88:0/1935481165 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5acc0be5a0 0x7f5ab8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc14bc70 con 0x7f5ab80047c0 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc14bf50 con 0x7f5ab8003a50 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab800b9b0 con 0x7f5acc0be5a0 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad1036640 1 --2- 172.21.15.88:0/1935481165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ab80047c0 0x7f5ab8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad1837640 1 --2- 172.21.15.88:0/1935481165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab8003a50 0x7f5ab8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad2038640 1 --2- 172.21.15.88:0/1935481165 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5acc0be5a0 0x7f5ab8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad1036640 1 -- 172.21.15.88:0/1935481165 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5acc0be5a0 msgr2=0x7f5ab8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad1036640 1 --2- 172.21.15.88:0/1935481165 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5acc0be5a0 0x7f5ab8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad1036640 1 -- 172.21.15.88:0/1935481165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab8003a50 msgr2=0x7f5ab8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad1036640 1 --2- 172.21.15.88:0/1935481165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab8003a50 0x7f5ab8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.459+0000 7f5ad1036640 1 -- 172.21.15.88:0/1935481165 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8003520 con 0x7f5ab80047c0 2024-01-22T10:13:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.460+0000 7f5ad1036640 1 --2- 172.21.15.88:0/1935481165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ab80047c0 0x7f5ab8004c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00c240 tx=0x7f5ab80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf69dafc1faba616 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.460+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc02cb00 con 0x7f5ab80047c0 2024-01-22T10:13:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.460+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc02cc60 con 0x7f5ab80047c0 2024-01-22T10:13:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.460+0000 7f5ad0835640 1 -- 172.21.15.88:0/1935481165 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc005b10 con 0x7f5ab80047c0 2024-01-22T10:13:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.460+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/1935481165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ab80047c0 msgr2=0x7f5ab8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.460+0000 7f5ad3a9b640 1 --2- 172.21.15.88:0/1935481165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ab80047c0 0x7f5ab8004c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00c240 tx=0x7f5ab80057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.460+0000 7f5ad2038640 1 -- 172.21.15.88:0/1935481165 reap_dead start 2024-01-22T10:13:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.461+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/1935481165 shutdown_connections 2024-01-22T10:13:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.461+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/1935481165 >> 172.21.15.88:0/1935481165 conn(0x7f5acc06be30 msgr2=0x7f5acc0bdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.461+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/1935481165 shutdown_connections 2024-01-22T10:13:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.461+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/1935481165 wait complete. 2024-01-22T10:13:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.462+0000 7f5ad3a9b640 1 Processor -- start 2024-01-22T10:13:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.462+0000 7f5ad3a9b640 1 -- start start 2024-01-22T10:13:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.462+0000 7f5ad3a9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ab80047c0 0x7f5acc148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.462+0000 7f5ad3a9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5acc1e0be0 0x7f5acc0adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.462+0000 7f5ad3a9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5acc1e1040 0x7f5acc1da740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.462+0000 7f5ad3a9b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc148660 con 0x7f5acc1e1040 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.462+0000 7f5ad3a9b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0acda0 con 0x7f5acc1e0be0 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.462+0000 7f5ad3a9b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc146e00 con 0x7f5ab80047c0 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.462+0000 7f5ad2038640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5acc1e1040 0x7f5acc1da740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.462+0000 7f5ad2038640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5acc1e1040 0x7f5acc1da740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36108/0 (socket says 172.21.15.88:36108) 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.462+0000 7f5ad2038640 1 -- 172.21.15.88:0/2174680455 learned_addr learned my addr 172.21.15.88:0/2174680455 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ad1837640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ab80047c0 0x7f5acc148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ad1036640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5acc1e0be0 0x7f5acc0adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ad2038640 1 -- 172.21.15.88:0/2174680455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ab80047c0 msgr2=0x7f5acc148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ad2038640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ab80047c0 0x7f5acc148120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ad2038640 1 -- 172.21.15.88:0/2174680455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5acc1e0be0 msgr2=0x7f5acc0adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ad2038640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5acc1e0be0 0x7f5acc0adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ad2038640 1 -- 172.21.15.88:0/2174680455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc0acff0 con 0x7f5acc1e1040 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ad1036640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5acc1e0be0 0x7f5acc0adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ad1837640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ab80047c0 0x7f5acc148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:21.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ad2038640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5acc1e1040 0x7f5acc1da740 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5acc148e70 tx=0x7f5ac4011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:21.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ac27fc640 1 -- 172.21.15.88:0/2174680455 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac400faa0 con 0x7f5acc1e1040 2024-01-22T10:13:21.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ac27fc640 1 -- 172.21.15.88:0/2174680455 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac400fc00 con 0x7f5acc1e1040 2024-01-22T10:13:21.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/2174680455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc0ad2d0 con 0x7f5acc1e1040 2024-01-22T10:13:21.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ac27fc640 1 -- 172.21.15.88:0/2174680455 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4004020 con 0x7f5acc1e1040 2024-01-22T10:13:21.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.463+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/2174680455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5acc1478f0 con 0x7f5acc1e1040 2024-01-22T10:13:21.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.464+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/2174680455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5acc0ad4c0 con 0x7f5acc1e1040 2024-01-22T10:13:21.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.464+0000 7f5ac27fc640 1 -- 172.21.15.88:0/2174680455 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f5ac4004180 con 0x7f5acc1e1040 2024-01-22T10:13:21.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.465+0000 7f5ac27fc640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5ab006b330 0x7f5ab006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.465+0000 7f5ad1837640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5ab006b330 0x7f5ab006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.465+0000 7f5ac27fc640 1 -- 172.21.15.88:0/2174680455 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ac4089d30 con 0x7f5acc1e1040 2024-01-22T10:13:21.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.465+0000 7f5ad1837640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5ab006b330 0x7f5ab006d7f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009f60 tx=0x7f5ac800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.469+0000 7f5ac27fc640 1 -- 172.21.15.88:0/2174680455 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5ac4054a50 con 0x7f5acc1e1040 2024-01-22T10:13:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.636+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/2174680455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5acc0ba3c0 con 0x7f5acc1e1040 2024-01-22T10:13:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.637+0000 7f5ac27fc640 1 -- 172.21.15.88:0/2174680455 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ac4019020 con 0x7f5acc1e1040 2024-01-22T10:13:21.620 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-01-22T10:13:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.639+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/2174680455 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5ab006b330 msgr2=0x7f5ab006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.639+0000 7f5ad3a9b640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5ab006b330 0x7f5ab006d7f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009f60 tx=0x7f5ac800b040 comp rx=0 tx=0).stop 2024-01-22T10:13:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.639+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/2174680455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5acc1e1040 msgr2=0x7f5acc1da740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.639+0000 7f5ad3a9b640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5acc1e1040 0x7f5acc1da740 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5acc148e70 tx=0x7f5ac4011e30 comp rx=0 tx=0).stop 2024-01-22T10:13:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.639+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/2174680455 shutdown_connections 2024-01-22T10:13:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.639+0000 7f5ad3a9b640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f5ab006b330 0x7f5ab006d7f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.639+0000 7f5ad3a9b640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5acc1e1040 0x7f5acc1da740 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.639+0000 7f5ad3a9b640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5acc1e0be0 0x7f5acc0adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.639+0000 7f5ad3a9b640 1 --2- 172.21.15.88:0/2174680455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ab80047c0 0x7f5acc148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.639+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/2174680455 >> 172.21.15.88:0/2174680455 conn(0x7f5acc06be30 msgr2=0x7f5acc0703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.639+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/2174680455 shutdown_connections 2024-01-22T10:13:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.639+0000 7f5ad3a9b640 1 -- 172.21.15.88:0/2174680455 wait complete. 2024-01-22T10:13:21.632 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T10:13:21.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.753+0000 7f35f9b68640 1 Processor -- start 2024-01-22T10:13:21.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.753+0000 7f35f9b68640 1 -- start start 2024-01-22T10:13:21.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.753+0000 7f35f9b68640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35f40ba8e0 0x7f35f40bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.753+0000 7f35f9b68640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f35f414b7f0 0x7f35f406aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.753+0000 7f35f9b68640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f40b47c0 con 0x7f35f414ed40 2024-01-22T10:13:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.753+0000 7f35f9b68640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f40bacc0 con 0x7f35f414b7f0 2024-01-22T10:13:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.753+0000 7f35f9b68640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40bb240 con 0x7f35f40ba8e0 2024-01-22T10:13:21.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.753+0000 7f35f3fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f35f414ed40 0x7f35f414f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58494/0 (socket says 172.21.15.88:58494) 2024-01-22T10:13:21.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.753+0000 7f35f3fff640 1 -- 172.21.15.88:0/4262223352 learned_addr learned my addr 172.21.15.88:0/4262223352 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:21.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.753+0000 7f35f37fe640 1 --2- 172.21.15.88:0/4262223352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35f40ba8e0 0x7f35f40bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.753+0000 7f35f2ffd640 1 --2- 172.21.15.88:0/4262223352 >> v2:172.21.15.119:3300/0 conn(0x7f35f414b7f0 0x7f35f406aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.754+0000 7f35f27fc640 1 -- 172.21.15.88:0/4262223352 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948269461 0 0) 0x7f35f40b47c0 con 0x7f35f414ed40 2024-01-22T10:13:21.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.754+0000 7f35f27fc640 1 -- 172.21.15.88:0/4262223352 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e0003520 con 0x7f35f414ed40 2024-01-22T10:13:21.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.754+0000 7f35f27fc640 1 -- 172.21.15.88:0/4262223352 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3032552275 0 0) 0x7f35e0003520 con 0x7f35f414ed40 2024-01-22T10:13:21.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.754+0000 7f35f2ffd640 1 -- 172.21.15.88:0/4262223352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35f40ba8e0 msgr2=0x7f35f40bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:21.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.754+0000 7f35f2ffd640 1 --2- 172.21.15.88:0/4262223352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35f40ba8e0 0x7f35f40bbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.754+0000 7f35f2ffd640 1 -- 172.21.15.88:0/4262223352 >> v1:172.21.15.88:6789/0 conn(0x7f35f414ed40 legacy=0x7f35f414f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.754+0000 7f35f2ffd640 1 -- 172.21.15.88:0/4262223352 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f40b4500 con 0x7f35f414b7f0 2024-01-22T10:13:21.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.754+0000 7f35f37fe640 1 --2- 172.21.15.88:0/4262223352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35f40ba8e0 0x7f35f40bbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:21.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.755+0000 7f35f2ffd640 1 --2- 172.21.15.88:0/4262223352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35f414b7f0 0x7f35f406aa30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f35e40097a0 tx=0x7f35e402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9d8a403748feeec server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:21.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.755+0000 7f35f27fc640 1 -- 172.21.15.88:0/4262223352 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec0019f0 con 0x7f35f414b7f0 2024-01-22T10:13:21.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.755+0000 7f35f27fc640 1 -- 172.21.15.88:0/4262223352 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e402e050 con 0x7f35f414b7f0 2024-01-22T10:13:21.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.755+0000 7f35f27fc640 1 -- 172.21.15.88:0/4262223352 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4030710 con 0x7f35f414b7f0 2024-01-22T10:13:21.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.755+0000 7f35f9b68640 1 -- 172.21.15.88:0/4262223352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35f414b7f0 msgr2=0x7f35f406aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.755+0000 7f35f9b68640 1 --2- 172.21.15.88:0/4262223352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35f414b7f0 0x7f35f406aa30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f35e40097a0 tx=0x7f35e402b710 comp rx=0 tx=0).stop 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.755+0000 7f35f9b68640 1 -- 172.21.15.88:0/4262223352 shutdown_connections 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.755+0000 7f35f9b68640 1 --2- 172.21.15.88:0/4262223352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35f414b7f0 0x7f35f406aa30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.755+0000 7f35f9b68640 1 --2- 172.21.15.88:0/4262223352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35f40ba8e0 0x7f35f40bbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.755+0000 7f35f9b68640 1 -- 172.21.15.88:0/4262223352 >> 172.21.15.88:0/4262223352 conn(0x7f35f40c0e70 msgr2=0x7f35f40c1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.755+0000 7f35f9b68640 1 -- 172.21.15.88:0/4262223352 shutdown_connections 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.755+0000 7f35f9b68640 1 -- 172.21.15.88:0/4262223352 wait complete. 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.756+0000 7f35f9b68640 1 Processor -- start 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.757+0000 7f35f9b68640 1 -- start start 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.757+0000 7f35f9b68640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35f40ba8e0 0x7f35f41e1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.757+0000 7f35f9b68640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35f414b7f0 0x7f35f40a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.757+0000 7f35f9b68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35f414ed40 0x7f35f4147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.757+0000 7f35f9b68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40a4310 con 0x7f35f414ed40 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.757+0000 7f35f9b68640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40b6ed0 con 0x7f35f40ba8e0 2024-01-22T10:13:21.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.757+0000 7f35f9b68640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40b7170 con 0x7f35f414b7f0 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.757+0000 7f35f3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35f414ed40 0x7f35f4147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.757+0000 7f35f3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35f414ed40 0x7f35f4147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36112/0 (socket says 172.21.15.88:36112) 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.757+0000 7f35f3fff640 1 -- 172.21.15.88:0/2384376741 learned_addr learned my addr 172.21.15.88:0/2384376741 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.757+0000 7f35f37fe640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35f40ba8e0 0x7f35f41e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.757+0000 7f35f2ffd640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35f414b7f0 0x7f35f40a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35f3fff640 1 -- 172.21.15.88:0/2384376741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35f414b7f0 msgr2=0x7f35f40a4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35f3fff640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35f414b7f0 0x7f35f40a4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35f3fff640 1 -- 172.21.15.88:0/2384376741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35f40ba8e0 msgr2=0x7f35f41e1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35f3fff640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35f40ba8e0 0x7f35f41e1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35f3fff640 1 -- 172.21.15.88:0/2384376741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc009400 con 0x7f35f414ed40 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35f2ffd640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35f414b7f0 0x7f35f40a4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35f37fe640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35f40ba8e0 0x7f35f41e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35f3fff640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35f414ed40 0x7f35f4147c10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00cc00 tx=0x7f35ec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:21.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35ebfff640 1 -- 172.21.15.88:0/2384376741 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec00ce10 con 0x7f35f414ed40 2024-01-22T10:13:21.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35ebfff640 1 -- 172.21.15.88:0/2384376741 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec012400 con 0x7f35f414ed40 2024-01-22T10:13:21.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35ebfff640 1 -- 172.21.15.88:0/2384376741 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec0127b0 con 0x7f35f414ed40 2024-01-22T10:13:21.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35f9b68640 1 -- 172.21.15.88:0/2384376741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e4009400 con 0x7f35f414ed40 2024-01-22T10:13:21.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.758+0000 7f35f9b68640 1 -- 172.21.15.88:0/2384376741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f4148820 con 0x7f35f414ed40 2024-01-22T10:13:21.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.759+0000 7f35f9b68640 1 -- 172.21.15.88:0/2384376741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f4067c40 con 0x7f35f414ed40 2024-01-22T10:13:21.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.759+0000 7f35ebfff640 1 -- 172.21.15.88:0/2384376741 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f35ec012910 con 0x7f35f414ed40 2024-01-22T10:13:21.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.760+0000 7f35ebfff640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f35d406b330 0x7f35d406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:21.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.760+0000 7f35ebfff640 1 -- 172.21.15.88:0/2384376741 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35ec08a2e0 con 0x7f35f414ed40 2024-01-22T10:13:21.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.760+0000 7f35f37fe640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f35d406b330 0x7f35d406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:21.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.760+0000 7f35f37fe640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f35d406b330 0x7f35d406d7f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009c50 tx=0x7f35dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:21.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.764+0000 7f35ebfff640 1 -- 172.21.15.88:0/2384376741 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f35ec054f70 con 0x7f35f414ed40 2024-01-22T10:13:21.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.931+0000 7f35f9b68640 1 -- 172.21.15.88:0/2384376741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35f406b120 con 0x7f35f414ed40 2024-01-22T10:13:21.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.931+0000 7f35ebfff640 1 -- 172.21.15.88:0/2384376741 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35ec058590 con 0x7f35f414ed40 2024-01-22T10:13:21.914 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-01-22T10:13:21.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.933+0000 7f35f9b68640 1 -- 172.21.15.88:0/2384376741 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f35d406b330 msgr2=0x7f35d406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.933+0000 7f35f9b68640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f35d406b330 0x7f35d406d7f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009c50 tx=0x7f35dc008040 comp rx=0 tx=0).stop 2024-01-22T10:13:21.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.933+0000 7f35f9b68640 1 -- 172.21.15.88:0/2384376741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35f414ed40 msgr2=0x7f35f4147c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:21.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.933+0000 7f35f9b68640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35f414ed40 0x7f35f4147c10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00cc00 tx=0x7f35ec00a430 comp rx=0 tx=0).stop 2024-01-22T10:13:21.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.933+0000 7f35f9b68640 1 -- 172.21.15.88:0/2384376741 shutdown_connections 2024-01-22T10:13:21.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.933+0000 7f35f9b68640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f35d406b330 0x7f35d406d7f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.933+0000 7f35f9b68640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35f414b7f0 0x7f35f40a4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.933+0000 7f35f9b68640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35f414ed40 0x7f35f4147c10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.933+0000 7f35f9b68640 1 --2- 172.21.15.88:0/2384376741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35f40ba8e0 0x7f35f41e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:21.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.933+0000 7f35f9b68640 1 -- 172.21.15.88:0/2384376741 >> 172.21.15.88:0/2384376741 conn(0x7f35f40c0e70 msgr2=0x7f35f406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:21.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.933+0000 7f35f9b68640 1 -- 172.21.15.88:0/2384376741 shutdown_connections 2024-01-22T10:13:21.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:21.933+0000 7f35f9b68640 1 -- 172.21.15.88:0/2384376741 wait complete. 2024-01-22T10:13:21.928 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:22.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.046+0000 7fc3704da640 1 Processor -- start 2024-01-22T10:13:22.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.046+0000 7fc3704da640 1 -- start start 2024-01-22T10:13:22.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc3704da640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc36806d2b0 0x7fc36814bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc3704da640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc36806baa0 0x7fc36806bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc3704da640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36814b700 con 0x7fc3680a40c0 2024-01-22T10:13:22.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc3704da640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36806f340 con 0x7fc36806baa0 2024-01-22T10:13:22.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc3704da640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36806de90 con 0x7fc36806d2b0 2024-01-22T10:13:22.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc36da75640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc36806baa0 0x7fc36806bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc36da75640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc36806baa0 0x7fc36806bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36122/0 (socket says 172.21.15.88:36122) 2024-01-22T10:13:22.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc36da75640 1 -- 172.21.15.88:0/1950112438 learned_addr learned my addr 172.21.15.88:0/1950112438 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:22.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc36e276640 1 --2- 172.21.15.88:0/1950112438 >> v2:172.21.15.119:3300/0 conn(0x7fc36806d2b0 0x7fc36814bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc36da75640 1 -- 172.21.15.88:0/1950112438 >> v2:172.21.15.119:3300/0 conn(0x7fc36806d2b0 msgr2=0x7fc36814bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:22.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc36da75640 1 --2- 172.21.15.88:0/1950112438 >> v2:172.21.15.119:3300/0 conn(0x7fc36806d2b0 0x7fc36814bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc36da75640 1 -- 172.21.15.88:0/1950112438 >> v1:172.21.15.119:6789/0 conn(0x7fc3680a40c0 legacy=0x7fc36814ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.047+0000 7fc36da75640 1 -- 172.21.15.88:0/1950112438 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36806f5e0 con 0x7fc36806baa0 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.048+0000 7fc36da75640 1 --2- 172.21.15.88:0/1950112438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc36806baa0 0x7fc36806bee0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc3680745a0 tx=0x7fc35802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f248ad11b99607dd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.048+0000 7fc36d274640 1 -- 172.21.15.88:0/1950112438 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358031870 con 0x7fc36806baa0 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.048+0000 7fc36d274640 1 -- 172.21.15.88:0/1950112438 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3580319d0 con 0x7fc36806baa0 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.048+0000 7fc36d274640 1 -- 172.21.15.88:0/1950112438 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358031d60 con 0x7fc36806baa0 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.048+0000 7fc3704da640 1 -- 172.21.15.88:0/1950112438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc36806baa0 msgr2=0x7fc36806bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.048+0000 7fc3704da640 1 --2- 172.21.15.88:0/1950112438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc36806baa0 0x7fc36806bee0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc3680745a0 tx=0x7fc35802b910 comp rx=0 tx=0).stop 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.049+0000 7fc3704da640 1 -- 172.21.15.88:0/1950112438 shutdown_connections 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.049+0000 7fc3704da640 1 --2- 172.21.15.88:0/1950112438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc36806baa0 0x7fc36806bee0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.049+0000 7fc3704da640 1 --2- 172.21.15.88:0/1950112438 >> v2:172.21.15.119:3300/0 conn(0x7fc36806d2b0 0x7fc36814bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.049+0000 7fc3704da640 1 -- 172.21.15.88:0/1950112438 >> 172.21.15.88:0/1950112438 conn(0x7fc3680bb8d0 msgr2=0x7fc3680bbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.049+0000 7fc3704da640 1 -- 172.21.15.88:0/1950112438 shutdown_connections 2024-01-22T10:13:22.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.049+0000 7fc3704da640 1 -- 172.21.15.88:0/1950112438 wait complete. 2024-01-22T10:13:22.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc3704da640 1 Processor -- start 2024-01-22T10:13:22.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc3704da640 1 -- start start 2024-01-22T10:13:22.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc3704da640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc36806baa0 0x7fc368146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc3704da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc36806d2b0 0x7fc36813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc3704da640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3680a40c0 0x7fc36813f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc3704da640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3681472d0 con 0x7fc36806d2b0 2024-01-22T10:13:22.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc3704da640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36813fa00 con 0x7fc3680a40c0 2024-01-22T10:13:22.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc3704da640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc368148860 con 0x7fc36806baa0 2024-01-22T10:13:22.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc36da75640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc36806d2b0 0x7fc36813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc36da75640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc36806d2b0 0x7fc36813ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36132/0 (socket says 172.21.15.88:36132) 2024-01-22T10:13:22.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc36da75640 1 -- 172.21.15.88:0/1117381085 learned_addr learned my addr 172.21.15.88:0/1117381085 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:22.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc36da75640 1 -- 172.21.15.88:0/1117381085 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc36806baa0 msgr2=0x7fc368146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc36da75640 1 --2- 172.21.15.88:0/1117381085 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc36806baa0 0x7fc368146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc36da75640 1 -- 172.21.15.88:0/1117381085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3680a40c0 msgr2=0x7fc36813f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc36da75640 1 --2- 172.21.15.88:0/1117381085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3680a40c0 0x7fc36813f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.050+0000 7fc36da75640 1 -- 172.21.15.88:0/1117381085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3580094d0 con 0x7fc36806d2b0 2024-01-22T10:13:22.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.051+0000 7fc36da75640 1 --2- 172.21.15.88:0/1117381085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc36806d2b0 0x7fc36813ef80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc358000c00 tx=0x7fc3580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:22.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.051+0000 7fc35effd640 1 -- 172.21.15.88:0/1117381085 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35803abe0 con 0x7fc36806d2b0 2024-01-22T10:13:22.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.051+0000 7fc35effd640 1 -- 172.21.15.88:0/1117381085 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35803ad40 con 0x7fc36806d2b0 2024-01-22T10:13:22.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.051+0000 7fc3704da640 1 -- 172.21.15.88:0/1117381085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36814f4e0 con 0x7fc36806d2b0 2024-01-22T10:13:22.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.051+0000 7fc35effd640 1 -- 172.21.15.88:0/1117381085 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358044610 con 0x7fc36806d2b0 2024-01-22T10:13:22.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.051+0000 7fc3704da640 1 -- 172.21.15.88:0/1117381085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc368148a60 con 0x7fc36806d2b0 2024-01-22T10:13:22.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.052+0000 7fc3704da640 1 -- 172.21.15.88:0/1117381085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36804ea30 con 0x7fc36806d2b0 2024-01-22T10:13:22.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.052+0000 7fc35effd640 1 -- 172.21.15.88:0/1117381085 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fc35804d450 con 0x7fc36806d2b0 2024-01-22T10:13:22.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.052+0000 7fc35effd640 1 --2- 172.21.15.88:0/1117381085 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc34c06b330 0x7fc34c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.053+0000 7fc35effd640 1 -- 172.21.15.88:0/1117381085 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc35802d040 con 0x7fc36806d2b0 2024-01-22T10:13:22.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.053+0000 7fc36e276640 1 --2- 172.21.15.88:0/1117381085 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc34c06b330 0x7fc34c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.053+0000 7fc36e276640 1 --2- 172.21.15.88:0/1117381085 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc34c06b330 0x7fc34c06d7f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3640098f0 tx=0x7fc364008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:22.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.057+0000 7fc35effd640 1 -- 172.21.15.88:0/1117381085 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc358076ec0 con 0x7fc36806d2b0 2024-01-22T10:13:22.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.229+0000 7fc3704da640 1 -- 172.21.15.88:0/1117381085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc36806c550 con 0x7fc36806d2b0 2024-01-22T10:13:22.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.230+0000 7fc35effd640 1 -- 172.21.15.88:0/1117381085 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fc35807a4e0 con 0x7fc36806d2b0 2024-01-22T10:13:22.213 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:22.213 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.232+0000 7fc3704da640 1 -- 172.21.15.88:0/1117381085 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc34c06b330 msgr2=0x7fc34c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.232+0000 7fc3704da640 1 --2- 172.21.15.88:0/1117381085 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc34c06b330 0x7fc34c06d7f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3640098f0 tx=0x7fc364008040 comp rx=0 tx=0).stop 2024-01-22T10:13:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.232+0000 7fc3704da640 1 -- 172.21.15.88:0/1117381085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc36806d2b0 msgr2=0x7fc36813ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.232+0000 7fc3704da640 1 --2- 172.21.15.88:0/1117381085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc36806d2b0 0x7fc36813ef80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc358000c00 tx=0x7fc3580046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.232+0000 7fc3704da640 1 -- 172.21.15.88:0/1117381085 shutdown_connections 2024-01-22T10:13:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.232+0000 7fc3704da640 1 --2- 172.21.15.88:0/1117381085 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc34c06b330 0x7fc34c06d7f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.232+0000 7fc3704da640 1 --2- 172.21.15.88:0/1117381085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3680a40c0 0x7fc36813f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.232+0000 7fc3704da640 1 --2- 172.21.15.88:0/1117381085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc36806d2b0 0x7fc36813ef80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.232+0000 7fc3704da640 1 --2- 172.21.15.88:0/1117381085 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc36806baa0 0x7fc368146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.232+0000 7fc3704da640 1 -- 172.21.15.88:0/1117381085 >> 172.21.15.88:0/1117381085 conn(0x7fc3680bb8d0 msgr2=0x7fc3681441d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.232+0000 7fc3704da640 1 -- 172.21.15.88:0/1117381085 shutdown_connections 2024-01-22T10:13:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.232+0000 7fc3704da640 1 -- 172.21.15.88:0/1117381085 wait complete. 2024-01-22T10:13:22.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T10:13:00.844842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T10:13:01.816849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:13:22.226 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:13:22.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.346+0000 7fd1fad0f640 1 Processor -- start 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.346+0000 7fd1fad0f640 1 -- start start 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.346+0000 7fd1fad0f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1f406c840 0x7fd1f40b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.346+0000 7fd1fad0f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f406d7d0 con 0x7fd1f406b800 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.346+0000 7fd1fad0f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f414b740 con 0x7fd1f406fbc0 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.346+0000 7fd1fad0f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f40b5480 con 0x7fd1f406c840 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.347+0000 7fd1f92ac640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd1f406b800 0x7fd1f4155fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58506/0 (socket says 172.21.15.88:58506) 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.347+0000 7fd1f92ac640 1 -- 172.21.15.88:0/3748166741 learned_addr learned my addr 172.21.15.88:0/3748166741 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.347+0000 7fd1f8aab640 1 --2- 172.21.15.88:0/3748166741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1f406c840 0x7fd1f40b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.347+0000 7fd1f37fe640 1 -- 172.21.15.88:0/3748166741 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295288035 0 0) 0x7fd1f406d7d0 con 0x7fd1f406b800 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.347+0000 7fd1f37fe640 1 -- 172.21.15.88:0/3748166741 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1e4003520 con 0x7fd1f406b800 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.347+0000 7fd1f37fe640 1 -- 172.21.15.88:0/3748166741 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440391347 0 0) 0x7fd1f414b740 con 0x7fd1f406fbc0 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.347+0000 7fd1f37fe640 1 -- 172.21.15.88:0/3748166741 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f406d7d0 con 0x7fd1f406fbc0 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.347+0000 7fd1f37fe640 1 -- 172.21.15.88:0/3748166741 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3445618019 0 0) 0x7fd1e4003520 con 0x7fd1f406b800 2024-01-22T10:13:22.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.347+0000 7fd1f8aab640 1 -- 172.21.15.88:0/3748166741 >> v1:172.21.15.119:6789/0 conn(0x7fd1f406fbc0 legacy=0x7fd1f406d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.347+0000 7fd1f8aab640 1 -- 172.21.15.88:0/3748166741 >> v1:172.21.15.88:6789/0 conn(0x7fd1f406b800 legacy=0x7fd1f4155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.347+0000 7fd1f8aab640 1 -- 172.21.15.88:0/3748166741 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f414ba20 con 0x7fd1f406c840 2024-01-22T10:13:22.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.348+0000 7fd1f8aab640 1 --2- 172.21.15.88:0/3748166741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1f406c840 0x7fd1f40b57c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80097d0 tx=0x7fd1e802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62a7fde2fb7c3a0f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:22.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.348+0000 7fd1f37fe640 1 -- 172.21.15.88:0/3748166741 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0019f0 con 0x7fd1f406c840 2024-01-22T10:13:22.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.348+0000 7fd1f37fe640 1 -- 172.21.15.88:0/3748166741 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e8031580 con 0x7fd1f406c840 2024-01-22T10:13:22.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.348+0000 7fd1f37fe640 1 -- 172.21.15.88:0/3748166741 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8031910 con 0x7fd1f406c840 2024-01-22T10:13:22.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.348+0000 7fd1fad0f640 1 -- 172.21.15.88:0/3748166741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1f406c840 msgr2=0x7fd1f40b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.348+0000 7fd1fad0f640 1 --2- 172.21.15.88:0/3748166741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1f406c840 0x7fd1f40b57c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80097d0 tx=0x7fd1e802b8a0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.349+0000 7fd1fad0f640 1 -- 172.21.15.88:0/3748166741 shutdown_connections 2024-01-22T10:13:22.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.349+0000 7fd1fad0f640 1 --2- 172.21.15.88:0/3748166741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1f406c840 0x7fd1f40b57c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.349+0000 7fd1fad0f640 1 -- 172.21.15.88:0/3748166741 >> 172.21.15.88:0/3748166741 conn(0x7fd1f40bb740 msgr2=0x7fd1f40bbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:22.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.349+0000 7fd1fad0f640 1 -- 172.21.15.88:0/3748166741 shutdown_connections 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.349+0000 7fd1fad0f640 1 -- 172.21.15.88:0/3748166741 wait complete. 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.350+0000 7fd1fad0f640 1 Processor -- start 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.350+0000 7fd1fad0f640 1 -- start start 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.350+0000 7fd1fad0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1f406b800 0x7fd1f40b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.350+0000 7fd1fad0f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1f406c840 0x7fd1f4146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.350+0000 7fd1fad0f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1f406fbc0 0x7fd1f4141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.350+0000 7fd1fad0f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f40b8070 con 0x7fd1f406b800 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.350+0000 7fd1fad0f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f4147510 con 0x7fd1f406c840 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.350+0000 7fd1fad0f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f40b8800 con 0x7fd1f406fbc0 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.350+0000 7fd1f8aab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1f406b800 0x7fd1f40b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.350+0000 7fd1f8aab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1f406b800 0x7fd1f40b7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36146/0 (socket says 172.21.15.88:36146) 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.350+0000 7fd1f8aab640 1 -- 172.21.15.88:0/993859765 learned_addr learned my addr 172.21.15.88:0/993859765 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1f3fff640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1f406c840 0x7fd1f4146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1f92ac640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1f406fbc0 0x7fd1f4141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1f8aab640 1 -- 172.21.15.88:0/993859765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1f406fbc0 msgr2=0x7fd1f4141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1f8aab640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1f406fbc0 0x7fd1f4141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1f8aab640 1 -- 172.21.15.88:0/993859765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1f406c840 msgr2=0x7fd1f4146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1f8aab640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1f406c840 0x7fd1f4146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1f8aab640 1 -- 172.21.15.88:0/993859765 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e8009400 con 0x7fd1f406b800 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1f3fff640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1f406c840 0x7fd1f4146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1f8aab640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1f406b800 0x7fd1f40b7b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80097d0 tx=0x7fd1e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1f17fa640 1 -- 172.21.15.88:0/993859765 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8004020 con 0x7fd1f406b800 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1f17fa640 1 -- 172.21.15.88:0/993859765 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e80041a0 con 0x7fd1f406b800 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1fad0f640 1 -- 172.21.15.88:0/993859765 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f4144760 con 0x7fd1f406b800 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1f17fa640 1 -- 172.21.15.88:0/993859765 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8003610 con 0x7fd1f406b800 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.351+0000 7fd1fad0f640 1 -- 172.21.15.88:0/993859765 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f4145f20 con 0x7fd1f406b800 2024-01-22T10:13:22.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.352+0000 7fd1fad0f640 1 -- 172.21.15.88:0/993859765 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f404ea30 con 0x7fd1f406b800 2024-01-22T10:13:22.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.352+0000 7fd1f17fa640 1 -- 172.21.15.88:0/993859765 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fd1e8043070 con 0x7fd1f406b800 2024-01-22T10:13:22.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.353+0000 7fd1f17fa640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd1d806b330 0x7fd1d806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.353+0000 7fd1f3fff640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd1d806b330 0x7fd1d806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.353+0000 7fd1f17fa640 1 -- 172.21.15.88:0/993859765 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1e80ab8d0 con 0x7fd1f406b800 2024-01-22T10:13:22.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.353+0000 7fd1f3fff640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd1d806b330 0x7fd1d806d7f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd1f41450e0 tx=0x7fd1e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:22.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.357+0000 7fd1f17fa640 1 -- 172.21.15.88:0/993859765 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd1e8076560 con 0x7fd1f406b800 2024-01-22T10:13:22.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.525+0000 7fd1fad0f640 1 -- 172.21.15.88:0/993859765 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd1f4141b60 con 0x7fd1f406b800 2024-01-22T10:13:22.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.525+0000 7fd1f17fa640 1 -- 172.21.15.88:0/993859765 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1e8079b80 con 0x7fd1f406b800 2024-01-22T10:13:22.508 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:13:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.527+0000 7fd1fad0f640 1 -- 172.21.15.88:0/993859765 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd1d806b330 msgr2=0x7fd1d806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.527+0000 7fd1fad0f640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd1d806b330 0x7fd1d806d7f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd1f41450e0 tx=0x7fd1e0009040 comp rx=0 tx=0).stop 2024-01-22T10:13:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.527+0000 7fd1fad0f640 1 -- 172.21.15.88:0/993859765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1f406b800 msgr2=0x7fd1f40b7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.527+0000 7fd1fad0f640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1f406b800 0x7fd1f40b7b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80097d0 tx=0x7fd1e80046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.527+0000 7fd1fad0f640 1 -- 172.21.15.88:0/993859765 shutdown_connections 2024-01-22T10:13:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.527+0000 7fd1fad0f640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd1d806b330 0x7fd1d806d7f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.527+0000 7fd1fad0f640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1f406fbc0 0x7fd1f4141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.527+0000 7fd1fad0f640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1f406c840 0x7fd1f4146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.527+0000 7fd1fad0f640 1 --2- 172.21.15.88:0/993859765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1f406b800 0x7fd1f40b7b30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.527+0000 7fd1fad0f640 1 -- 172.21.15.88:0/993859765 >> 172.21.15.88:0/993859765 conn(0x7fd1f40bb740 msgr2=0x7fd1f40bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.527+0000 7fd1fad0f640 1 -- 172.21.15.88:0/993859765 shutdown_connections 2024-01-22T10:13:22.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.527+0000 7fd1fad0f640 1 -- 172.21.15.88:0/993859765 wait complete. 2024-01-22T10:13:22.520 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T10:13:22.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.639+0000 7f47f6ada640 1 Processor -- start 2024-01-22T10:13:22.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.639+0000 7f47f6ada640 1 -- start start 2024-01-22T10:13:22.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47f6ada640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f47f01456f0 0x7f47f0072950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47f6ada640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47f00b7e40 0x7f47f00be330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47f6ada640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47f00be870 0x7f47f014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47f6ada640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f0071530 con 0x7f47f00b7e40 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47f6ada640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f0145ad0 con 0x7f47f01456f0 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47f6ada640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f0070c00 con 0x7f47f00be870 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47effff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47f00b7e40 0x7f47f00be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47effff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47f00b7e40 0x7f47f00be330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36152/0 (socket says 172.21.15.88:36152) 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47effff640 1 -- 172.21.15.88:0/4191871379 learned_addr learned my addr 172.21.15.88:0/4191871379 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47f4876640 1 --2- 172.21.15.88:0/4191871379 >> v2:172.21.15.119:3300/0 conn(0x7f47f01456f0 0x7f47f0072950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47f5077640 1 --2- 172.21.15.88:0/4191871379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47f00be870 0x7f47f014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47effff640 1 -- 172.21.15.88:0/4191871379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47f00be870 msgr2=0x7f47f014ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47effff640 1 --2- 172.21.15.88:0/4191871379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47f00be870 0x7f47f014ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47effff640 1 -- 172.21.15.88:0/4191871379 >> v2:172.21.15.119:3300/0 conn(0x7f47f01456f0 msgr2=0x7f47f0072950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47effff640 1 --2- 172.21.15.88:0/4191871379 >> v2:172.21.15.119:3300/0 conn(0x7f47f01456f0 0x7f47f0072950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47effff640 1 -- 172.21.15.88:0/4191871379 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f0070ee0 con 0x7f47f00b7e40 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47f4876640 1 --2- 172.21.15.88:0/4191871379 >> v2:172.21.15.119:3300/0 conn(0x7f47f01456f0 0x7f47f0072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.640+0000 7f47f5077640 1 --2- 172.21.15.88:0/4191871379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47f00be870 0x7f47f014ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.641+0000 7f47effff640 1 --2- 172.21.15.88:0/4191871379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f00b7e40 0x7f47f00be330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f47f00b9210 tx=0x7f47e402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3114762c2863625c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.641+0000 7f47ef7fe640 1 -- 172.21.15.88:0/4191871379 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4030860 con 0x7f47f00b7e40 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.641+0000 7f47ef7fe640 1 -- 172.21.15.88:0/4191871379 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e40309c0 con 0x7f47f00b7e40 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.641+0000 7f47ef7fe640 1 -- 172.21.15.88:0/4191871379 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4030d50 con 0x7f47f00b7e40 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.642+0000 7f47f6ada640 1 -- 172.21.15.88:0/4191871379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f00b7e40 msgr2=0x7f47f00be330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.642+0000 7f47f6ada640 1 --2- 172.21.15.88:0/4191871379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f00b7e40 0x7f47f00be330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f47f00b9210 tx=0x7f47e402b9a0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.642+0000 7f47f6ada640 1 -- 172.21.15.88:0/4191871379 shutdown_connections 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.642+0000 7f47f6ada640 1 --2- 172.21.15.88:0/4191871379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f00b7e40 0x7f47f00be330 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.642+0000 7f47f6ada640 1 --2- 172.21.15.88:0/4191871379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47f00be870 0x7f47f014ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.642+0000 7f47f6ada640 1 --2- 172.21.15.88:0/4191871379 >> v2:172.21.15.119:3300/0 conn(0x7f47f01456f0 0x7f47f0072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.642+0000 7f47f6ada640 1 -- 172.21.15.88:0/4191871379 >> 172.21.15.88:0/4191871379 conn(0x7f47f006be30 msgr2=0x7f47f00bdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:22.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.642+0000 7f47f6ada640 1 -- 172.21.15.88:0/4191871379 shutdown_connections 2024-01-22T10:13:22.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.642+0000 7f47f6ada640 1 -- 172.21.15.88:0/4191871379 wait complete. 2024-01-22T10:13:22.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.643+0000 7f47f6ada640 1 Processor -- start 2024-01-22T10:13:22.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.643+0000 7f47f6ada640 1 -- start start 2024-01-22T10:13:22.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f6ada640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f00b7e40 0x7f47f01e0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f6ada640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47f00be870 0x7f47f014c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f6ada640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47f01456f0 0x7f47f013dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f6ada640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f01e0f50 con 0x7f47f00b7e40 2024-01-22T10:13:22.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f6ada640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f0148f30 con 0x7f47f00be870 2024-01-22T10:13:22.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f6ada640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f013f940 con 0x7f47f01456f0 2024-01-22T10:13:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f4876640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f00b7e40 0x7f47f01e0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f4876640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f00b7e40 0x7f47f01e0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36168/0 (socket says 172.21.15.88:36168) 2024-01-22T10:13:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f4876640 1 -- 172.21.15.88:0/3522294064 learned_addr learned my addr 172.21.15.88:0/3522294064 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47effff640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47f00be870 0x7f47f014c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f5077640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47f01456f0 0x7f47f013dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f4876640 1 -- 172.21.15.88:0/3522294064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47f01456f0 msgr2=0x7f47f013dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f4876640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47f01456f0 0x7f47f013dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f4876640 1 -- 172.21.15.88:0/3522294064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47f00be870 msgr2=0x7f47f014c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f4876640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47f00be870 0x7f47f014c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f4876640 1 -- 172.21.15.88:0/3522294064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e40094d0 con 0x7f47f00b7e40 2024-01-22T10:13:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f5077640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47f01456f0 0x7f47f013dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:22.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f4876640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f00b7e40 0x7f47f01e0a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f47e000c7f0 tx=0x7f47e000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:22.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47ed7fa640 1 -- 172.21.15.88:0/3522294064 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0007820 con 0x7f47f00b7e40 2024-01-22T10:13:22.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47ed7fa640 1 -- 172.21.15.88:0/3522294064 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e0007980 con 0x7f47f00b7e40 2024-01-22T10:13:22.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f6ada640 1 -- 172.21.15.88:0/3522294064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f013eb80 con 0x7f47f00b7e40 2024-01-22T10:13:22.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47ed7fa640 1 -- 172.21.15.88:0/3522294064 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0007cf0 con 0x7f47f00b7e40 2024-01-22T10:13:22.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.644+0000 7f47f6ada640 1 -- 172.21.15.88:0/3522294064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f013f140 con 0x7f47f00b7e40 2024-01-22T10:13:22.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.645+0000 7f47f6ada640 1 -- 172.21.15.88:0/3522294064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f004ea30 con 0x7f47f00b7e40 2024-01-22T10:13:22.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.646+0000 7f47ed7fa640 1 -- 172.21.15.88:0/3522294064 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f47e00113f0 con 0x7f47f00b7e40 2024-01-22T10:13:22.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.646+0000 7f47ed7fa640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f47dc06b330 0x7f47dc06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.646+0000 7f47effff640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f47dc06b330 0x7f47dc06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.646+0000 7f47ed7fa640 1 -- 172.21.15.88:0/3522294064 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47e0089f20 con 0x7f47f00b7e40 2024-01-22T10:13:22.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.647+0000 7f47effff640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f47dc06b330 0x7f47dc06d7f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f47e4036000 tx=0x7f47e4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:22.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.650+0000 7f47ed7fa640 1 -- 172.21.15.88:0/3522294064 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f47e0054bd0 con 0x7f47f00b7e40 2024-01-22T10:13:22.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.818+0000 7f47f6ada640 1 -- 172.21.15.88:0/3522294064 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47f00b92a0 con 0x7f47f00b7e40 2024-01-22T10:13:22.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.819+0000 7f47ed7fa640 1 -- 172.21.15.88:0/3522294064 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47e001f0a0 con 0x7f47f00b7e40 2024-01-22T10:13:22.801 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-01-22T10:13:22.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.820+0000 7f47f6ada640 1 -- 172.21.15.88:0/3522294064 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f47dc06b330 msgr2=0x7f47dc06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.820+0000 7f47f6ada640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f47dc06b330 0x7f47dc06d7f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f47e4036000 tx=0x7f47e4008030 comp rx=0 tx=0).stop 2024-01-22T10:13:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.820+0000 7f47f6ada640 1 -- 172.21.15.88:0/3522294064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f00b7e40 msgr2=0x7f47f01e0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.820+0000 7f47f6ada640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f00b7e40 0x7f47f01e0a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f47e000c7f0 tx=0x7f47e000ccb0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.820+0000 7f47f6ada640 1 -- 172.21.15.88:0/3522294064 shutdown_connections 2024-01-22T10:13:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.820+0000 7f47f6ada640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f47dc06b330 0x7f47dc06d7f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.820+0000 7f47f6ada640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47f01456f0 0x7f47f013dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.820+0000 7f47f6ada640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47f00be870 0x7f47f014c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.820+0000 7f47f6ada640 1 --2- 172.21.15.88:0/3522294064 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47f00b7e40 0x7f47f01e0a10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.821+0000 7f47f6ada640 1 -- 172.21.15.88:0/3522294064 >> 172.21.15.88:0/3522294064 conn(0x7f47f006be30 msgr2=0x7f47f0141c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.821+0000 7f47f6ada640 1 -- 172.21.15.88:0/3522294064 shutdown_connections 2024-01-22T10:13:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.821+0000 7f47f6ada640 1 -- 172.21.15.88:0/3522294064 wait complete. 2024-01-22T10:13:22.814 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T10:13:22.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.934+0000 7fa47b631640 1 Processor -- start 2024-01-22T10:13:22.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.934+0000 7fa47b631640 1 -- start start 2024-01-22T10:13:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa47b631640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa474143390 0x7fa474143820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa47b631640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa474143d60 con 0x7fa4740b3df0 2024-01-22T10:13:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa47b631640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4740bbef0 con 0x7fa4740b8b30 2024-01-22T10:13:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa47b631640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4740bb140 con 0x7fa474143390 2024-01-22T10:13:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa478bcc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa4740b3df0 0x7fa4740b9890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58514/0 (socket says 172.21.15.88:58514) 2024-01-22T10:13:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa478bcc640 1 -- 172.21.15.88:0/3945121605 learned_addr learned my addr 172.21.15.88:0/3945121605 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082686623 0 0) 0x7fa474143d60 con 0x7fa4740b3df0 2024-01-22T10:13:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa460003520 con 0x7fa4740b3df0 2024-01-22T10:13:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa479bce640 1 --2- 172.21.15.88:0/3945121605 >> v2:172.21.15.119:3300/0 conn(0x7fa474143390 0x7fa474143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1843993952 0 0) 0x7fa460003520 con 0x7fa4740b3df0 2024-01-22T10:13:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 >> v2:172.21.15.119:3300/0 conn(0x7fa474143390 msgr2=0x7fa474143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 --2- 172.21.15.88:0/3945121605 >> v2:172.21.15.119:3300/0 conn(0x7fa474143390 0x7fa474143820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 >> v1:172.21.15.119:6789/0 conn(0x7fa4740b8b30 legacy=0x7fa4740b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4740bb410 con 0x7fa4740b3df0 2024-01-22T10:13:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fa464001670 con 0x7fa4740b3df0 2024-01-22T10:13:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 >> v1:172.21.15.88:6789/0 conn(0x7fa4740b3df0 legacy=0x7fa4740b9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 --2- 172.21.15.88:0/3945121605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 0x7fa460003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 --2- 172.21.15.88:0/3945121605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4600047c0 0x7fa460004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 --2- 172.21.15.88:0/3945121605 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4600052a0 0x7fa46000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740bb140 con 0x7fa460003a50 2024-01-22T10:13:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46000c1a0 con 0x7fa4600047c0 2024-01-22T10:13:22.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46000c360 con 0x7fa4600052a0 2024-01-22T10:13:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa4793cd640 1 --2- 172.21.15.88:0/3945121605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 0x7fa460003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.935+0000 7fa478bcc640 1 --2- 172.21.15.88:0/3945121605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4600047c0 0x7fa460004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.936+0000 7fa479bce640 1 --2- 172.21.15.88:0/3945121605 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4600052a0 0x7fa46000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.936+0000 7fa4793cd640 1 -- 172.21.15.88:0/3945121605 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4600052a0 msgr2=0x7fa46000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.936+0000 7fa4793cd640 1 --2- 172.21.15.88:0/3945121605 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4600052a0 0x7fa46000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.936+0000 7fa4793cd640 1 -- 172.21.15.88:0/3945121605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4600047c0 msgr2=0x7fa460004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.936+0000 7fa4793cd640 1 --2- 172.21.15.88:0/3945121605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4600047c0 0x7fa460004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.936+0000 7fa4793cd640 1 -- 172.21.15.88:0/3945121605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa460003520 con 0x7fa460003a50 2024-01-22T10:13:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.936+0000 7fa479bce640 1 -- 172.21.15.88:0/3945121605 reap_dead start 2024-01-22T10:13:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.936+0000 7fa4793cd640 1 --2- 172.21.15.88:0/3945121605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 0x7fa460003e50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa470003d80 tx=0x7fa4600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1197d192c6212131 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:22.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.936+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470032600 con 0x7fa460003a50 2024-01-22T10:13:22.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.936+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47002e050 con 0x7fa460003a50 2024-01-22T10:13:22.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.937+0000 7fa46bfff640 1 -- 172.21.15.88:0/3945121605 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4700329e0 con 0x7fa460003a50 2024-01-22T10:13:22.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.937+0000 7fa47b631640 1 -- 172.21.15.88:0/3945121605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 msgr2=0x7fa460003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.937+0000 7fa47b631640 1 --2- 172.21.15.88:0/3945121605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 0x7fa460003e50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa470003d80 tx=0x7fa4600057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.937+0000 7fa47b631640 1 -- 172.21.15.88:0/3945121605 shutdown_connections 2024-01-22T10:13:22.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.937+0000 7fa47b631640 1 --2- 172.21.15.88:0/3945121605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 0x7fa460003e50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.937+0000 7fa47b631640 1 -- 172.21.15.88:0/3945121605 >> 172.21.15.88:0/3945121605 conn(0x7fa474071650 msgr2=0x7fa474071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:22.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.937+0000 7fa47b631640 1 -- 172.21.15.88:0/3945121605 shutdown_connections 2024-01-22T10:13:22.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.937+0000 7fa47b631640 1 -- 172.21.15.88:0/3945121605 wait complete. 2024-01-22T10:13:22.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.938+0000 7fa47b631640 1 Processor -- start 2024-01-22T10:13:22.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.938+0000 7fa47b631640 1 -- start start 2024-01-22T10:13:22.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa47b631640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 0x7fa474145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa47b631640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa474146920 0x7fa474144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa47b631640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474144790 0x7fa4740a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa47b631640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4741e2110 con 0x7fa460003a50 2024-01-22T10:13:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa47b631640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa474144c10 con 0x7fa474144790 2024-01-22T10:13:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa47b631640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47409e340 con 0x7fa474146920 2024-01-22T10:13:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa4793cd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 0x7fa474145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa4793cd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 0x7fa474145fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36178/0 (socket says 172.21.15.88:36178) 2024-01-22T10:13:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa4793cd640 1 -- 172.21.15.88:0/2481147536 learned_addr learned my addr 172.21.15.88:0/2481147536 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa479bce640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474144790 0x7fa4740a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa478bcc640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa474146920 0x7fa474144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa4793cd640 1 -- 172.21.15.88:0/2481147536 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa474146920 msgr2=0x7fa474144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa4793cd640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa474146920 0x7fa474144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa4793cd640 1 -- 172.21.15.88:0/2481147536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474144790 msgr2=0x7fa4740a3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:22.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa4793cd640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474144790 0x7fa4740a3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa4793cd640 1 -- 172.21.15.88:0/2481147536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4741e17e0 con 0x7fa460003a50 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.939+0000 7fa4793cd640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 0x7fa474145fd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa470003d80 tx=0x7fa4700036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.940+0000 7fa469ffb640 1 -- 172.21.15.88:0/2481147536 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47003c410 con 0x7fa460003a50 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.940+0000 7fa469ffb640 1 -- 172.21.15.88:0/2481147536 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47003c570 con 0x7fa460003a50 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.940+0000 7fa47b631640 1 -- 172.21.15.88:0/2481147536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4741e2110 con 0x7fa460003a50 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.940+0000 7fa469ffb640 1 -- 172.21.15.88:0/2481147536 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47003c920 con 0x7fa460003a50 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.940+0000 7fa47b631640 1 -- 172.21.15.88:0/2481147536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4741e1da0 con 0x7fa460003a50 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.941+0000 7fa47b631640 1 -- 172.21.15.88:0/2481147536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4740b45f0 con 0x7fa460003a50 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.941+0000 7fa469ffb640 1 -- 172.21.15.88:0/2481147536 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fa470039050 con 0x7fa460003a50 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.941+0000 7fa469ffb640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa45806b330 0x7fa45806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.941+0000 7fa469ffb640 1 -- 172.21.15.88:0/2481147536 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4700ab030 con 0x7fa460003a50 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.942+0000 7fa478bcc640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa45806b330 0x7fa45806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:22.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.942+0000 7fa478bcc640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa45806b330 0x7fa45806d7f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa47406d9e0 tx=0x7fa464009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:22.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:22.946+0000 7fa469ffb640 1 -- 172.21.15.88:0/2481147536 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa470075d80 con 0x7fa460003a50 2024-01-22T10:13:23.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.117+0000 7fa47b631640 1 -- 172.21.15.88:0/2481147536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa47404ea30 con 0x7fa460003a50 2024-01-22T10:13:23.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.118+0000 7fa469ffb640 1 -- 172.21.15.88:0/2481147536 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa4700793a0 con 0x7fa460003a50 2024-01-22T10:13:23.101 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-01-22T10:13:23.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.120+0000 7fa47b631640 1 -- 172.21.15.88:0/2481147536 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa45806b330 msgr2=0x7fa45806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.120+0000 7fa47b631640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa45806b330 0x7fa45806d7f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa47406d9e0 tx=0x7fa464009040 comp rx=0 tx=0).stop 2024-01-22T10:13:23.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.120+0000 7fa47b631640 1 -- 172.21.15.88:0/2481147536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 msgr2=0x7fa474145fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.120+0000 7fa47b631640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 0x7fa474145fd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa470003d80 tx=0x7fa4700036f0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.120+0000 7fa47b631640 1 -- 172.21.15.88:0/2481147536 shutdown_connections 2024-01-22T10:13:23.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.120+0000 7fa47b631640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa45806b330 0x7fa45806d7f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.120+0000 7fa47b631640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa474146920 0x7fa474144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.120+0000 7fa47b631640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474144790 0x7fa4740a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.120+0000 7fa47b631640 1 --2- 172.21.15.88:0/2481147536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa460003a50 0x7fa474145fd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.120+0000 7fa47b631640 1 -- 172.21.15.88:0/2481147536 >> 172.21.15.88:0/2481147536 conn(0x7fa474071650 msgr2=0x7fa4740b9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:23.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.120+0000 7fa47b631640 1 -- 172.21.15.88:0/2481147536 shutdown_connections 2024-01-22T10:13:23.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.120+0000 7fa47b631640 1 -- 172.21.15.88:0/2481147536 wait complete. 2024-01-22T10:13:23.113 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:23.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.230+0000 7f9bf9e83640 1 Processor -- start 2024-01-22T10:13:23.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.230+0000 7f9bf9e83640 1 -- start start 2024-01-22T10:13:23.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf9e83640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9bf40b38f0 0x7f9bf414b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf9e83640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf40bd930 con 0x7f9bf4072510 2024-01-22T10:13:23.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf9e83640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf4072d10 con 0x7f9bf40b6ad0 2024-01-22T10:13:23.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf9e83640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40b2c90 con 0x7f9bf40b38f0 2024-01-22T10:13:23.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf2ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9bf4072510 0x7f9bf4153f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58526/0 (socket says 172.21.15.88:58526) 2024-01-22T10:13:23.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf2ffd640 1 -- 172.21.15.88:0/1780869607 learned_addr learned my addr 172.21.15.88:0/1780869607 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf3fff640 1 --2- 172.21.15.88:0/1780869607 >> v2:172.21.15.119:3300/0 conn(0x7f9bf40b38f0 0x7f9bf414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603915522 0 0) 0x7f9bf40bd930 con 0x7f9bf4072510 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bdc003520 con 0x7f9bf4072510 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1420960670 0 0) 0x7f9bdc003520 con 0x7f9bf4072510 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 >> v2:172.21.15.119:3300/0 conn(0x7f9bf40b38f0 msgr2=0x7f9bf414b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 --2- 172.21.15.88:0/1780869607 >> v2:172.21.15.119:3300/0 conn(0x7f9bf40b38f0 0x7f9bf414b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 >> v1:172.21.15.119:6789/0 conn(0x7f9bf40b6ad0 legacy=0x7f9bf40bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40b3130 con 0x7f9bf4072510 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f9be4001670 con 0x7f9bf4072510 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 >> v1:172.21.15.88:6789/0 conn(0x7f9bf4072510 legacy=0x7f9bf4153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 --2- 172.21.15.88:0/1780869607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bdc003a50 0x7f9bdc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 --2- 172.21.15.88:0/1780869607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bdc0047c0 0x7f9bdc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 --2- 172.21.15.88:0/1780869607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bdc0051d0 0x7f9bdc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40b2c90 con 0x7f9bdc0051d0 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc00c100 con 0x7f9bdc003a50 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc00c2c0 con 0x7f9bdc0047c0 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf3fff640 1 --2- 172.21.15.88:0/1780869607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bdc0051d0 0x7f9bdc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf37fe640 1 --2- 172.21.15.88:0/1780869607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bdc003a50 0x7f9bdc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.231+0000 7f9bf2ffd640 1 --2- 172.21.15.88:0/1780869607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bdc0047c0 0x7f9bdc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.232+0000 7f9bf3fff640 1 -- 172.21.15.88:0/1780869607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bdc0047c0 msgr2=0x7f9bdc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.232+0000 7f9bf3fff640 1 --2- 172.21.15.88:0/1780869607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bdc0047c0 0x7f9bdc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.232+0000 7f9bf3fff640 1 -- 172.21.15.88:0/1780869607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bdc003a50 msgr2=0x7f9bdc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.232+0000 7f9bf3fff640 1 --2- 172.21.15.88:0/1780869607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bdc003a50 0x7f9bdc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.232+0000 7f9bf3fff640 1 -- 172.21.15.88:0/1780869607 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc003520 con 0x7f9bdc0051d0 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.232+0000 7f9bf3fff640 1 -- 172.21.15.88:0/1780869607 reap_dead start 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.232+0000 7f9bf3fff640 1 --2- 172.21.15.88:0/1780869607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bdc0051d0 0x7f9bdc00b980 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009f90 tx=0x7f9bdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5e3d75c0b4fd2a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.232+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec02cc20 con 0x7f9bdc0051d0 2024-01-22T10:13:23.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.232+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec00f040 con 0x7f9bdc0051d0 2024-01-22T10:13:23.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.232+0000 7f9bf27fc640 1 -- 172.21.15.88:0/1780869607 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec003990 con 0x7f9bdc0051d0 2024-01-22T10:13:23.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.233+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1780869607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bdc0051d0 msgr2=0x7f9bdc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.233+0000 7f9bf9e83640 1 --2- 172.21.15.88:0/1780869607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bdc0051d0 0x7f9bdc00b980 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009f90 tx=0x7f9bdc0057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.233+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1780869607 shutdown_connections 2024-01-22T10:13:23.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.233+0000 7f9bf9e83640 1 --2- 172.21.15.88:0/1780869607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bdc0051d0 0x7f9bdc00b980 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.233+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1780869607 >> 172.21.15.88:0/1780869607 conn(0x7f9bf406acf0 msgr2=0x7f9bf40bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:23.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.233+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1780869607 shutdown_connections 2024-01-22T10:13:23.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.233+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1780869607 wait complete. 2024-01-22T10:13:23.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.234+0000 7f9bf9e83640 1 Processor -- start 2024-01-22T10:13:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.234+0000 7f9bf9e83640 1 -- start start 2024-01-22T10:13:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf9e83640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bdc0051d0 0x7f9bf4146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf9e83640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bf4148950 0x7f9bf4147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf9e83640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bf41e1360 0x7f9bf41e17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf9e83640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4071f60 con 0x7f9bf41e1360 2024-01-22T10:13:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf9e83640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4146fd0 con 0x7f9bdc0051d0 2024-01-22T10:13:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf9e83640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf41472b0 con 0x7f9bf4148950 2024-01-22T10:13:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bf41e1360 0x7f9bf41e17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bf41e1360 0x7f9bf41e17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36200/0 (socket says 172.21.15.88:36200) 2024-01-22T10:13:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf3fff640 1 -- 172.21.15.88:0/1301595620 learned_addr learned my addr 172.21.15.88:0/1301595620 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf37fe640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bdc0051d0 0x7f9bf4146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf2ffd640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bf4148950 0x7f9bf4147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf3fff640 1 -- 172.21.15.88:0/1301595620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bf4148950 msgr2=0x7f9bf4147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf3fff640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bf4148950 0x7f9bf4147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf3fff640 1 -- 172.21.15.88:0/1301595620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bdc0051d0 msgr2=0x7f9bf4146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf3fff640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bdc0051d0 0x7f9bf4146240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf3fff640 1 -- 172.21.15.88:0/1301595620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf4146780 con 0x7f9bf41e1360 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf3fff640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bf41e1360 0x7f9bf41e17e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9bec02c690 tx=0x7f9bec009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bdbfff640 1 -- 172.21.15.88:0/1301595620 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec02cea0 con 0x7f9bf41e1360 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bdbfff640 1 -- 172.21.15.88:0/1301595620 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec004230 con 0x7f9bf41e1360 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1301595620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf4148e80 con 0x7f9bf41e1360 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.235+0000 7f9bdbfff640 1 -- 172.21.15.88:0/1301595620 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0045e0 con 0x7f9bf41e1360 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.236+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1301595620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf40711d0 con 0x7f9bf41e1360 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.236+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1301595620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf4146c30 con 0x7f9bf41e1360 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.237+0000 7f9bdbfff640 1 -- 172.21.15.88:0/1301595620 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f9bec004740 con 0x7f9bf41e1360 2024-01-22T10:13:23.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.237+0000 7f9bdbfff640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9be006b330 0x7f9be006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.237+0000 7f9bdbfff640 1 -- 172.21.15.88:0/1301595620 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bec0ac0e0 con 0x7f9bf41e1360 2024-01-22T10:13:23.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.237+0000 7f9bf37fe640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9be006b330 0x7f9be006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.238+0000 7f9bf37fe640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9be006b330 0x7f9be006d7f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9be8000c00 tx=0x7f9be8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:23.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.241+0000 7f9bdbfff640 1 -- 172.21.15.88:0/1301595620 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9bec076fd0 con 0x7f9bf41e1360 2024-01-22T10:13:23.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.410+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1301595620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bf4067c40 con 0x7f9bf41e1360 2024-01-22T10:13:23.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.411+0000 7f9bdbfff640 1 -- 172.21.15.88:0/1301595620 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f9bec07a5f0 con 0x7f9bf41e1360 2024-01-22T10:13:23.394 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:23.394 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.413+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1301595620 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9be006b330 msgr2=0x7f9be006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.413+0000 7f9bf9e83640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9be006b330 0x7f9be006d7f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9be8000c00 tx=0x7f9be8009040 comp rx=0 tx=0).stop 2024-01-22T10:13:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.413+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1301595620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bf41e1360 msgr2=0x7f9bf41e17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.413+0000 7f9bf9e83640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bf41e1360 0x7f9bf41e17e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9bec02c690 tx=0x7f9bec009750 comp rx=0 tx=0).stop 2024-01-22T10:13:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.413+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1301595620 shutdown_connections 2024-01-22T10:13:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.413+0000 7f9bf9e83640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9be006b330 0x7f9be006d7f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.413+0000 7f9bf9e83640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bf4148950 0x7f9bf4147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.413+0000 7f9bf9e83640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bf41e1360 0x7f9bf41e17e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.413+0000 7f9bf9e83640 1 --2- 172.21.15.88:0/1301595620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bdc0051d0 0x7f9bf4146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.413+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1301595620 >> 172.21.15.88:0/1301595620 conn(0x7f9bf406acf0 msgr2=0x7f9bf40b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:23.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.413+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1301595620 shutdown_connections 2024-01-22T10:13:23.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.413+0000 7f9bf9e83640 1 -- 172.21.15.88:0/1301595620 wait complete. 2024-01-22T10:13:23.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T10:13:00.844842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T10:13:01.816849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:13:23.407 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:13:23.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.528+0000 7fba286a2640 1 Processor -- start 2024-01-22T10:13:23.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.528+0000 7fba286a2640 1 -- start start 2024-01-22T10:13:23.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba286a2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba2006abc0 0x7fba200bcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba286a2640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba200c08b0 con 0x7fba200b44e0 2024-01-22T10:13:23.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba286a2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2014b820 con 0x7fba200babb0 2024-01-22T10:13:23.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba286a2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba200c0b10 con 0x7fba2006abc0 2024-01-22T10:13:23.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba25c3d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fba200b44e0 0x7fba200ba4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58530/0 (socket says 172.21.15.88:58530) 2024-01-22T10:13:23.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba25c3d640 1 -- 172.21.15.88:0/151821295 learned_addr learned my addr 172.21.15.88:0/151821295 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:23.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2643e640 1 --2- 172.21.15.88:0/151821295 >> v2:172.21.15.119:3300/0 conn(0x7fba2006abc0 0x7fba200bcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461261807 0 0) 0x7fba200c08b0 con 0x7fba200b44e0 2024-01-22T10:13:23.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba0c003520 con 0x7fba200b44e0 2024-01-22T10:13:23.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2757449544 0 0) 0x7fba0c003520 con 0x7fba200b44e0 2024-01-22T10:13:23.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 >> v2:172.21.15.119:3300/0 conn(0x7fba2006abc0 msgr2=0x7fba200bcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:23.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 --2- 172.21.15.88:0/151821295 >> v2:172.21.15.119:3300/0 conn(0x7fba2006abc0 0x7fba200bcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 >> v1:172.21.15.119:6789/0 conn(0x7fba200babb0 legacy=0x7fba2014bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200bbfc0 con 0x7fba200b44e0 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fba10001670 con 0x7fba200b44e0 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 >> v1:172.21.15.88:6789/0 conn(0x7fba200b44e0 legacy=0x7fba200ba4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 --2- 172.21.15.88:0/151821295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba0c003970 0x7fba0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 --2- 172.21.15.88:0/151821295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba0c0047c0 0x7fba0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 --2- 172.21.15.88:0/151821295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0052a0 0x7fba0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200c0b10 con 0x7fba0c0052a0 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c00c170 con 0x7fba0c003970 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c00c330 con 0x7fba0c0047c0 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba26c3f640 1 --2- 172.21.15.88:0/151821295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0052a0 0x7fba0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba2643e640 1 --2- 172.21.15.88:0/151821295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba0c003970 0x7fba0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.529+0000 7fba25c3d640 1 --2- 172.21.15.88:0/151821295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba0c0047c0 0x7fba0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.530+0000 7fba26c3f640 1 -- 172.21.15.88:0/151821295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba0c0047c0 msgr2=0x7fba0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:23.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.530+0000 7fba26c3f640 1 --2- 172.21.15.88:0/151821295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba0c0047c0 0x7fba0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.530+0000 7fba26c3f640 1 -- 172.21.15.88:0/151821295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba0c003970 msgr2=0x7fba0c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:23.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.530+0000 7fba26c3f640 1 --2- 172.21.15.88:0/151821295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba0c003970 0x7fba0c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.530+0000 7fba26c3f640 1 -- 172.21.15.88:0/151821295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c003520 con 0x7fba0c0052a0 2024-01-22T10:13:23.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.530+0000 7fba26c3f640 1 -- 172.21.15.88:0/151821295 reap_dead start 2024-01-22T10:13:23.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.530+0000 7fba26c3f640 1 --2- 172.21.15.88:0/151821295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0052a0 0x7fba0c00b980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fba200b8090 tx=0x7fba0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0dba3c4e479706 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:23.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.530+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18003b70 con 0x7fba0c0052a0 2024-01-22T10:13:23.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.530+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba18003cd0 con 0x7fba0c0052a0 2024-01-22T10:13:23.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.530+0000 7fba2543c640 1 -- 172.21.15.88:0/151821295 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba180052f0 con 0x7fba0c0052a0 2024-01-22T10:13:23.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.531+0000 7fba286a2640 1 -- 172.21.15.88:0/151821295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0052a0 msgr2=0x7fba0c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.531+0000 7fba286a2640 1 --2- 172.21.15.88:0/151821295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0052a0 0x7fba0c00b980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fba200b8090 tx=0x7fba0c0057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.531+0000 7fba286a2640 1 -- 172.21.15.88:0/151821295 shutdown_connections 2024-01-22T10:13:23.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.531+0000 7fba286a2640 1 --2- 172.21.15.88:0/151821295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba0c0052a0 0x7fba0c00b980 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.531+0000 7fba286a2640 1 -- 172.21.15.88:0/151821295 >> 172.21.15.88:0/151821295 conn(0x7fba200bd8d0 msgr2=0x7fba200bdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:23.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.531+0000 7fba286a2640 1 -- 172.21.15.88:0/151821295 shutdown_connections 2024-01-22T10:13:23.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.531+0000 7fba286a2640 1 -- 172.21.15.88:0/151821295 wait complete. 2024-01-22T10:13:23.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.532+0000 7fba286a2640 1 Processor -- start 2024-01-22T10:13:23.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.532+0000 7fba286a2640 1 -- start start 2024-01-22T10:13:23.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba286a2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba0c0052a0 0x7fba201d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba286a2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba200a2400 0x7fba201e4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba286a2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba201e4b90 0x7fba200b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba286a2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba201d2470 con 0x7fba201e4b90 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba286a2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba201e4230 con 0x7fba0c0052a0 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba286a2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba200b6590 con 0x7fba200a2400 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba26c3f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba201e4b90 0x7fba200b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba26c3f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba201e4b90 0x7fba200b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36214/0 (socket says 172.21.15.88:36214) 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba26c3f640 1 -- 172.21.15.88:0/985150957 learned_addr learned my addr 172.21.15.88:0/985150957 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba2643e640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba0c0052a0 0x7fba201d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba25c3d640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba200a2400 0x7fba201e4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba26c3f640 1 -- 172.21.15.88:0/985150957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba200a2400 msgr2=0x7fba201e4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba26c3f640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba200a2400 0x7fba201e4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba26c3f640 1 -- 172.21.15.88:0/985150957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba0c0052a0 msgr2=0x7fba201d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba26c3f640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba0c0052a0 0x7fba201d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba26c3f640 1 -- 172.21.15.88:0/985150957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200a2880 con 0x7fba201e4b90 2024-01-22T10:13:23.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba26c3f640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba201e4b90 0x7fba200b48c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fba1802c020 tx=0x7fba180014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:23.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba16ffd640 1 -- 172.21.15.88:0/985150957 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18039450 con 0x7fba201e4b90 2024-01-22T10:13:23.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba16ffd640 1 -- 172.21.15.88:0/985150957 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1803d070 con 0x7fba201e4b90 2024-01-22T10:13:23.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba286a2640 1 -- 172.21.15.88:0/985150957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba201d3510 con 0x7fba201e4b90 2024-01-22T10:13:23.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba16ffd640 1 -- 172.21.15.88:0/985150957 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18039810 con 0x7fba201e4b90 2024-01-22T10:13:23.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.533+0000 7fba286a2640 1 -- 172.21.15.88:0/985150957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba201d2190 con 0x7fba201e4b90 2024-01-22T10:13:23.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.534+0000 7fba286a2640 1 -- 172.21.15.88:0/985150957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba201e3f90 con 0x7fba201e4b90 2024-01-22T10:13:23.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.535+0000 7fba16ffd640 1 -- 172.21.15.88:0/985150957 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fba1803f030 con 0x7fba201e4b90 2024-01-22T10:13:23.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.535+0000 7fba16ffd640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fba0406b330 0x7fba0406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.535+0000 7fba16ffd640 1 -- 172.21.15.88:0/985150957 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba18003e40 con 0x7fba201e4b90 2024-01-22T10:13:23.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.535+0000 7fba2643e640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fba0406b330 0x7fba0406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.536+0000 7fba2643e640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fba0406b330 0x7fba0406d7f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009b40 tx=0x7fba1c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:23.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.539+0000 7fba16ffd640 1 -- 172.21.15.88:0/985150957 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fba201e3f90 con 0x7fba201e4b90 2024-01-22T10:13:23.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.707+0000 7fba286a2640 1 -- 172.21.15.88:0/985150957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba201e3f90 con 0x7fba201e4b90 2024-01-22T10:13:23.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.707+0000 7fba16ffd640 1 -- 172.21.15.88:0/985150957 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba201e3f90 con 0x7fba201e4b90 2024-01-22T10:13:23.690 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:13:23.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.709+0000 7fba286a2640 1 -- 172.21.15.88:0/985150957 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fba0406b330 msgr2=0x7fba0406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.709+0000 7fba286a2640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fba0406b330 0x7fba0406d7f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009b40 tx=0x7fba1c009190 comp rx=0 tx=0).stop 2024-01-22T10:13:23.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.709+0000 7fba286a2640 1 -- 172.21.15.88:0/985150957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba201e4b90 msgr2=0x7fba200b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.709+0000 7fba286a2640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba201e4b90 0x7fba200b48c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fba1802c020 tx=0x7fba180014a0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.709+0000 7fba286a2640 1 -- 172.21.15.88:0/985150957 shutdown_connections 2024-01-22T10:13:23.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.709+0000 7fba286a2640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fba0406b330 0x7fba0406d7f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.709+0000 7fba286a2640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba200a2400 0x7fba201e4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.709+0000 7fba286a2640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba201e4b90 0x7fba200b48c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.709+0000 7fba286a2640 1 --2- 172.21.15.88:0/985150957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba0c0052a0 0x7fba201d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.709+0000 7fba286a2640 1 -- 172.21.15.88:0/985150957 >> 172.21.15.88:0/985150957 conn(0x7fba200bd8d0 msgr2=0x7fba200ba430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:23.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.709+0000 7fba286a2640 1 -- 172.21.15.88:0/985150957 shutdown_connections 2024-01-22T10:13:23.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.709+0000 7fba286a2640 1 -- 172.21.15.88:0/985150957 wait complete. 2024-01-22T10:13:23.702 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T10:13:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.822+0000 7f5484525640 1 Processor -- start 2024-01-22T10:13:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.822+0000 7f5484525640 1 -- start start 2024-01-22T10:13:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.822+0000 7f5484525640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f547c0bded0 0x7f547c06aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.822+0000 7f5484525640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c0b4590 0x7f547c148b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f5484525640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c0c0830 con 0x7f547c149050 2024-01-22T10:13:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f5484525640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c1494c0 con 0x7f547c0bded0 2024-01-22T10:13:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f5484525640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0c0b10 con 0x7f547c0b4590 2024-01-22T10:13:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f5482ac2640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f547c149050 0x7f547c14ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58542/0 (socket says 172.21.15.88:58542) 2024-01-22T10:13:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f5482ac2640 1 -- 172.21.15.88:0/1115007739 learned_addr learned my addr 172.21.15.88:0/1115007739 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795997919 0 0) 0x7f547c0c0830 con 0x7f547c149050 2024-01-22T10:13:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54822c1640 1 --2- 172.21.15.88:0/1115007739 >> v2:172.21.15.119:3300/0 conn(0x7f547c0bded0 0x7f547c06aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5468003520 con 0x7f547c149050 2024-01-22T10:13:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f5481ac0640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c0b4590 0x7f547c148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4179731500 0 0) 0x7f5468003520 con 0x7f547c149050 2024-01-22T10:13:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c0b4590 msgr2=0x7f547c148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c0b4590 0x7f547c148b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 >> v2:172.21.15.119:3300/0 conn(0x7f547c0bded0 msgr2=0x7f547c06aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 --2- 172.21.15.88:0/1115007739 >> v2:172.21.15.119:3300/0 conn(0x7f547c0bded0 0x7f547c06aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0bb890 con 0x7f547c149050 2024-01-22T10:13:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f54740019f0 con 0x7f547c149050 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 >> v1:172.21.15.88:6789/0 conn(0x7f547c149050 legacy=0x7f547c14ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5468003a50 0x7f5468003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c0b4590 0x7f54680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5468004d00 0x7f5468005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c1494c0 con 0x7f5468003a50 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0c0b10 con 0x7f5468004d00 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546800ba00 con 0x7f547c0b4590 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f54822c1640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5468003a50 0x7f5468003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f5481ac0640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c0b4590 0x7f54680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.823+0000 7f5482ac2640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5468004d00 0x7f5468005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.824+0000 7f54822c1640 1 -- 172.21.15.88:0/1115007739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c0b4590 msgr2=0x7f54680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.824+0000 7f54822c1640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c0b4590 0x7f54680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.824+0000 7f54822c1640 1 -- 172.21.15.88:0/1115007739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5468004d00 msgr2=0x7f5468005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:23.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.824+0000 7f54822c1640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5468004d00 0x7f5468005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.824+0000 7f54822c1640 1 -- 172.21.15.88:0/1115007739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5468003520 con 0x7f5468003a50 2024-01-22T10:13:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.824+0000 7f5482ac2640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5468004d00 0x7f5468005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.824+0000 7f54822c1640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5468003a50 0x7f5468003e70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5478009ac0 tx=0x7f54680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62e380f300f9f94 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.824+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547802c710 con 0x7f5468003a50 2024-01-22T10:13:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.824+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547802c870 con 0x7f5468003a50 2024-01-22T10:13:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.824+0000 7f54812bf640 1 -- 172.21.15.88:0/1115007739 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547802cc00 con 0x7f5468003a50 2024-01-22T10:13:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.825+0000 7f5484525640 1 -- 172.21.15.88:0/1115007739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5468003a50 msgr2=0x7f5468003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.825+0000 7f5484525640 1 --2- 172.21.15.88:0/1115007739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5468003a50 0x7f5468003e70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5478009ac0 tx=0x7f54680057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.825+0000 7f5482ac2640 1 -- 172.21.15.88:0/1115007739 reap_dead start 2024-01-22T10:13:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.825+0000 7f5484525640 1 -- 172.21.15.88:0/1115007739 shutdown_connections 2024-01-22T10:13:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.825+0000 7f5484525640 1 -- 172.21.15.88:0/1115007739 >> 172.21.15.88:0/1115007739 conn(0x7f547c0a2d70 msgr2=0x7f547c0a3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:23.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.825+0000 7f5484525640 1 -- 172.21.15.88:0/1115007739 shutdown_connections 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.825+0000 7f5484525640 1 -- 172.21.15.88:0/1115007739 wait complete. 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.826+0000 7f5484525640 1 Processor -- start 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.826+0000 7f5484525640 1 -- start start 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5484525640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5468003a50 0x7f547c14efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5484525640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c1e14b0 0x7f547c1e1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5484525640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c1461b0 0x7f547c146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5484525640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c14f4f0 con 0x7f547c1461b0 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5484525640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0b7c50 con 0x7f5468003a50 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5484525640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c1e1e70 con 0x7f547c1e14b0 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5482ac2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c1461b0 0x7f547c146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5482ac2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c1461b0 0x7f547c146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36238/0 (socket says 172.21.15.88:36238) 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5482ac2640 1 -- 172.21.15.88:0/1879411588 learned_addr learned my addr 172.21.15.88:0/1879411588 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f54822c1640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5468003a50 0x7f547c14efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5481ac0640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c1e14b0 0x7f547c1e1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5482ac2640 1 -- 172.21.15.88:0/1879411588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c1e14b0 msgr2=0x7f547c1e1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5482ac2640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c1e14b0 0x7f547c1e1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5482ac2640 1 -- 172.21.15.88:0/1879411588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5468003a50 msgr2=0x7f547c14efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5482ac2640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5468003a50 0x7f547c14efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5482ac2640 1 -- 172.21.15.88:0/1879411588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0a35e0 con 0x7f547c1461b0 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5481ac0640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c1e14b0 0x7f547c1e1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5482ac2640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c1461b0 0x7f547c146630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f547c0bc610 tx=0x7f547400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5472ffd640 1 -- 172.21.15.88:0/1879411588 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547400eb90 con 0x7f547c1461b0 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5472ffd640 1 -- 172.21.15.88:0/1879411588 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547400ecf0 con 0x7f547c1461b0 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5484525640 1 -- 172.21.15.88:0/1879411588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c0b73b0 con 0x7f547c1461b0 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5472ffd640 1 -- 172.21.15.88:0/1879411588 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474013660 con 0x7f547c1461b0 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.827+0000 7f5484525640 1 -- 172.21.15.88:0/1879411588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c0b7970 con 0x7f547c1461b0 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.828+0000 7f5484525640 1 -- 172.21.15.88:0/1879411588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c0a1b50 con 0x7f547c1461b0 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.829+0000 7f5472ffd640 1 -- 172.21.15.88:0/1879411588 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f54740137c0 con 0x7f547c1461b0 2024-01-22T10:13:23.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.829+0000 7f5472ffd640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f546006b330 0x7f546006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:23.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.829+0000 7f5472ffd640 1 -- 172.21.15.88:0/1879411588 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5474089f80 con 0x7f547c1461b0 2024-01-22T10:13:23.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.829+0000 7f54822c1640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f546006b330 0x7f546006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:23.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.830+0000 7f54822c1640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f546006b330 0x7f546006d7f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5478036000 tx=0x7f5478030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:23.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.834+0000 7f5472ffd640 1 -- 172.21.15.88:0/1879411588 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5474054c10 con 0x7f547c1461b0 2024-01-22T10:13:23.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:23.999+0000 7f5484525640 1 -- 172.21.15.88:0/1879411588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f547c04ea30 con 0x7f547c1461b0 2024-01-22T10:13:23.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.000+0000 7f5472ffd640 1 -- 172.21.15.88:0/1879411588 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5474058230 con 0x7f547c1461b0 2024-01-22T10:13:23.982 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-01-22T10:13:23.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.001+0000 7f5484525640 1 -- 172.21.15.88:0/1879411588 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f546006b330 msgr2=0x7f546006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.001+0000 7f5484525640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f546006b330 0x7f546006d7f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5478036000 tx=0x7f5478030000 comp rx=0 tx=0).stop 2024-01-22T10:13:23.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.001+0000 7f5484525640 1 -- 172.21.15.88:0/1879411588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c1461b0 msgr2=0x7f547c146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:23.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.001+0000 7f5484525640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c1461b0 0x7f547c146630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f547c0bc610 tx=0x7f547400e530 comp rx=0 tx=0).stop 2024-01-22T10:13:23.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.001+0000 7f5484525640 1 -- 172.21.15.88:0/1879411588 shutdown_connections 2024-01-22T10:13:23.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.001+0000 7f5484525640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f546006b330 0x7f546006d7f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.001+0000 7f5484525640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f547c1e14b0 0x7f547c1e1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.001+0000 7f5484525640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f547c1461b0 0x7f547c146630 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.001+0000 7f5484525640 1 --2- 172.21.15.88:0/1879411588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5468003a50 0x7f547c14efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:23.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.001+0000 7f5484525640 1 -- 172.21.15.88:0/1879411588 >> 172.21.15.88:0/1879411588 conn(0x7f547c0a2d70 msgr2=0x7f547c0a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:23.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.002+0000 7f5484525640 1 -- 172.21.15.88:0/1879411588 shutdown_connections 2024-01-22T10:13:23.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.002+0000 7f5484525640 1 -- 172.21.15.88:0/1879411588 wait complete. 2024-01-22T10:13:23.995 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T10:13:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.114+0000 7fa835464640 1 Processor -- start 2024-01-22T10:13:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.114+0000 7fa835464640 1 -- start start 2024-01-22T10:13:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.114+0000 7fa835464640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8300b45a0 0x7fa83014b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.114+0000 7fa835464640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8300bd1c0 con 0x7fa8300bdde0 2024-01-22T10:13:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.114+0000 7fa835464640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8300c0820 con 0x7fa8300bbb00 2024-01-22T10:13:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.114+0000 7fa835464640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8300bc560 con 0x7fa8300b45a0 2024-01-22T10:13:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.114+0000 7fa8267fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8300b45a0 0x7fa83014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.114+0000 7fa82f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa8300bdde0 0x7fa830156010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58556/0 (socket says 172.21.15.88:58556) 2024-01-22T10:13:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.114+0000 7fa82f7fe640 1 -- 172.21.15.88:0/3088285600 learned_addr learned my addr 172.21.15.88:0/3088285600 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.115+0000 7fa82e7fc640 1 -- 172.21.15.88:0/3088285600 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148325262 0 0) 0x7fa8300bd1c0 con 0x7fa8300bdde0 2024-01-22T10:13:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.115+0000 7fa82e7fc640 1 -- 172.21.15.88:0/3088285600 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa81c003520 con 0x7fa8300bdde0 2024-01-22T10:13:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.115+0000 7fa8267fc640 1 -- 172.21.15.88:0/3088285600 >> v1:172.21.15.119:6789/0 conn(0x7fa8300bbb00 legacy=0x7fa83014ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.115+0000 7fa8267fc640 1 -- 172.21.15.88:0/3088285600 >> v1:172.21.15.88:6789/0 conn(0x7fa8300bdde0 legacy=0x7fa830156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.115+0000 7fa8267fc640 1 -- 172.21.15.88:0/3088285600 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8300c0b00 con 0x7fa8300b45a0 2024-01-22T10:13:24.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.115+0000 7fa8267fc640 1 --2- 172.21.15.88:0/3088285600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8300b45a0 0x7fa83014b580 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa8180097a0 tx=0x7fa81802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fc4f98c3ab57ea server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:24.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.116+0000 7fa82e7fc640 1 -- 172.21.15.88:0/3088285600 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818030610 con 0x7fa8300b45a0 2024-01-22T10:13:24.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.116+0000 7fa82e7fc640 1 -- 172.21.15.88:0/3088285600 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa818030770 con 0x7fa8300b45a0 2024-01-22T10:13:24.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.116+0000 7fa82e7fc640 1 -- 172.21.15.88:0/3088285600 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818030b00 con 0x7fa8300b45a0 2024-01-22T10:13:24.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.116+0000 7fa835464640 1 -- 172.21.15.88:0/3088285600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8300b45a0 msgr2=0x7fa83014b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.116+0000 7fa835464640 1 --2- 172.21.15.88:0/3088285600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8300b45a0 0x7fa83014b580 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa8180097a0 tx=0x7fa81802b960 comp rx=0 tx=0).stop 2024-01-22T10:13:24.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.116+0000 7fa835464640 1 -- 172.21.15.88:0/3088285600 shutdown_connections 2024-01-22T10:13:24.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.116+0000 7fa835464640 1 --2- 172.21.15.88:0/3088285600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8300b45a0 0x7fa83014b580 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.116+0000 7fa835464640 1 -- 172.21.15.88:0/3088285600 >> 172.21.15.88:0/3088285600 conn(0x7fa8300a2c20 msgr2=0x7fa8300a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:24.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.116+0000 7fa835464640 1 -- 172.21.15.88:0/3088285600 shutdown_connections 2024-01-22T10:13:24.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.116+0000 7fa835464640 1 -- 172.21.15.88:0/3088285600 wait complete. 2024-01-22T10:13:24.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.117+0000 7fa835464640 1 Processor -- start 2024-01-22T10:13:24.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.117+0000 7fa835464640 1 -- start start 2024-01-22T10:13:24.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa835464640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8300b45a0 0x7fa8300ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa835464640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8300bbb00 0x7fa8300b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa835464640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8300bdde0 0x7fa8300b6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa835464640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300baa10 con 0x7fa8300b45a0 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa835464640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300b5d00 con 0x7fa8300bbb00 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa835464640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8300b71d0 con 0x7fa8300bdde0 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa82effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8300b45a0 0x7fa8300ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa82effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8300b45a0 0x7fa8300ba4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36254/0 (socket says 172.21.15.88:36254) 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa82effd640 1 -- 172.21.15.88:0/1612798112 learned_addr learned my addr 172.21.15.88:0/1612798112 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa82effd640 1 -- 172.21.15.88:0/1612798112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8300bdde0 msgr2=0x7fa8300b6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa82effd640 1 --2- 172.21.15.88:0/1612798112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8300bdde0 0x7fa8300b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa82effd640 1 -- 172.21.15.88:0/1612798112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8300bbb00 msgr2=0x7fa8300b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa82effd640 1 --2- 172.21.15.88:0/1612798112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8300bbb00 0x7fa8300b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa82effd640 1 -- 172.21.15.88:0/1612798112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa818009400 con 0x7fa8300b45a0 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.118+0000 7fa82effd640 1 --2- 172.21.15.88:0/1612798112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8300b45a0 0x7fa8300ba4d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa82000c430 tx=0x7fa82000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.119+0000 7fa827fff640 1 -- 172.21.15.88:0/1612798112 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8200052d0 con 0x7fa8300b45a0 2024-01-22T10:13:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.119+0000 7fa827fff640 1 -- 172.21.15.88:0/1612798112 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa820005450 con 0x7fa8300b45a0 2024-01-22T10:13:24.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.119+0000 7fa835464640 1 -- 172.21.15.88:0/1612798112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa830147b40 con 0x7fa8300b45a0 2024-01-22T10:13:24.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.119+0000 7fa827fff640 1 -- 172.21.15.88:0/1612798112 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820007260 con 0x7fa8300b45a0 2024-01-22T10:13:24.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.119+0000 7fa835464640 1 -- 172.21.15.88:0/1612798112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8300b7400 con 0x7fa8300b45a0 2024-01-22T10:13:24.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.120+0000 7fa835464640 1 -- 172.21.15.88:0/1612798112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83004ea30 con 0x7fa8300b45a0 2024-01-22T10:13:24.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.120+0000 7fa827fff640 1 -- 172.21.15.88:0/1612798112 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fa8200073c0 con 0x7fa8300b45a0 2024-01-22T10:13:24.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.120+0000 7fa827fff640 1 --2- 172.21.15.88:0/1612798112 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa81006b330 0x7fa81006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.120+0000 7fa8267fc640 1 --2- 172.21.15.88:0/1612798112 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa81006b330 0x7fa81006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.120+0000 7fa827fff640 1 -- 172.21.15.88:0/1612798112 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa820088f90 con 0x7fa8300b45a0 2024-01-22T10:13:24.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.121+0000 7fa8267fc640 1 --2- 172.21.15.88:0/1612798112 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa81006b330 0x7fa81006d7f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa818036000 tx=0x7fa81803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:24.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.125+0000 7fa827fff640 1 -- 172.21.15.88:0/1612798112 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa8200bc0d0 con 0x7fa8300b45a0 2024-01-22T10:13:24.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.291+0000 7fa835464640 1 -- 172.21.15.88:0/1612798112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8300b5520 con 0x7fa8300b45a0 2024-01-22T10:13:24.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.291+0000 7fa827fff640 1 -- 172.21.15.88:0/1612798112 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa820053cb0 con 0x7fa8300b45a0 2024-01-22T10:13:24.274 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-01-22T10:13:24.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.293+0000 7fa835464640 1 -- 172.21.15.88:0/1612798112 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa81006b330 msgr2=0x7fa81006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.293+0000 7fa835464640 1 --2- 172.21.15.88:0/1612798112 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa81006b330 0x7fa81006d7f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa818036000 tx=0x7fa81803b040 comp rx=0 tx=0).stop 2024-01-22T10:13:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.293+0000 7fa835464640 1 -- 172.21.15.88:0/1612798112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8300b45a0 msgr2=0x7fa8300ba4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.293+0000 7fa835464640 1 --2- 172.21.15.88:0/1612798112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8300b45a0 0x7fa8300ba4d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa82000c430 tx=0x7fa82000c8f0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.293+0000 7fa835464640 1 -- 172.21.15.88:0/1612798112 shutdown_connections 2024-01-22T10:13:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.293+0000 7fa835464640 1 --2- 172.21.15.88:0/1612798112 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa81006b330 0x7fa81006d7f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.293+0000 7fa835464640 1 --2- 172.21.15.88:0/1612798112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8300bdde0 0x7fa8300b6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.293+0000 7fa835464640 1 --2- 172.21.15.88:0/1612798112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8300bbb00 0x7fa8300b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.293+0000 7fa835464640 1 --2- 172.21.15.88:0/1612798112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8300b45a0 0x7fa8300ba4d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.293+0000 7fa835464640 1 -- 172.21.15.88:0/1612798112 >> 172.21.15.88:0/1612798112 conn(0x7fa8300a2c20 msgr2=0x7fa8301490c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.293+0000 7fa835464640 1 -- 172.21.15.88:0/1612798112 shutdown_connections 2024-01-22T10:13:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.294+0000 7fa835464640 1 -- 172.21.15.88:0/1612798112 wait complete. 2024-01-22T10:13:24.350 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-01-22T10:13:24.350 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:24.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.467+0000 7fda4bb5a640 1 Processor -- start 2024-01-22T10:13:24.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.467+0000 7fda4bb5a640 1 -- start start 2024-01-22T10:13:24.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda4bb5a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda440b49c0 0x7fda4414b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda4bb5a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda4414bea0 0x7fda44152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda4bb5a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda440bd930 con 0x7fda440b3630 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda4bb5a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda440b5370 con 0x7fda440b49c0 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda4bb5a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4414c2f0 con 0x7fda4414bea0 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda490f5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda440b49c0 0x7fda4414b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda498f6640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fda440b3630 0x7fda440bd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58560/0 (socket says 172.21.15.88:58560) 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda498f6640 1 -- 172.21.15.88:0/2551638288 learned_addr learned my addr 172.21.15.88:0/2551638288 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda490f5640 1 -- 172.21.15.88:0/2551638288 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda4414bea0 msgr2=0x7fda44152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda4a0f7640 1 --2- 172.21.15.88:0/2551638288 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda4414bea0 0x7fda44152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda490f5640 1 --2- 172.21.15.88:0/2551638288 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda4414bea0 0x7fda44152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda488f4640 1 -- 172.21.15.88:0/2551638288 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420131449 0 0) 0x7fda440bd930 con 0x7fda440b3630 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda490f5640 1 -- 172.21.15.88:0/2551638288 >> v1:172.21.15.88:6789/0 conn(0x7fda440b3630 legacy=0x7fda440bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda490f5640 1 -- 172.21.15.88:0/2551638288 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda440b4e80 con 0x7fda440b49c0 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.468+0000 7fda4a0f7640 1 --2- 172.21.15.88:0/2551638288 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda4414bea0 0x7fda44152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:24.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.469+0000 7fda490f5640 1 --2- 172.21.15.88:0/2551638288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda440b49c0 0x7fda4414b960 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda340097a0 tx=0x7fda3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8da73d9d882566 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.469+0000 7fda488f4640 1 -- 172.21.15.88:0/2551638288 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34031830 con 0x7fda440b49c0 2024-01-22T10:13:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.469+0000 7fda488f4640 1 -- 172.21.15.88:0/2551638288 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda34031990 con 0x7fda440b49c0 2024-01-22T10:13:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.469+0000 7fda488f4640 1 -- 172.21.15.88:0/2551638288 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34031d20 con 0x7fda440b49c0 2024-01-22T10:13:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.470+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2551638288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda440b49c0 msgr2=0x7fda4414b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.470+0000 7fda4bb5a640 1 --2- 172.21.15.88:0/2551638288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda440b49c0 0x7fda4414b960 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda340097a0 tx=0x7fda3402b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.470+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2551638288 shutdown_connections 2024-01-22T10:13:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.470+0000 7fda4bb5a640 1 --2- 172.21.15.88:0/2551638288 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda4414bea0 0x7fda44152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.470+0000 7fda4bb5a640 1 --2- 172.21.15.88:0/2551638288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda440b49c0 0x7fda4414b960 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.470+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2551638288 >> 172.21.15.88:0/2551638288 conn(0x7fda4406acf0 msgr2=0x7fda440bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.470+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2551638288 shutdown_connections 2024-01-22T10:13:24.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.470+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2551638288 wait complete. 2024-01-22T10:13:24.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.471+0000 7fda4bb5a640 1 Processor -- start 2024-01-22T10:13:24.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.471+0000 7fda4bb5a640 1 -- start start 2024-01-22T10:13:24.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.471+0000 7fda4bb5a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda440b3630 0x7fda44149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.471+0000 7fda4bb5a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda440b49c0 0x7fda441e14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.471+0000 7fda4bb5a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda4414bea0 0x7fda441d4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.471+0000 7fda4bb5a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4414ac10 con 0x7fda440b49c0 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.471+0000 7fda4bb5a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44071d60 con 0x7fda4414bea0 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.471+0000 7fda4bb5a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda44072490 con 0x7fda440b3630 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.471+0000 7fda490f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda440b49c0 0x7fda441e14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.471+0000 7fda490f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda440b49c0 0x7fda441e14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36280/0 (socket says 172.21.15.88:36280) 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.471+0000 7fda490f5640 1 -- 172.21.15.88:0/2567941733 learned_addr learned my addr 172.21.15.88:0/2567941733 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.472+0000 7fda490f5640 1 -- 172.21.15.88:0/2567941733 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda440b3630 msgr2=0x7fda44149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.472+0000 7fda490f5640 1 --2- 172.21.15.88:0/2567941733 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda440b3630 0x7fda44149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.472+0000 7fda490f5640 1 -- 172.21.15.88:0/2567941733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda4414bea0 msgr2=0x7fda441d4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.472+0000 7fda490f5640 1 --2- 172.21.15.88:0/2567941733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda4414bea0 0x7fda441d4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.472+0000 7fda490f5640 1 -- 172.21.15.88:0/2567941733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda34009400 con 0x7fda440b49c0 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.472+0000 7fda490f5640 1 --2- 172.21.15.88:0/2567941733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda440b49c0 0x7fda441e14b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fda3402bee0 tx=0x7fda340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.472+0000 7fda3a7fc640 1 -- 172.21.15.88:0/2567941733 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3403ba70 con 0x7fda440b49c0 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.472+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2567941733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda440719b0 con 0x7fda440b49c0 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.472+0000 7fda3a7fc640 1 -- 172.21.15.88:0/2567941733 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3403bbf0 con 0x7fda440b49c0 2024-01-22T10:13:24.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.472+0000 7fda3a7fc640 1 -- 172.21.15.88:0/2567941733 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda340453f0 con 0x7fda440b49c0 2024-01-22T10:13:24.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.472+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2567941733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4414a340 con 0x7fda440b49c0 2024-01-22T10:13:24.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.473+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2567941733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda441d5720 con 0x7fda440b49c0 2024-01-22T10:13:24.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.473+0000 7fda3a7fc640 1 -- 172.21.15.88:0/2567941733 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fda3404e450 con 0x7fda440b49c0 2024-01-22T10:13:24.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.474+0000 7fda3a7fc640 1 --2- 172.21.15.88:0/2567941733 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fda2806b330 0x7fda2806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.474+0000 7fda3a7fc640 1 -- 172.21.15.88:0/2567941733 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda340abf10 con 0x7fda440b49c0 2024-01-22T10:13:24.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.474+0000 7fda498f6640 1 --2- 172.21.15.88:0/2567941733 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fda2806b330 0x7fda2806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.474+0000 7fda498f6640 1 --2- 172.21.15.88:0/2567941733 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fda2806b330 0x7fda2806d7f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fda40007fd0 tx=0x7fda40007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:24.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.478+0000 7fda3a7fc640 1 -- 172.21.15.88:0/2567941733 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fda34076a80 con 0x7fda440b49c0 2024-01-22T10:13:24.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.647+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2567941733 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda4404ea30 con 0x7fda440b49c0 2024-01-22T10:13:24.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.648+0000 7fda3a7fc640 1 -- 172.21.15.88:0/2567941733 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fda3407a0a0 con 0x7fda440b49c0 2024-01-22T10:13:24.631 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:24.631 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:24.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.650+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2567941733 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fda2806b330 msgr2=0x7fda2806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.650+0000 7fda4bb5a640 1 --2- 172.21.15.88:0/2567941733 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fda2806b330 0x7fda2806d7f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fda40007fd0 tx=0x7fda40007920 comp rx=0 tx=0).stop 2024-01-22T10:13:24.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.650+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2567941733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda440b49c0 msgr2=0x7fda441e14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.650+0000 7fda4bb5a640 1 --2- 172.21.15.88:0/2567941733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda440b49c0 0x7fda441e14b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fda3402bee0 tx=0x7fda340046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.650+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2567941733 shutdown_connections 2024-01-22T10:13:24.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.650+0000 7fda4bb5a640 1 --2- 172.21.15.88:0/2567941733 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fda2806b330 0x7fda2806d7f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.650+0000 7fda4bb5a640 1 --2- 172.21.15.88:0/2567941733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda4414bea0 0x7fda441d4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.650+0000 7fda4bb5a640 1 --2- 172.21.15.88:0/2567941733 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda440b49c0 0x7fda441e14b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.650+0000 7fda4bb5a640 1 --2- 172.21.15.88:0/2567941733 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda440b3630 0x7fda44149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.650+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2567941733 >> 172.21.15.88:0/2567941733 conn(0x7fda4406acf0 msgr2=0x7fda440baa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:24.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.650+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2567941733 shutdown_connections 2024-01-22T10:13:24.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.650+0000 7fda4bb5a640 1 -- 172.21.15.88:0/2567941733 wait complete. 2024-01-22T10:13:24.643 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T10:13:00.844842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T10:13:01.816849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:13:24.644 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:13:24.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.763+0000 7f29bf4b4640 1 Processor -- start 2024-01-22T10:13:24.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.763+0000 7f29bf4b4640 1 -- start start 2024-01-22T10:13:24.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.764+0000 7f29bf4b4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f29b80b8a00 0x7f29b806f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.764+0000 7f29bf4b4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29b80b8de0 0x7f29b8149d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.764+0000 7f29bf4b4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b806fee0 con 0x7f29b8142f80 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.764+0000 7f29bf4b4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b80b5410 con 0x7f29b80b8a00 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.764+0000 7f29bf4b4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80b5df0 con 0x7f29b80b8de0 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.764+0000 7f29bca4f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29b80b8de0 0x7f29b8149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.764+0000 7f29bd250640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f29b80b8a00 0x7f29b806f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.765+0000 7f29bd250640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f29b80b8a00 0x7f29b806f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:41346/0 (socket says 172.21.15.88:41346) 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.765+0000 7f29bca4f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29b80b8de0 0x7f29b8149d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:45622/0 (socket says 172.21.15.88:45622) 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.765+0000 7f29bd250640 1 -- 172.21.15.88:0/2560614147 learned_addr learned my addr 172.21.15.88:0/2560614147 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.765+0000 7f29bda51640 1 --1- 172.21.15.88:0/2560614147 >> v1:172.21.15.119:6789/0 conn(0x7f29b8142f80 0x7f29b814c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.88:53200/0 (socket says 172.21.15.88:53200) 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.765+0000 7f29bd250640 1 -- 172.21.15.88:0/2560614147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29b80b8de0 msgr2=0x7f29b8149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.765+0000 7f29bd250640 1 --2- 172.21.15.88:0/2560614147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29b80b8de0 0x7f29b8149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.765+0000 7f29bd250640 1 -- 172.21.15.88:0/2560614147 >> v1:172.21.15.119:6789/0 conn(0x7f29b8142f80 legacy=0x7f29b814c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.765+0000 7f29bd250640 1 -- 172.21.15.88:0/2560614147 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b80b5b10 con 0x7f29b80b8a00 2024-01-22T10:13:24.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.765+0000 7f29affff640 1 -- 172.21.15.88:0/2560614147 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681921459 0 0) 0x7f29b806fee0 con 0x7f29b8142f80 2024-01-22T10:13:24.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.765+0000 7f29bca4f640 1 --2- 172.21.15.88:0/2560614147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29b80b8de0 0x7f29b8149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:24.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.766+0000 7f29bd250640 1 --2- 172.21.15.88:0/2560614147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b80b8a00 0x7f29b806f9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009870 tx=0x7f29b402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e065c66af202db2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:24.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.766+0000 7f29affff640 1 -- 172.21.15.88:0/2560614147 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4030840 con 0x7f29b80b8a00 2024-01-22T10:13:24.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.766+0000 7f29affff640 1 -- 172.21.15.88:0/2560614147 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b40309a0 con 0x7f29b80b8a00 2024-01-22T10:13:24.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.766+0000 7f29affff640 1 -- 172.21.15.88:0/2560614147 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4030d30 con 0x7f29b80b8a00 2024-01-22T10:13:24.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.766+0000 7f29bf4b4640 1 -- 172.21.15.88:0/2560614147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b80b8a00 msgr2=0x7f29b806f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.766+0000 7f29bf4b4640 1 --2- 172.21.15.88:0/2560614147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b80b8a00 0x7f29b806f9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009870 tx=0x7f29b402b980 comp rx=0 tx=0).stop 2024-01-22T10:13:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.766+0000 7f29bf4b4640 1 -- 172.21.15.88:0/2560614147 shutdown_connections 2024-01-22T10:13:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.766+0000 7f29bf4b4640 1 --2- 172.21.15.88:0/2560614147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29b80b8de0 0x7f29b8149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.766+0000 7f29bf4b4640 1 --2- 172.21.15.88:0/2560614147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b80b8a00 0x7f29b806f9a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.766+0000 7f29bf4b4640 1 -- 172.21.15.88:0/2560614147 >> 172.21.15.88:0/2560614147 conn(0x7f29b80bb740 msgr2=0x7f29b80bbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.766+0000 7f29bf4b4640 1 -- 172.21.15.88:0/2560614147 shutdown_connections 2024-01-22T10:13:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.766+0000 7f29bf4b4640 1 -- 172.21.15.88:0/2560614147 wait complete. 2024-01-22T10:13:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.767+0000 7f29bf4b4640 1 Processor -- start 2024-01-22T10:13:24.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.767+0000 7f29bf4b4640 1 -- start start 2024-01-22T10:13:24.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bf4b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b80b8a00 0x7f29b8147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bf4b4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29b80b8de0 0x7f29b80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bf4b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b8142f80 0x7f29b81e1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bf4b4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80b7d70 con 0x7f29b8142f80 2024-01-22T10:13:24.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bf4b4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b81df620 con 0x7f29b80b8a00 2024-01-22T10:13:24.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bf4b4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b81de860 con 0x7f29b80b8de0 2024-01-22T10:13:24.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bda51640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b8142f80 0x7f29b81e1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bda51640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b8142f80 0x7f29b81e1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36294/0 (socket says 172.21.15.88:36294) 2024-01-22T10:13:24.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bda51640 1 -- 172.21.15.88:0/107126223 learned_addr learned my addr 172.21.15.88:0/107126223 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:24.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bd250640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b80b8a00 0x7f29b8147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bca4f640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29b80b8de0 0x7f29b80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bda51640 1 -- 172.21.15.88:0/107126223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29b80b8de0 msgr2=0x7f29b80b7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bda51640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29b80b8de0 0x7f29b80b7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bda51640 1 -- 172.21.15.88:0/107126223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b80b8a00 msgr2=0x7f29b8147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.768+0000 7f29bda51640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b80b8a00 0x7f29b8147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.769+0000 7f29bda51640 1 -- 172.21.15.88:0/107126223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a8009400 con 0x7f29b8142f80 2024-01-22T10:13:24.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.769+0000 7f29bda51640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b8142f80 0x7f29b81e1c00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f29b000c7d0 tx=0x7f29b000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:24.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.769+0000 7f29adffb640 1 -- 172.21.15.88:0/107126223 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b000a640 con 0x7f29b8142f80 2024-01-22T10:13:24.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.769+0000 7f29adffb640 1 -- 172.21.15.88:0/107126223 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b000a7a0 con 0x7f29b8142f80 2024-01-22T10:13:24.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.769+0000 7f29adffb640 1 -- 172.21.15.88:0/107126223 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b000ab90 con 0x7f29b8142f80 2024-01-22T10:13:24.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.769+0000 7f29bf4b4640 1 -- 172.21.15.88:0/107126223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b40094d0 con 0x7f29b8142f80 2024-01-22T10:13:24.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.769+0000 7f29bf4b4640 1 -- 172.21.15.88:0/107126223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b81dee20 con 0x7f29b8142f80 2024-01-22T10:13:24.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.770+0000 7f29bf4b4640 1 -- 172.21.15.88:0/107126223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b804ea30 con 0x7f29b8142f80 2024-01-22T10:13:24.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.770+0000 7f29adffb640 1 -- 172.21.15.88:0/107126223 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f29b000acf0 con 0x7f29b8142f80 2024-01-22T10:13:24.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.770+0000 7f29adffb640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f299c06b330 0x7f299c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:24.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.771+0000 7f29adffb640 1 -- 172.21.15.88:0/107126223 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29b0089300 con 0x7f29b8142f80 2024-01-22T10:13:24.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.771+0000 7f29bd250640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f299c06b330 0x7f299c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:24.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.771+0000 7f29bd250640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f299c06b330 0x7f299c06d7f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f29b4036000 tx=0x7f29b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:24.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.775+0000 7f29adffb640 1 -- 172.21.15.88:0/107126223 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f29b0054040 con 0x7f29b8142f80 2024-01-22T10:13:24.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.941+0000 7f29bf4b4640 1 -- 172.21.15.88:0/107126223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29b80bbcc0 con 0x7f29b8142f80 2024-01-22T10:13:24.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.942+0000 7f29adffb640 1 -- 172.21.15.88:0/107126223 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29b0057660 con 0x7f29b8142f80 2024-01-22T10:13:24.924 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:13:24.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.943+0000 7f29bf4b4640 1 -- 172.21.15.88:0/107126223 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f299c06b330 msgr2=0x7f299c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.943+0000 7f29bf4b4640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f299c06b330 0x7f299c06d7f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f29b4036000 tx=0x7f29b4008030 comp rx=0 tx=0).stop 2024-01-22T10:13:24.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.944+0000 7f29bf4b4640 1 -- 172.21.15.88:0/107126223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b8142f80 msgr2=0x7f29b81e1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:24.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.944+0000 7f29bf4b4640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b8142f80 0x7f29b81e1c00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f29b000c7d0 tx=0x7f29b000cc90 comp rx=0 tx=0).stop 2024-01-22T10:13:24.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.944+0000 7f29bf4b4640 1 -- 172.21.15.88:0/107126223 shutdown_connections 2024-01-22T10:13:24.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.944+0000 7f29bf4b4640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f299c06b330 0x7f299c06d7f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.944+0000 7f29bf4b4640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29b80b8de0 0x7f29b80b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.944+0000 7f29bf4b4640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29b8142f80 0x7f29b81e1c00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.944+0000 7f29bf4b4640 1 --2- 172.21.15.88:0/107126223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29b80b8a00 0x7f29b8147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:24.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.944+0000 7f29bf4b4640 1 -- 172.21.15.88:0/107126223 >> 172.21.15.88:0/107126223 conn(0x7f29b80bb740 msgr2=0x7f29b8141340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:24.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.944+0000 7f29bf4b4640 1 -- 172.21.15.88:0/107126223 shutdown_connections 2024-01-22T10:13:24.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:24.944+0000 7f29bf4b4640 1 -- 172.21.15.88:0/107126223 wait complete. 2024-01-22T10:13:24.936 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T10:13:25.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.056+0000 7f227338e640 1 Processor -- start 2024-01-22T10:13:25.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.056+0000 7f227338e640 1 -- start start 2024-01-22T10:13:25.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.056+0000 7f227338e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f226c0b75a0 0x7f226c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f227338e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c0b90f0 con 0x7f226c0b4ec0 2024-01-22T10:13:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f227338e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c14ca70 con 0x7f226c14d550 2024-01-22T10:13:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f227338e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0b7a30 con 0x7f226c0b75a0 2024-01-22T10:13:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f227112a640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f226c0b4ec0 0x7f226c0b86d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58576/0 (socket says 172.21.15.88:58576) 2024-01-22T10:13:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f227112a640 1 -- 172.21.15.88:0/3785037275 learned_addr learned my addr 172.21.15.88:0/3785037275 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f227192b640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f226c0b75a0 0x7f226c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264289443 0 0) 0x7f226c0b90f0 con 0x7f226c0b4ec0 2024-01-22T10:13:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2258003520 con 0x7f226c0b4ec0 2024-01-22T10:13:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340997401 0 0) 0x7f226c14ca70 con 0x7f226c14d550 2024-01-22T10:13:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f226c0b90f0 con 0x7f226c14d550 2024-01-22T10:13:25.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2124154336 0 0) 0x7f2258003520 con 0x7f226c0b4ec0 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f226c0b75a0 msgr2=0x7f226c154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f226c0b75a0 0x7f226c154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 >> v1:172.21.15.119:6789/0 conn(0x7f226c14d550 legacy=0x7f226c0a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c14cd50 con 0x7f226c0b4ec0 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f227192b640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f226c0b75a0 0x7f226c154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f2268001670 con 0x7f226c0b4ec0 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 >> v1:172.21.15.88:6789/0 conn(0x7f226c0b4ec0 legacy=0x7f226c0b86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2258003c10 0x7f2258004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22580047c0 0x7f2258004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f226c0b75a0 0x7f22580051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0b7a30 con 0x7f22580047c0 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225800bb10 con 0x7f2258003c10 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225800bca0 con 0x7f226c0b75a0 2024-01-22T10:13:25.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f2270929640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22580047c0 0x7f2258004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f227112a640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2258003c10 0x7f2258004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.057+0000 7f227192b640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f226c0b75a0 0x7f22580051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.058+0000 7f2270929640 1 -- 172.21.15.88:0/3785037275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f226c0b75a0 msgr2=0x7f22580051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.058+0000 7f2270929640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f226c0b75a0 0x7f22580051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.058+0000 7f2270929640 1 -- 172.21.15.88:0/3785037275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2258003c10 msgr2=0x7f2258004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.058+0000 7f2270929640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2258003c10 0x7f2258004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.058+0000 7f2270929640 1 -- 172.21.15.88:0/3785037275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2264009a70 con 0x7f22580047c0 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.058+0000 7f2270929640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22580047c0 0x7f2258004c40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f225c0018a0 tx=0x7f22580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bd57318c5bdd89 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.058+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c0052d0 con 0x7f22580047c0 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.058+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c005430 con 0x7f22580047c0 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.058+0000 7f2263fff640 1 -- 172.21.15.88:0/3785037275 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c003810 con 0x7f22580047c0 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.059+0000 7f227338e640 1 -- 172.21.15.88:0/3785037275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22580047c0 msgr2=0x7f2258004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.059+0000 7f227338e640 1 --2- 172.21.15.88:0/3785037275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22580047c0 0x7f2258004c40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f225c0018a0 tx=0x7f22580057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.059+0000 7f227192b640 1 -- 172.21.15.88:0/3785037275 reap_dead start 2024-01-22T10:13:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.059+0000 7f227338e640 1 -- 172.21.15.88:0/3785037275 shutdown_connections 2024-01-22T10:13:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.059+0000 7f227338e640 1 -- 172.21.15.88:0/3785037275 >> 172.21.15.88:0/3785037275 conn(0x7f226c06a6f0 msgr2=0x7f226c06ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.059+0000 7f227338e640 1 -- 172.21.15.88:0/3785037275 shutdown_connections 2024-01-22T10:13:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.059+0000 7f227338e640 1 -- 172.21.15.88:0/3785037275 wait complete. 2024-01-22T10:13:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.060+0000 7f227338e640 1 Processor -- start 2024-01-22T10:13:25.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.060+0000 7f227338e640 1 -- start start 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227338e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22580047c0 0x7f226c144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227338e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f226c13d370 0x7f226c1e2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227338e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226c1e27a0 0x7f226c13f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227338e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c1e2be0 con 0x7f226c1e27a0 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227338e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c13dd40 con 0x7f226c13d370 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227338e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c1469a0 con 0x7f22580047c0 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227192b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226c1e27a0 0x7f226c13f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227192b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226c1e27a0 0x7f226c13f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36304/0 (socket says 172.21.15.88:36304) 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227192b640 1 -- 172.21.15.88:0/1399607457 learned_addr learned my addr 172.21.15.88:0/1399607457 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227112a640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22580047c0 0x7f226c144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f2270929640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f226c13d370 0x7f226c1e2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227192b640 1 -- 172.21.15.88:0/1399607457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22580047c0 msgr2=0x7f226c144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227192b640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22580047c0 0x7f226c144d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227192b640 1 -- 172.21.15.88:0/1399607457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f226c13d370 msgr2=0x7f226c1e2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227192b640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f226c13d370 0x7f226c1e2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227192b640 1 -- 172.21.15.88:0/1399607457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c146c80 con 0x7f226c1e27a0 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227192b640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226c1e27a0 0x7f226c13f270 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f226c14d930 tx=0x7f226400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f2261ffb640 1 -- 172.21.15.88:0/1399607457 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226400e040 con 0x7f226c1e27a0 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f2261ffb640 1 -- 172.21.15.88:0/1399607457 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226400f040 con 0x7f226c1e27a0 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f2261ffb640 1 -- 172.21.15.88:0/1399607457 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264003dd0 con 0x7f226c1e27a0 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.061+0000 7f227338e640 1 -- 172.21.15.88:0/1399607457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226c13cc90 con 0x7f226c1e27a0 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.062+0000 7f227338e640 1 -- 172.21.15.88:0/1399607457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c1e3070 con 0x7f226c1e27a0 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.063+0000 7f227338e640 1 -- 172.21.15.88:0/1399607457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226c04ea30 con 0x7f226c1e27a0 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.063+0000 7f2261ffb640 1 -- 172.21.15.88:0/1399607457 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f2264003f30 con 0x7f226c1e27a0 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.063+0000 7f2261ffb640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f225006b330 0x7f225006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.063+0000 7f2261ffb640 1 -- 172.21.15.88:0/1399607457 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f226408a4e0 con 0x7f226c1e27a0 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.063+0000 7f227112a640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f225006b330 0x7f225006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.064+0000 7f227112a640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f225006b330 0x7f225006d7f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2268001eb0 tx=0x7f2268009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:25.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.068+0000 7f2261ffb640 1 -- 172.21.15.88:0/1399607457 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2264055200 con 0x7f226c1e27a0 2024-01-22T10:13:25.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.236+0000 7f227338e640 1 -- 172.21.15.88:0/1399607457 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f226c1e2d20 con 0x7f226c1e27a0 2024-01-22T10:13:25.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.237+0000 7f2261ffb640 1 -- 172.21.15.88:0/1399607457 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2264058820 con 0x7f226c1e27a0 2024-01-22T10:13:25.219 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-01-22T10:13:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.239+0000 7f227338e640 1 -- 172.21.15.88:0/1399607457 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f225006b330 msgr2=0x7f225006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.239+0000 7f227338e640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f225006b330 0x7f225006d7f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2268001eb0 tx=0x7f2268009040 comp rx=0 tx=0).stop 2024-01-22T10:13:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.239+0000 7f227338e640 1 -- 172.21.15.88:0/1399607457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226c1e27a0 msgr2=0x7f226c13f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.239+0000 7f227338e640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226c1e27a0 0x7f226c13f270 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f226c14d930 tx=0x7f226400f580 comp rx=0 tx=0).stop 2024-01-22T10:13:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.239+0000 7f227338e640 1 -- 172.21.15.88:0/1399607457 shutdown_connections 2024-01-22T10:13:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.239+0000 7f227338e640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f225006b330 0x7f225006d7f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.239+0000 7f227338e640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f226c1e27a0 0x7f226c13f270 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.239+0000 7f227338e640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f226c13d370 0x7f226c1e2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.239+0000 7f227338e640 1 --2- 172.21.15.88:0/1399607457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22580047c0 0x7f226c144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.239+0000 7f227338e640 1 -- 172.21.15.88:0/1399607457 >> 172.21.15.88:0/1399607457 conn(0x7f226c06a6f0 msgr2=0x7f226c06ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.239+0000 7f227338e640 1 -- 172.21.15.88:0/1399607457 shutdown_connections 2024-01-22T10:13:25.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.239+0000 7f227338e640 1 -- 172.21.15.88:0/1399607457 wait complete. 2024-01-22T10:13:25.232 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T10:13:25.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.352+0000 7fd067a4b640 1 Processor -- start 2024-01-22T10:13:25.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.352+0000 7fd067a4b640 1 -- start start 2024-01-22T10:13:25.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd067a4b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd0600b8920 0x7fd06014ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd067a4b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd06014b560 0x7fd060153010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd067a4b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0600b37e0 con 0x7fd06014a9e0 2024-01-22T10:13:25.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd067a4b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0600b5570 con 0x7fd06014b560 2024-01-22T10:13:25.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd067a4b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0600a1e40 con 0x7fd0600b8920 2024-01-22T10:13:25.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd065fe8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd06014b560 0x7fd060153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd064fe6640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd06014a9e0 0x7fd06014ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58592/0 (socket says 172.21.15.88:58592) 2024-01-22T10:13:25.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd064fe6640 1 -- 172.21.15.88:0/764536136 learned_addr learned my addr 172.21.15.88:0/764536136 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:25.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd0657e7640 1 --2- 172.21.15.88:0/764536136 >> v2:172.21.15.119:3300/0 conn(0x7fd0600b8920 0x7fd06014ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd065fe8640 1 -- 172.21.15.88:0/764536136 >> v2:172.21.15.119:3300/0 conn(0x7fd0600b8920 msgr2=0x7fd06014ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:25.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd065fe8640 1 --2- 172.21.15.88:0/764536136 >> v2:172.21.15.119:3300/0 conn(0x7fd0600b8920 0x7fd06014ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd065fe8640 1 -- 172.21.15.88:0/764536136 >> v1:172.21.15.88:6789/0 conn(0x7fd06014a9e0 legacy=0x7fd06014ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.353+0000 7fd065fe8640 1 -- 172.21.15.88:0/764536136 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600b6fd0 con 0x7fd06014b560 2024-01-22T10:13:25.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.354+0000 7fd065fe8640 1 --2- 172.21.15.88:0/764536136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd06014b560 0x7fd060153010 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b1c40 tx=0x7fd05802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5395408b8a7a02 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:25.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.354+0000 7fd057fff640 1 -- 172.21.15.88:0/764536136 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05802cbf0 con 0x7fd06014b560 2024-01-22T10:13:25.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.354+0000 7fd057fff640 1 -- 172.21.15.88:0/764536136 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05802cd50 con 0x7fd06014b560 2024-01-22T10:13:25.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.354+0000 7fd057fff640 1 -- 172.21.15.88:0/764536136 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058034660 con 0x7fd06014b560 2024-01-22T10:13:25.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.355+0000 7fd067a4b640 1 -- 172.21.15.88:0/764536136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd06014b560 msgr2=0x7fd060153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.355+0000 7fd067a4b640 1 --2- 172.21.15.88:0/764536136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd06014b560 0x7fd060153010 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b1c40 tx=0x7fd05802be40 comp rx=0 tx=0).stop 2024-01-22T10:13:25.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.355+0000 7fd067a4b640 1 -- 172.21.15.88:0/764536136 shutdown_connections 2024-01-22T10:13:25.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.355+0000 7fd067a4b640 1 --2- 172.21.15.88:0/764536136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd06014b560 0x7fd060153010 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.355+0000 7fd067a4b640 1 --2- 172.21.15.88:0/764536136 >> v2:172.21.15.119:3300/0 conn(0x7fd0600b8920 0x7fd06014ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.355+0000 7fd067a4b640 1 -- 172.21.15.88:0/764536136 >> 172.21.15.88:0/764536136 conn(0x7fd06006a6f0 msgr2=0x7fd06006ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:25.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.355+0000 7fd067a4b640 1 -- 172.21.15.88:0/764536136 shutdown_connections 2024-01-22T10:13:25.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.355+0000 7fd067a4b640 1 -- 172.21.15.88:0/764536136 wait complete. 2024-01-22T10:13:25.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.356+0000 7fd067a4b640 1 Processor -- start 2024-01-22T10:13:25.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.356+0000 7fd067a4b640 1 -- start start 2024-01-22T10:13:25.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd067a4b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0600b8920 0x7fd0601e2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd067a4b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd06014a9e0 0x7fd0601de950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd067a4b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd06014b560 0x7fd0600bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd067a4b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600bc2d0 con 0x7fd0600b8920 2024-01-22T10:13:25.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd067a4b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06009a550 con 0x7fd06014a9e0 2024-01-22T10:13:25.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd067a4b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06009a060 con 0x7fd06014b560 2024-01-22T10:13:25.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd0657e7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0600b8920 0x7fd0601e2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd0657e7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0600b8920 0x7fd0601e2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36326/0 (socket says 172.21.15.88:36326) 2024-01-22T10:13:25.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd0657e7640 1 -- 172.21.15.88:0/468269302 learned_addr learned my addr 172.21.15.88:0/468269302 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd064fe6640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd06014a9e0 0x7fd0601de950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd065fe8640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd06014b560 0x7fd0600bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd0657e7640 1 -- 172.21.15.88:0/468269302 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd06014b560 msgr2=0x7fd0600bbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd0657e7640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd06014b560 0x7fd0600bbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd0657e7640 1 -- 172.21.15.88:0/468269302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd06014a9e0 msgr2=0x7fd0601de950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd0657e7640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd06014a9e0 0x7fd0601de950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd0657e7640 1 -- 172.21.15.88:0/468269302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058009a70 con 0x7fd0600b8920 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd065fe8640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd06014b560 0x7fd0600bbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd0657e7640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0600b8920 0x7fd0601e2a80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00d800 tx=0x7fd05c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd055ffb640 1 -- 172.21.15.88:0/468269302 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00b6c0 con 0x7fd0600b8920 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd055ffb640 1 -- 172.21.15.88:0/468269302 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c00b820 con 0x7fd0600b8920 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd067a4b640 1 -- 172.21.15.88:0/468269302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06009a2f0 con 0x7fd0600b8920 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.357+0000 7fd055ffb640 1 -- 172.21.15.88:0/468269302 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00bbb0 con 0x7fd0600b8920 2024-01-22T10:13:25.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.358+0000 7fd067a4b640 1 -- 172.21.15.88:0/468269302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0601e2050 con 0x7fd0600b8920 2024-01-22T10:13:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.358+0000 7fd067a4b640 1 -- 172.21.15.88:0/468269302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06004ea30 con 0x7fd0600b8920 2024-01-22T10:13:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.359+0000 7fd055ffb640 1 -- 172.21.15.88:0/468269302 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fd05c00bd10 con 0x7fd0600b8920 2024-01-22T10:13:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.359+0000 7fd055ffb640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd04406b360 0x7fd04406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.359+0000 7fd055ffb640 1 -- 172.21.15.88:0/468269302 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd05c08a090 con 0x7fd0600b8920 2024-01-22T10:13:25.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.359+0000 7fd064fe6640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd04406b360 0x7fd04406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.360+0000 7fd064fe6640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd04406b360 0x7fd04406d820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b9780 tx=0x7fd050007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:25.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.363+0000 7fd055ffb640 1 -- 172.21.15.88:0/468269302 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd05c054d20 con 0x7fd0600b8920 2024-01-22T10:13:25.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.533+0000 7fd067a4b640 1 -- 172.21.15.88:0/468269302 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd06009b490 con 0x7fd0600b8920 2024-01-22T10:13:25.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.533+0000 7fd055ffb640 1 -- 172.21.15.88:0/468269302 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd05c058340 con 0x7fd0600b8920 2024-01-22T10:13:25.516 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-01-22T10:13:25.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.535+0000 7fd067a4b640 1 -- 172.21.15.88:0/468269302 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd04406b360 msgr2=0x7fd04406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.535+0000 7fd067a4b640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd04406b360 0x7fd04406d820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd0600b9780 tx=0x7fd050007e80 comp rx=0 tx=0).stop 2024-01-22T10:13:25.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.535+0000 7fd067a4b640 1 -- 172.21.15.88:0/468269302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0600b8920 msgr2=0x7fd0601e2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.535+0000 7fd067a4b640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0600b8920 0x7fd0601e2a80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00d800 tx=0x7fd05c00dcc0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.535+0000 7fd067a4b640 1 -- 172.21.15.88:0/468269302 shutdown_connections 2024-01-22T10:13:25.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.535+0000 7fd067a4b640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd04406b360 0x7fd04406d820 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.535+0000 7fd067a4b640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd06014b560 0x7fd0600bbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.535+0000 7fd067a4b640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd06014a9e0 0x7fd0601de950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.535+0000 7fd067a4b640 1 --2- 172.21.15.88:0/468269302 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0600b8920 0x7fd0601e2a80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.535+0000 7fd067a4b640 1 -- 172.21.15.88:0/468269302 >> 172.21.15.88:0/468269302 conn(0x7fd06006a6f0 msgr2=0x7fd06014ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:25.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.535+0000 7fd067a4b640 1 -- 172.21.15.88:0/468269302 shutdown_connections 2024-01-22T10:13:25.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.535+0000 7fd067a4b640 1 -- 172.21.15.88:0/468269302 wait complete. 2024-01-22T10:13:25.529 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2024-01-22T10:13:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.646+0000 7f109cb5a640 1 Processor -- start 2024-01-22T10:13:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.646+0000 7f109cb5a640 1 -- start start 2024-01-22T10:13:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.646+0000 7f109cb5a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f10980bdee0 0x7f10980bbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f109cb5a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1098148c30 0x7f10981490a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f109cb5a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10980bcfd0 con 0x7f10980b45a0 2024-01-22T10:13:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f109cb5a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10980bd240 con 0x7f10980bdee0 2024-01-22T10:13:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f109cb5a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10980c0670 con 0x7f1098148c30 2024-01-22T10:13:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f109659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f10980bdee0 0x7f10980bbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f109659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f10980bdee0 0x7f10980bbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36330/0 (socket says 172.21.15.88:36330) 2024-01-22T10:13:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f109659c640 1 -- 172.21.15.88:0/2959033698 learned_addr learned my addr 172.21.15.88:0/2959033698 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:25.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f109659c640 1 -- 172.21.15.88:0/2959033698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1098148c30 msgr2=0x7f10981490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:25.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f1096d9d640 1 --2- 172.21.15.88:0/2959033698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1098148c30 0x7f10981490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f109659c640 1 --2- 172.21.15.88:0/2959033698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1098148c30 0x7f10981490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f109659c640 1 -- 172.21.15.88:0/2959033698 >> v1:172.21.15.119:6789/0 conn(0x7f10980b45a0 legacy=0x7f109806aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:25.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f109659c640 1 -- 172.21.15.88:0/2959033698 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10980c0950 con 0x7f10980bdee0 2024-01-22T10:13:25.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.647+0000 7f1096d9d640 1 --2- 172.21.15.88:0/2959033698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1098148c30 0x7f10981490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.648+0000 7f109659c640 1 --2- 172.21.15.88:0/2959033698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10980bdee0 0x7f10980bbee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1088009870 tx=0x7f108802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72aebc0d10bec0a3 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.648+0000 7f1095d9b640 1 -- 172.21.15.88:0/2959033698 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088030840 con 0x7f10980bdee0 2024-01-22T10:13:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.648+0000 7f1095d9b640 1 -- 172.21.15.88:0/2959033698 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10880309a0 con 0x7f10980bdee0 2024-01-22T10:13:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.648+0000 7f1095d9b640 1 -- 172.21.15.88:0/2959033698 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088030d30 con 0x7f10980bdee0 2024-01-22T10:13:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.648+0000 7f109cb5a640 1 -- 172.21.15.88:0/2959033698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10980bdee0 msgr2=0x7f10980bbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.648+0000 7f109cb5a640 1 --2- 172.21.15.88:0/2959033698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10980bdee0 0x7f10980bbee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1088009870 tx=0x7f108802b980 comp rx=0 tx=0).stop 2024-01-22T10:13:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.648+0000 7f109cb5a640 1 -- 172.21.15.88:0/2959033698 shutdown_connections 2024-01-22T10:13:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.648+0000 7f109cb5a640 1 --2- 172.21.15.88:0/2959033698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1098148c30 0x7f10981490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.648+0000 7f109cb5a640 1 --2- 172.21.15.88:0/2959033698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10980bdee0 0x7f10980bbee0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.648+0000 7f109cb5a640 1 -- 172.21.15.88:0/2959033698 >> 172.21.15.88:0/2959033698 conn(0x7f10980a2b70 msgr2=0x7f10980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.648+0000 7f109cb5a640 1 -- 172.21.15.88:0/2959033698 shutdown_connections 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.648+0000 7f109cb5a640 1 -- 172.21.15.88:0/2959033698 wait complete. 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f109cb5a640 1 Processor -- start 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f109cb5a640 1 -- start start 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f109cb5a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10980b45a0 0x7f10980a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f109cb5a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10980bdee0 0x7f1098141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f109cb5a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1098148c30 0x7f10981447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f109cb5a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10980bb4f0 con 0x7f10980bdee0 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f109cb5a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10980a2230 con 0x7f1098148c30 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f109cb5a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1098144370 con 0x7f10980b45a0 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f108ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10980bdee0 0x7f1098141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f108ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10980bdee0 0x7f1098141f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36336/0 (socket says 172.21.15.88:36336) 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f108ffff640 1 -- 172.21.15.88:0/1787856230 learned_addr learned my addr 172.21.15.88:0/1787856230 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:25.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f109659c640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10980b45a0 0x7f10980a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.650+0000 7f1096d9d640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1098148c30 0x7f10981447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.651+0000 7f108ffff640 1 -- 172.21.15.88:0/1787856230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10980b45a0 msgr2=0x7f10980a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.651+0000 7f108ffff640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10980b45a0 0x7f10980a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.651+0000 7f108ffff640 1 -- 172.21.15.88:0/1787856230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1098148c30 msgr2=0x7f10981447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.651+0000 7f108ffff640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1098148c30 0x7f10981447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.651+0000 7f108ffff640 1 -- 172.21.15.88:0/1787856230 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10880094d0 con 0x7f10980bdee0 2024-01-22T10:13:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.651+0000 7f108ffff640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10980bdee0 0x7f1098141f30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f108000b3e0 tx=0x7f108000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.651+0000 7f108effd640 1 -- 172.21.15.88:0/1787856230 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080011830 con 0x7f10980bdee0 2024-01-22T10:13:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.651+0000 7f108effd640 1 -- 172.21.15.88:0/1787856230 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10800119b0 con 0x7f10980bdee0 2024-01-22T10:13:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.651+0000 7f108effd640 1 -- 172.21.15.88:0/1787856230 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080011da0 con 0x7f10980bdee0 2024-01-22T10:13:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.651+0000 7f109cb5a640 1 -- 172.21.15.88:0/1787856230 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109813f860 con 0x7f10980bdee0 2024-01-22T10:13:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.651+0000 7f109cb5a640 1 -- 172.21.15.88:0/1787856230 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10981460c0 con 0x7f10980bdee0 2024-01-22T10:13:25.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.652+0000 7f109cb5a640 1 -- 172.21.15.88:0/1787856230 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10980b42e0 con 0x7f10980bdee0 2024-01-22T10:13:25.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.652+0000 7f108effd640 1 -- 172.21.15.88:0/1787856230 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f108001a410 con 0x7f10980bdee0 2024-01-22T10:13:25.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.652+0000 7f108effd640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f107806b330 0x7f107806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:25.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.653+0000 7f108effd640 1 -- 172.21.15.88:0/1787856230 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1080089b00 con 0x7f10980bdee0 2024-01-22T10:13:25.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.653+0000 7f109659c640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f107806b330 0x7f107806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:25.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.653+0000 7f109659c640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f107806b330 0x7f107806d7f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1088036000 tx=0x7f108803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:25.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.657+0000 7f108effd640 1 -- 172.21.15.88:0/1787856230 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f10980b42e0 con 0x7f10980bdee0 2024-01-22T10:13:25.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:25.890+0000 7f109cb5a640 1 -- 172.21.15.88:0/1787856230 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f10981444e0 con 0x7f10980bdee0 2024-01-22T10:13:26.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.508+0000 7f108effd640 1 -- 172.21.15.88:0/1787856230 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v47) v1 ==== 166+0+0 (secure 0 0 0) 0x7f10981444e0 con 0x7f10980bdee0 2024-01-22T10:13:26.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.511+0000 7f109cb5a640 1 -- 172.21.15.88:0/1787856230 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f107806b330 msgr2=0x7f107806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:26.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.511+0000 7f109cb5a640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f107806b330 0x7f107806d7f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1088036000 tx=0x7f108803b040 comp rx=0 tx=0).stop 2024-01-22T10:13:26.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.511+0000 7f109cb5a640 1 -- 172.21.15.88:0/1787856230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10980bdee0 msgr2=0x7f1098141f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:26.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.511+0000 7f109cb5a640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10980bdee0 0x7f1098141f30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f108000b3e0 tx=0x7f108000b8a0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.511+0000 7f109cb5a640 1 -- 172.21.15.88:0/1787856230 shutdown_connections 2024-01-22T10:13:26.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.511+0000 7f109cb5a640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f107806b330 0x7f107806d7f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.511+0000 7f109cb5a640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1098148c30 0x7f10981447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.511+0000 7f109cb5a640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10980bdee0 0x7f1098141f30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.511+0000 7f109cb5a640 1 --2- 172.21.15.88:0/1787856230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f10980b45a0 0x7f10980a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.511+0000 7f109cb5a640 1 -- 172.21.15.88:0/1787856230 >> 172.21.15.88:0/1787856230 conn(0x7f10980a2b70 msgr2=0x7f1098147ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:26.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.511+0000 7f109cb5a640 1 -- 172.21.15.88:0/1787856230 shutdown_connections 2024-01-22T10:13:26.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.511+0000 7f109cb5a640 1 -- 172.21.15.88:0/1787856230 wait complete. 2024-01-22T10:13:26.507 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-22T10:13:26.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.632+0000 7f8c8eaee640 1 Processor -- start 2024-01-22T10:13:26.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.632+0000 7f8c8eaee640 1 -- start start 2024-01-22T10:13:26.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c8eaee640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c880b8920 0x7f8c8814ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:26.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c8eaee640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c8814a9e0 0x7f8c8814ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:26.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c8eaee640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c880b37e0 con 0x7f8c8814b390 2024-01-22T10:13:26.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c8eaee640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c880b5570 con 0x7f8c880b8920 2024-01-22T10:13:26.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c8eaee640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8814b820 con 0x7f8c8814a9e0 2024-01-22T10:13:26.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c8d08b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8c8814b390 0x7f8c880b95e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58604/0 (socket says 172.21.15.88:58604) 2024-01-22T10:13:26.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c8d08b640 1 -- 172.21.15.88:0/4276638452 learned_addr learned my addr 172.21.15.88:0/4276638452 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:26.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660747265 0 0) 0x7f8c880b37e0 con 0x7f8c8814b390 2024-01-22T10:13:26.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c87fff640 1 --2- 172.21.15.88:0/4276638452 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c8814a9e0 0x7f8c8814ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:26.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c8c88a640 1 --2- 172.21.15.88:0/4276638452 >> v2:172.21.15.119:3300/0 conn(0x7f8c880b8920 0x7f8c8814ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:26.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c70003520 con 0x7f8c8814b390 2024-01-22T10:13:26.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1797528670 0 0) 0x7f8c70003520 con 0x7f8c8814b390 2024-01-22T10:13:26.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c8814a9e0 msgr2=0x7f8c8814ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:26.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c877fe640 1 --2- 172.21.15.88:0/4276638452 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c8814a9e0 0x7f8c8814ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 >> v2:172.21.15.119:3300/0 conn(0x7f8c880b8920 msgr2=0x7f8c8814ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:26.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c877fe640 1 --2- 172.21.15.88:0/4276638452 >> v2:172.21.15.119:3300/0 conn(0x7f8c880b8920 0x7f8c8814ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c880a1e40 con 0x7f8c8814b390 2024-01-22T10:13:26.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f8c800019f0 con 0x7f8c8814b390 2024-01-22T10:13:26.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.633+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 >> v1:172.21.15.88:6789/0 conn(0x7f8c8814b390 legacy=0x7f8c880b95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:26.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c877fe640 1 --2- 172.21.15.88:0/4276638452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c70003a50 0x7f8c70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:26.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c877fe640 1 --2- 172.21.15.88:0/4276638452 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c8814a9e0 0x7f8c700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:26.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c877fe640 1 --2- 172.21.15.88:0/4276638452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c70004d00 0x7f8c70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c880b5570 con 0x7f8c70003a50 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8814b820 con 0x7f8c70004d00 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7000ba50 con 0x7f8c8814a9e0 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c8c88a640 1 --2- 172.21.15.88:0/4276638452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c70003a50 0x7f8c70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c87fff640 1 --2- 172.21.15.88:0/4276638452 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c8814a9e0 0x7f8c700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c8d08b640 1 --2- 172.21.15.88:0/4276638452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c70004d00 0x7f8c70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c8c88a640 1 -- 172.21.15.88:0/4276638452 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c8814a9e0 msgr2=0x7f8c700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c8c88a640 1 --2- 172.21.15.88:0/4276638452 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c8814a9e0 0x7f8c700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c8c88a640 1 -- 172.21.15.88:0/4276638452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c70004d00 msgr2=0x7f8c70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c8c88a640 1 --2- 172.21.15.88:0/4276638452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c70004d00 0x7f8c70005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.634+0000 7f8c8c88a640 1 -- 172.21.15.88:0/4276638452 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c70003520 con 0x7f8c70003a50 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.635+0000 7f8c8c88a640 1 --2- 172.21.15.88:0/4276638452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c70003a50 0x7f8c70003e70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009ac0 tx=0x7f8c700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af369d1f98334a85 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.635+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7802c630 con 0x7f8c70003a50 2024-01-22T10:13:26.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.635+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7802c790 con 0x7f8c70003a50 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.635+0000 7f8c877fe640 1 -- 172.21.15.88:0/4276638452 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7802cb20 con 0x7f8c70003a50 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.635+0000 7f8c8eaee640 1 -- 172.21.15.88:0/4276638452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c70003a50 msgr2=0x7f8c70003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.635+0000 7f8c8eaee640 1 --2- 172.21.15.88:0/4276638452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c70003a50 0x7f8c70003e70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009ac0 tx=0x7f8c700057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.635+0000 7f8c8d08b640 1 -- 172.21.15.88:0/4276638452 reap_dead start 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.635+0000 7f8c8eaee640 1 -- 172.21.15.88:0/4276638452 shutdown_connections 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.635+0000 7f8c8eaee640 1 -- 172.21.15.88:0/4276638452 >> 172.21.15.88:0/4276638452 conn(0x7f8c8806a6f0 msgr2=0x7f8c8806ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.635+0000 7f8c8eaee640 1 -- 172.21.15.88:0/4276638452 shutdown_connections 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.635+0000 7f8c8eaee640 1 -- 172.21.15.88:0/4276638452 wait complete. 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.636+0000 7f8c8eaee640 1 Processor -- start 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.636+0000 7f8c8eaee640 1 -- start start 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8eaee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c70003a50 0x7f8c88144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8eaee640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c88071760 0x7f8c88071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8eaee640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c88070370 0x7f8c880707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8eaee640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c88144b80 con 0x7f8c88070370 2024-01-22T10:13:26.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8eaee640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8806f5e0 con 0x7f8c70003a50 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8eaee640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8806f880 con 0x7f8c88071760 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8d08b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c88070370 0x7f8c880707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8d08b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c88070370 0x7f8c880707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36348/0 (socket says 172.21.15.88:36348) 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8d08b640 1 -- 172.21.15.88:0/2937466179 learned_addr learned my addr 172.21.15.88:0/2937466179 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8d08b640 1 -- 172.21.15.88:0/2937466179 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c88071760 msgr2=0x7f8c88071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8d08b640 1 --2- 172.21.15.88:0/2937466179 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c88071760 0x7f8c88071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8d08b640 1 -- 172.21.15.88:0/2937466179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c70003a50 msgr2=0x7f8c88144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8d08b640 1 --2- 172.21.15.88:0/2937466179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c70003a50 0x7f8c88144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.637+0000 7f8c8d08b640 1 -- 172.21.15.88:0/2937466179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8806fb60 con 0x7f8c88070370 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.638+0000 7f8c8d08b640 1 --2- 172.21.15.88:0/2937466179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c88070370 0x7f8c880707d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c80000f80 tx=0x7f8c8000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.638+0000 7f8c857fa640 1 -- 172.21.15.88:0/2937466179 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000eb90 con 0x7f8c88070370 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.638+0000 7f8c857fa640 1 -- 172.21.15.88:0/2937466179 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8000ed10 con 0x7f8c88070370 2024-01-22T10:13:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.638+0000 7f8c857fa640 1 -- 172.21.15.88:0/2937466179 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c80013660 con 0x7f8c88070370 2024-01-22T10:13:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.638+0000 7f8c8eaee640 1 -- 172.21.15.88:0/2937466179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8806fe40 con 0x7f8c88070370 2024-01-22T10:13:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.638+0000 7f8c8eaee640 1 -- 172.21.15.88:0/2937466179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c88070d10 con 0x7f8c88070370 2024-01-22T10:13:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.639+0000 7f8c8eaee640 1 -- 172.21.15.88:0/2937466179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c880bd290 con 0x7f8c88070370 2024-01-22T10:13:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.639+0000 7f8c857fa640 1 -- 172.21.15.88:0/2937466179 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f8c800137c0 con 0x7f8c88070370 2024-01-22T10:13:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.639+0000 7f8c857fa640 1 --2- 172.21.15.88:0/2937466179 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f8c7406b2d0 0x7f8c7406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.640+0000 7f8c857fa640 1 -- 172.21.15.88:0/2937466179 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c80089ef0 con 0x7f8c88070370 2024-01-22T10:13:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.640+0000 7f8c8c88a640 1 --2- 172.21.15.88:0/2937466179 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f8c7406b2d0 0x7f8c7406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.640+0000 7f8c8c88a640 1 --2- 172.21.15.88:0/2937466179 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f8c7406b2d0 0x7f8c7406d790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8c78036000 tx=0x7f8c7802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:26.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.644+0000 7f8c857fa640 1 -- 172.21.15.88:0/2937466179 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8c80054c10 con 0x7f8c88070370 2024-01-22T10:13:26.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.814+0000 7f8c8eaee640 1 -- 172.21.15.88:0/2937466179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8c8804ea30 con 0x7f8c88070370 2024-01-22T10:13:26.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.819+0000 7f8c857fa640 1 -- 172.21.15.88:0/2937466179 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8c80058230 con 0x7f8c88070370 2024-01-22T10:13:26.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.821+0000 7f8c8eaee640 1 -- 172.21.15.88:0/2937466179 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f8c7406b2d0 msgr2=0x7f8c7406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:26.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.821+0000 7f8c8eaee640 1 --2- 172.21.15.88:0/2937466179 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f8c7406b2d0 0x7f8c7406d790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8c78036000 tx=0x7f8c7802e000 comp rx=0 tx=0).stop 2024-01-22T10:13:26.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.821+0000 7f8c8eaee640 1 -- 172.21.15.88:0/2937466179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c88070370 msgr2=0x7f8c880707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:26.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.821+0000 7f8c8eaee640 1 --2- 172.21.15.88:0/2937466179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c88070370 0x7f8c880707d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c80000f80 tx=0x7f8c8000e530 comp rx=0 tx=0).stop 2024-01-22T10:13:26.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.821+0000 7f8c8eaee640 1 -- 172.21.15.88:0/2937466179 shutdown_connections 2024-01-22T10:13:26.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.821+0000 7f8c8eaee640 1 --2- 172.21.15.88:0/2937466179 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f8c7406b2d0 0x7f8c7406d790 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.821+0000 7f8c8eaee640 1 --2- 172.21.15.88:0/2937466179 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c88071760 0x7f8c88071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.821+0000 7f8c8eaee640 1 --2- 172.21.15.88:0/2937466179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c88070370 0x7f8c880707d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.821+0000 7f8c8eaee640 1 --2- 172.21.15.88:0/2937466179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c70003a50 0x7f8c88144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:26.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.821+0000 7f8c8eaee640 1 -- 172.21.15.88:0/2937466179 >> 172.21.15.88:0/2937466179 conn(0x7f8c8806a6f0 msgr2=0x7f8c880bcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:26.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.821+0000 7f8c8eaee640 1 -- 172.21.15.88:0/2937466179 shutdown_connections 2024-01-22T10:13:26.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:26.821+0000 7f8c8eaee640 1 -- 172.21.15.88:0/2937466179 wait complete. 2024-01-22T10:13:26.814 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-22T10:13:26.814 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T10:13:26.920 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T10:13:27.000 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-22T10:13:27.116 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-22T10:13:27.116 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:13:27.116 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-22T10:13:27.167 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:13:27.167 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-22T10:13:27.263 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:13:27.263 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-22T10:13:27.314 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:27.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.433+0000 7f2ce5da9640 1 Processor -- start 2024-01-22T10:13:27.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.433+0000 7f2ce5da9640 1 -- start start 2024-01-22T10:13:27.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2ce5da9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2ce00b49c0 0x7f2ce014b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2ce5da9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce014c2b0 con 0x7f2ce00b3630 2024-01-22T10:13:27.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2ce5da9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce00bd930 con 0x7f2ce014bea0 2024-01-22T10:13:27.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2ce5da9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce00b5370 con 0x7f2ce00b49c0 2024-01-22T10:13:27.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cdf7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2ce00b3630 0x7f2ce00bd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58608/0 (socket says 172.21.15.88:58608) 2024-01-22T10:13:27.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cdf7fe640 1 -- 172.21.15.88:0/1179570466 learned_addr learned my addr 172.21.15.88:0/1179570466 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:27.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450357079 0 0) 0x7f2ce014c2b0 con 0x7f2ce00b3630 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc8003520 con 0x7f2ce00b3630 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cdeffd640 1 --2- 172.21.15.88:0/1179570466 >> v2:172.21.15.119:3300/0 conn(0x7f2ce00b49c0 0x7f2ce014b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 385643453 0 0) 0x7f2cc8003520 con 0x7f2ce00b3630 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 >> v2:172.21.15.119:3300/0 conn(0x7f2ce00b49c0 msgr2=0x7f2ce014b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 --2- 172.21.15.88:0/1179570466 >> v2:172.21.15.119:3300/0 conn(0x7f2ce00b49c0 0x7f2ce014b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 >> v1:172.21.15.119:6789/0 conn(0x7f2ce014bea0 legacy=0x7f2ce0152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce00b4e80 con 0x7f2ce00b3630 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f2cd0001670 con 0x7f2ce00b3630 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cdeffd640 1 --2- 172.21.15.88:0/1179570466 >> v2:172.21.15.119:3300/0 conn(0x7f2ce00b49c0 0x7f2ce014b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 >> v1:172.21.15.88:6789/0 conn(0x7f2ce00b3630 legacy=0x7f2ce00bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 --2- 172.21.15.88:0/1179570466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cc8003a50 0x7f2cc8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 --2- 172.21.15.88:0/1179570466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cc80047c0 0x7f2cc8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 --2- 172.21.15.88:0/1179570466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cc80052a0 0x7f2cc800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc800c170 con 0x7f2cc80047c0 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc800c2e0 con 0x7f2cc80052a0 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc800c4a0 con 0x7f2cc8003a50 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.434+0000 7f2cdeffd640 1 --2- 172.21.15.88:0/1179570466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cc80047c0 0x7f2cc8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.435+0000 7f2cdffff640 1 --2- 172.21.15.88:0/1179570466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cc80052a0 0x7f2cc800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.435+0000 7f2cdf7fe640 1 --2- 172.21.15.88:0/1179570466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cc8003a50 0x7f2cc8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.435+0000 7f2cdeffd640 1 -- 172.21.15.88:0/1179570466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cc8003a50 msgr2=0x7f2cc8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.435+0000 7f2cdeffd640 1 --2- 172.21.15.88:0/1179570466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cc8003a50 0x7f2cc8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.435+0000 7f2cdeffd640 1 -- 172.21.15.88:0/1179570466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cc80052a0 msgr2=0x7f2cc800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.435+0000 7f2cdeffd640 1 --2- 172.21.15.88:0/1179570466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cc80052a0 0x7f2cc800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.435+0000 7f2cdffff640 1 -- 172.21.15.88:0/1179570466 reap_dead start 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.435+0000 7f2cdeffd640 1 -- 172.21.15.88:0/1179570466 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc8003520 con 0x7f2cc80047c0 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.435+0000 7f2cdeffd640 1 --2- 172.21.15.88:0/1179570466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cc80047c0 0x7f2cc8004c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40098a0 tx=0x7f2cc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a06f26b7417130 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:27.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.436+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4004230 con 0x7f2cc80047c0 2024-01-22T10:13:27.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.436+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd4004390 con 0x7f2cc80047c0 2024-01-22T10:13:27.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.436+0000 7f2cde7fc640 1 -- 172.21.15.88:0/1179570466 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4003830 con 0x7f2cc80047c0 2024-01-22T10:13:27.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.436+0000 7f2ce5da9640 1 -- 172.21.15.88:0/1179570466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cc80047c0 msgr2=0x7f2cc8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.436+0000 7f2ce5da9640 1 --2- 172.21.15.88:0/1179570466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cc80047c0 0x7f2cc8004c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40098a0 tx=0x7f2cc80057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.436+0000 7f2ce5da9640 1 -- 172.21.15.88:0/1179570466 shutdown_connections 2024-01-22T10:13:27.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.436+0000 7f2ce5da9640 1 --2- 172.21.15.88:0/1179570466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cc80047c0 0x7f2cc8004c40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.436+0000 7f2ce5da9640 1 -- 172.21.15.88:0/1179570466 >> 172.21.15.88:0/1179570466 conn(0x7f2ce006acf0 msgr2=0x7f2ce00bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:27.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.436+0000 7f2ce5da9640 1 -- 172.21.15.88:0/1179570466 shutdown_connections 2024-01-22T10:13:27.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.436+0000 7f2ce5da9640 1 -- 172.21.15.88:0/1179570466 wait complete. 2024-01-22T10:13:27.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.437+0000 7f2ce5da9640 1 Processor -- start 2024-01-22T10:13:27.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.437+0000 7f2ce5da9640 1 -- start start 2024-01-22T10:13:27.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2ce5da9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cc80047c0 0x7f2ce01d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2ce5da9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce0141980 0x7f2ce01d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2ce5da9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce01d22f0 0x7f2ce01400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2ce5da9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce01495f0 con 0x7f2ce0141980 2024-01-22T10:13:27.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2ce5da9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce0141de0 con 0x7f2ce01d22f0 2024-01-22T10:13:27.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2ce5da9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce01d5c50 con 0x7f2cc80047c0 2024-01-22T10:13:27.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2cdeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce0141980 0x7f2ce01d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2cdeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce0141980 0x7f2ce01d1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54074/0 (socket says 172.21.15.88:54074) 2024-01-22T10:13:27.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2cdeffd640 1 -- 172.21.15.88:0/3751352257 learned_addr learned my addr 172.21.15.88:0/3751352257 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:27.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2cdf7fe640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cc80047c0 0x7f2ce01d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2cdffff640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce01d22f0 0x7f2ce01400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2cdeffd640 1 -- 172.21.15.88:0/3751352257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cc80047c0 msgr2=0x7f2ce01d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2cdeffd640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cc80047c0 0x7f2ce01d32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2cdeffd640 1 -- 172.21.15.88:0/3751352257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce01d22f0 msgr2=0x7f2ce01400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2cdeffd640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce01d22f0 0x7f2ce01400a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.438+0000 7f2cdeffd640 1 -- 172.21.15.88:0/3751352257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce01d4060 con 0x7f2ce0141980 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.439+0000 7f2cdeffd640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce0141980 0x7f2ce01d1db0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40099c0 tx=0x7f2cd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.439+0000 7f2cc7fff640 1 -- 172.21.15.88:0/3751352257 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4030630 con 0x7f2ce0141980 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.439+0000 7f2cc7fff640 1 -- 172.21.15.88:0/3751352257 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd4030790 con 0x7f2ce0141980 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.439+0000 7f2ce5da9640 1 -- 172.21.15.88:0/3751352257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce01d4bd0 con 0x7f2ce0141980 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.439+0000 7f2cc7fff640 1 -- 172.21.15.88:0/3751352257 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4030b20 con 0x7f2ce0141980 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.439+0000 7f2ce5da9640 1 -- 172.21.15.88:0/3751352257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce01d3d50 con 0x7f2ce0141980 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.440+0000 7f2ce5da9640 1 -- 172.21.15.88:0/3751352257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce01d5ab0 con 0x7f2ce0141980 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.440+0000 7f2cc7fff640 1 -- 172.21.15.88:0/3751352257 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f2cd4030c80 con 0x7f2ce0141980 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.440+0000 7f2cc7fff640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2ccc06b360 0x7f2ccc06d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.440+0000 7f2cc7fff640 1 -- 172.21.15.88:0/3751352257 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cd40abb20 con 0x7f2ce0141980 2024-01-22T10:13:27.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.440+0000 7f2cdf7fe640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2ccc06b360 0x7f2ccc06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.441+0000 7f2cdf7fe640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2ccc06b360 0x7f2ccc06d820 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0001eb0 tx=0x7f2cd0001d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:27.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.445+0000 7f2cc7fff640 1 -- 172.21.15.88:0/3751352257 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2ce01d5ab0 con 0x7f2ce0141980 2024-01-22T10:13:27.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.618+0000 7f2ce5da9640 1 -- 172.21.15.88:0/3751352257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ce01d5ab0 con 0x7f2ce0141980 2024-01-22T10:13:27.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.619+0000 7f2cc7fff640 1 -- 172.21.15.88:0/3751352257 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f2ce01d5ab0 con 0x7f2ce0141980 2024-01-22T10:13:27.602 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:27.602 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.621+0000 7f2ce5da9640 1 -- 172.21.15.88:0/3751352257 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2ccc06b360 msgr2=0x7f2ccc06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.621+0000 7f2ce5da9640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2ccc06b360 0x7f2ccc06d820 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0001eb0 tx=0x7f2cd0001d40 comp rx=0 tx=0).stop 2024-01-22T10:13:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.621+0000 7f2ce5da9640 1 -- 172.21.15.88:0/3751352257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce0141980 msgr2=0x7f2ce01d1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.621+0000 7f2ce5da9640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce0141980 0x7f2ce01d1db0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40099c0 tx=0x7f2cd4004730 comp rx=0 tx=0).stop 2024-01-22T10:13:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.621+0000 7f2ce5da9640 1 -- 172.21.15.88:0/3751352257 shutdown_connections 2024-01-22T10:13:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.621+0000 7f2ce5da9640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2ccc06b360 0x7f2ccc06d820 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.621+0000 7f2ce5da9640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce01d22f0 0x7f2ce01400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.621+0000 7f2ce5da9640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce0141980 0x7f2ce01d1db0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.621+0000 7f2ce5da9640 1 --2- 172.21.15.88:0/3751352257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cc80047c0 0x7f2ce01d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.621+0000 7f2ce5da9640 1 -- 172.21.15.88:0/3751352257 >> 172.21.15.88:0/3751352257 conn(0x7f2ce006acf0 msgr2=0x7f2ce00ba9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:27.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.621+0000 7f2ce5da9640 1 -- 172.21.15.88:0/3751352257 shutdown_connections 2024-01-22T10:13:27.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.621+0000 7f2ce5da9640 1 -- 172.21.15.88:0/3751352257 wait complete. 2024-01-22T10:13:27.614 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T10:13:00.844842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T10:13:01.816849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:13:27.615 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:13:27.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.735+0000 7f2c73d68640 1 Processor -- start 2024-01-22T10:13:27.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.735+0000 7f2c73d68640 1 -- start start 2024-01-22T10:13:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c73d68640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c6c14b940 0x7f2c6c0bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c73d68640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c0bb7e0 con 0x7f2c6c149010 2024-01-22T10:13:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c73d68640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c14bd90 con 0x7f2c6c0b44f0 2024-01-22T10:13:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c73d68640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c0bc1b0 con 0x7f2c6c14b940 2024-01-22T10:13:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c71b04640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2c6c149010 0x7f2c6c0a2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42048/0 (socket says 172.21.15.88:42048) 2024-01-22T10:13:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c71b04640 1 -- 172.21.15.88:0/2953911330 learned_addr learned my addr 172.21.15.88:0/2953911330 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c72305640 1 --2- 172.21.15.88:0/2953911330 >> v2:172.21.15.119:3300/0 conn(0x7f2c6c14b940 0x7f2c6c0bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604876265 0 0) 0x7f2c6c0bb7e0 con 0x7f2c6c149010 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c58003520 con 0x7f2c6c149010 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2695677227 0 0) 0x7f2c58003520 con 0x7f2c6c149010 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 >> v2:172.21.15.119:3300/0 conn(0x7f2c6c14b940 msgr2=0x7f2c6c0bbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 --2- 172.21.15.88:0/2953911330 >> v2:172.21.15.119:3300/0 conn(0x7f2c6c14b940 0x7f2c6c0bbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 >> v1:172.21.15.119:6789/0 conn(0x7f2c6c0b44f0 legacy=0x7f2c6c154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0c04e0 con 0x7f2c6c149010 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f2c68001670 con 0x7f2c6c149010 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 >> v1:172.21.15.88:6789/0 conn(0x7f2c6c149010 legacy=0x7f2c6c0a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c58003970 0x7f2c58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c580047c0 0x7f2c58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c58005180 0x7f2c5800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0bc1b0 con 0x7f2c58005180 2024-01-22T10:13:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5800c030 con 0x7f2c580047c0 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5800c1f0 con 0x7f2c58003970 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c72305640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c58005180 0x7f2c5800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c71b04640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c58003970 0x7f2c58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.736+0000 7f2c71303640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c580047c0 0x7f2c58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.737+0000 7f2c72305640 1 -- 172.21.15.88:0/2953911330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c58003970 msgr2=0x7f2c58003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.737+0000 7f2c72305640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c58003970 0x7f2c58003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.737+0000 7f2c72305640 1 -- 172.21.15.88:0/2953911330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c580047c0 msgr2=0x7f2c58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.737+0000 7f2c72305640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c580047c0 0x7f2c58004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.737+0000 7f2c72305640 1 -- 172.21.15.88:0/2953911330 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c58003520 con 0x7f2c58005180 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.737+0000 7f2c71b04640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c58003970 0x7f2c58003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.737+0000 7f2c71303640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c580047c0 0x7f2c58004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.737+0000 7f2c72305640 1 -- 172.21.15.88:0/2953911330 reap_dead start 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.737+0000 7f2c72305640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c58005180 0x7f2c5800b980 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009fc0 tx=0x7f2c580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7940b285a80ff15b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.737+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6402cc60 con 0x7f2c58005180 2024-01-22T10:13:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.737+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6400f040 con 0x7f2c58005180 2024-01-22T10:13:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.737+0000 7f2c70b02640 1 -- 172.21.15.88:0/2953911330 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c64003990 con 0x7f2c58005180 2024-01-22T10:13:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.738+0000 7f2c73d68640 1 -- 172.21.15.88:0/2953911330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c58005180 msgr2=0x7f2c5800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.738+0000 7f2c73d68640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c58005180 0x7f2c5800b980 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009fc0 tx=0x7f2c580057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.738+0000 7f2c73d68640 1 -- 172.21.15.88:0/2953911330 shutdown_connections 2024-01-22T10:13:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.738+0000 7f2c73d68640 1 --2- 172.21.15.88:0/2953911330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c58005180 0x7f2c5800b980 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.738+0000 7f2c73d68640 1 -- 172.21.15.88:0/2953911330 >> 172.21.15.88:0/2953911330 conn(0x7f2c6c0c1040 msgr2=0x7f2c6c0c1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.738+0000 7f2c73d68640 1 -- 172.21.15.88:0/2953911330 shutdown_connections 2024-01-22T10:13:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.738+0000 7f2c73d68640 1 -- 172.21.15.88:0/2953911330 wait complete. 2024-01-22T10:13:27.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.739+0000 7f2c73d68640 1 Processor -- start 2024-01-22T10:13:27.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.739+0000 7f2c73d68640 1 -- start start 2024-01-22T10:13:27.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c73d68640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c58005180 0x7f2c6c1e4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c73d68640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c09ed50 0x7f2c6c0b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c73d68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c09f1d0 0x7f2c6c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c73d68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0a0340 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c73d68640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0b3d70 con 0x7f2c6c09ed50 2024-01-22T10:13:27.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c73d68640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0a0060 con 0x7f2c58005180 2024-01-22T10:13:27.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c72305640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c09f1d0 0x7f2c6c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c72305640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c09f1d0 0x7f2c6c0b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54100/0 (socket says 172.21.15.88:54100) 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c72305640 1 -- 172.21.15.88:0/2470731410 learned_addr learned my addr 172.21.15.88:0/2470731410 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c71b04640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c58005180 0x7f2c6c1e4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c71303640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c09ed50 0x7f2c6c0b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c72305640 1 -- 172.21.15.88:0/2470731410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c58005180 msgr2=0x7f2c6c1e4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c72305640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c58005180 0x7f2c6c1e4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c72305640 1 -- 172.21.15.88:0/2470731410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c09ed50 msgr2=0x7f2c6c0b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c72305640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c09ed50 0x7f2c6c0b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c72305640 1 -- 172.21.15.88:0/2470731410 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c09cb50 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c71303640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c09ed50 0x7f2c6c0b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c72305640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c09f1d0 0x7f2c6c0b3830 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400e200 tx=0x7f2c64009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c627fc640 1 -- 172.21.15.88:0/2470731410 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c64003da0 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c627fc640 1 -- 172.21.15.88:0/2470731410 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c64035980 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c73d68640 1 -- 172.21.15.88:0/2470731410 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c09ce30 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c627fc640 1 -- 172.21.15.88:0/2470731410 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c64035d30 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.740+0000 7f2c73d68640 1 -- 172.21.15.88:0/2470731410 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c09a610 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.741+0000 7f2c73d68640 1 -- 172.21.15.88:0/2470731410 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c09cfc0 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.742+0000 7f2c627fc640 1 -- 172.21.15.88:0/2470731410 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f2c64004030 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.742+0000 7f2c627fc640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2c5006b360 0x7f2c5006d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:27.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.742+0000 7f2c71b04640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2c5006b360 0x7f2c5006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:27.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.742+0000 7f2c627fc640 1 -- 172.21.15.88:0/2470731410 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c640ac750 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.743+0000 7f2c71b04640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2c5006b360 0x7f2c5006d820 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2c68001200 tx=0x7f2c68007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:27.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.747+0000 7f2c627fc640 1 -- 172.21.15.88:0/2470731410 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2c64077470 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.914+0000 7f2c73d68640 1 -- 172.21.15.88:0/2470731410 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c6c04ea30 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.914+0000 7f2c627fc640 1 -- 172.21.15.88:0/2470731410 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c6407aa90 con 0x7f2c6c09f1d0 2024-01-22T10:13:27.897 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:13:27.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.916+0000 7f2c73d68640 1 -- 172.21.15.88:0/2470731410 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2c5006b360 msgr2=0x7f2c5006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.916+0000 7f2c73d68640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2c5006b360 0x7f2c5006d820 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2c68001200 tx=0x7f2c68007040 comp rx=0 tx=0).stop 2024-01-22T10:13:27.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.916+0000 7f2c73d68640 1 -- 172.21.15.88:0/2470731410 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c09f1d0 msgr2=0x7f2c6c0b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:27.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.916+0000 7f2c73d68640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c09f1d0 0x7f2c6c0b3830 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400e200 tx=0x7f2c64009750 comp rx=0 tx=0).stop 2024-01-22T10:13:27.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.916+0000 7f2c73d68640 1 -- 172.21.15.88:0/2470731410 shutdown_connections 2024-01-22T10:13:27.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.916+0000 7f2c73d68640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2c5006b360 0x7f2c5006d820 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.916+0000 7f2c73d68640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c6c09f1d0 0x7f2c6c0b3830 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.916+0000 7f2c73d68640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c6c09ed50 0x7f2c6c0b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.916+0000 7f2c73d68640 1 --2- 172.21.15.88:0/2470731410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c58005180 0x7f2c6c1e4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:27.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.916+0000 7f2c73d68640 1 -- 172.21.15.88:0/2470731410 >> 172.21.15.88:0/2470731410 conn(0x7f2c6c0c1040 msgr2=0x7f2c6c0c1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:27.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.916+0000 7f2c73d68640 1 -- 172.21.15.88:0/2470731410 shutdown_connections 2024-01-22T10:13:27.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:27.916+0000 7f2c73d68640 1 -- 172.21.15.88:0/2470731410 wait complete. 2024-01-22T10:13:27.909 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T10:13:28.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.028+0000 7f3d9161e640 1 Processor -- start 2024-01-22T10:13:28.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.029+0000 7f3d9161e640 1 -- start start 2024-01-22T10:13:28.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.029+0000 7f3d9161e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d8c071fc0 0x7f3d8c14bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.029+0000 7f3d9161e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c14eeb0 con 0x7f3d8c14c250 2024-01-22T10:13:28.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.029+0000 7f3d9161e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c14fa50 con 0x7f3d8c06a960 2024-01-22T10:13:28.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.029+0000 7f3d9161e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c070c60 con 0x7f3d8c071fc0 2024-01-22T10:13:28.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.029+0000 7f3d8a7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d8c071fc0 0x7f3d8c14bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.029+0000 7f3d8b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3d8c14c250 0x7f3d8c155f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42056/0 (socket says 172.21.15.88:42056) 2024-01-22T10:13:28.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.029+0000 7f3d8b7fe640 1 -- 172.21.15.88:0/3586977356 learned_addr learned my addr 172.21.15.88:0/3586977356 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:28.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.030+0000 7f3d8a7fc640 1 -- 172.21.15.88:0/3586977356 >> v1:172.21.15.119:6789/0 conn(0x7f3d8c06a960 legacy=0x7f3d8c14f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:28.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.030+0000 7f3d8a7fc640 1 -- 172.21.15.88:0/3586977356 >> v1:172.21.15.88:6789/0 conn(0x7f3d8c14c250 legacy=0x7f3d8c155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.030+0000 7f3d8a7fc640 1 -- 172.21.15.88:0/3586977356 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c14eb80 con 0x7f3d8c071fc0 2024-01-22T10:13:28.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.030+0000 7f3d89ffb640 1 -- 172.21.15.88:0/3586977356 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033295881 0 0) 0x7f3d8c14eeb0 con 0x7f3d8c14c250 2024-01-22T10:13:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.030+0000 7f3d8a7fc640 1 --2- 172.21.15.88:0/3586977356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c071fc0 0x7f3d8c14bd10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3d740097d0 tx=0x7f3d7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d53d8e4a23aa367 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.030+0000 7f3d89ffb640 1 -- 172.21.15.88:0/3586977356 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74031830 con 0x7f3d8c071fc0 2024-01-22T10:13:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.030+0000 7f3d89ffb640 1 -- 172.21.15.88:0/3586977356 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74031990 con 0x7f3d8c071fc0 2024-01-22T10:13:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.030+0000 7f3d89ffb640 1 -- 172.21.15.88:0/3586977356 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74031d20 con 0x7f3d8c071fc0 2024-01-22T10:13:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.031+0000 7f3d9161e640 1 -- 172.21.15.88:0/3586977356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c071fc0 msgr2=0x7f3d8c14bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.031+0000 7f3d9161e640 1 --2- 172.21.15.88:0/3586977356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c071fc0 0x7f3d8c14bd10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3d740097d0 tx=0x7f3d7402b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.031+0000 7f3d9161e640 1 -- 172.21.15.88:0/3586977356 shutdown_connections 2024-01-22T10:13:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.031+0000 7f3d9161e640 1 --2- 172.21.15.88:0/3586977356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c071fc0 0x7f3d8c14bd10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.031+0000 7f3d9161e640 1 -- 172.21.15.88:0/3586977356 >> 172.21.15.88:0/3586977356 conn(0x7f3d8c06e9b0 msgr2=0x7f3d8c06b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.031+0000 7f3d9161e640 1 -- 172.21.15.88:0/3586977356 shutdown_connections 2024-01-22T10:13:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.031+0000 7f3d9161e640 1 -- 172.21.15.88:0/3586977356 wait complete. 2024-01-22T10:13:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.032+0000 7f3d9161e640 1 Processor -- start 2024-01-22T10:13:28.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.032+0000 7f3d9161e640 1 -- start start 2024-01-22T10:13:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d9161e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c06a960 0x7f3d8c149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d9161e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c071fc0 0x7f3d8c1460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d9161e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c14c250 0x7f3d8c1419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d9161e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c146fb0 con 0x7f3d8c14c250 2024-01-22T10:13:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d9161e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c147220 con 0x7f3d8c06a960 2024-01-22T10:13:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d9161e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c147500 con 0x7f3d8c071fc0 2024-01-22T10:13:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d8b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c14c250 0x7f3d8c1419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d8b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c14c250 0x7f3d8c1419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54128/0 (socket says 172.21.15.88:54128) 2024-01-22T10:13:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d8b7fe640 1 -- 172.21.15.88:0/3329872173 learned_addr learned my addr 172.21.15.88:0/3329872173 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d8a7fc640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c071fc0 0x7f3d8c1460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d8affd640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c06a960 0x7f3d8c149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d8b7fe640 1 -- 172.21.15.88:0/3329872173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c071fc0 msgr2=0x7f3d8c1460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d8b7fe640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c071fc0 0x7f3d8c1460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d8b7fe640 1 -- 172.21.15.88:0/3329872173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c06a960 msgr2=0x7f3d8c149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d8b7fe640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c06a960 0x7f3d8c149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d8b7fe640 1 -- 172.21.15.88:0/3329872173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d74009400 con 0x7f3d8c14c250 2024-01-22T10:13:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d8b7fe640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c14c250 0x7f3d8c1419e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c780 tx=0x7f3d8400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.033+0000 7f3d837fe640 1 -- 172.21.15.88:0/3329872173 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400ce90 con 0x7f3d8c14c250 2024-01-22T10:13:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.034+0000 7f3d837fe640 1 -- 172.21.15.88:0/3329872173 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8400a640 con 0x7f3d8c14c250 2024-01-22T10:13:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.034+0000 7f3d9161e640 1 -- 172.21.15.88:0/3329872173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c0bc640 con 0x7f3d8c14c250 2024-01-22T10:13:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.034+0000 7f3d837fe640 1 -- 172.21.15.88:0/3329872173 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400a9d0 con 0x7f3d8c14c250 2024-01-22T10:13:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.034+0000 7f3d9161e640 1 -- 172.21.15.88:0/3329872173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c146a50 con 0x7f3d8c14c250 2024-01-22T10:13:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.035+0000 7f3d9161e640 1 -- 172.21.15.88:0/3329872173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c04ea30 con 0x7f3d8c14c250 2024-01-22T10:13:28.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.035+0000 7f3d837fe640 1 -- 172.21.15.88:0/3329872173 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f3d8400ab30 con 0x7f3d8c14c250 2024-01-22T10:13:28.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.035+0000 7f3d837fe640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f3d6c06b330 0x7f3d6c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.036+0000 7f3d8affd640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f3d6c06b330 0x7f3d6c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.036+0000 7f3d837fe640 1 -- 172.21.15.88:0/3329872173 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d84089300 con 0x7f3d8c14c250 2024-01-22T10:13:28.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.036+0000 7f3d8affd640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f3d6c06b330 0x7f3d6c06d7f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c004ea0 tx=0x7f3d7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:28.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.040+0000 7f3d837fe640 1 -- 172.21.15.88:0/3329872173 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3d84054020 con 0x7f3d8c14c250 2024-01-22T10:13:28.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.208+0000 7f3d9161e640 1 -- 172.21.15.88:0/3329872173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d8c148fb0 con 0x7f3d8c14c250 2024-01-22T10:13:28.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.208+0000 7f3d837fe640 1 -- 172.21.15.88:0/3329872173 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d84057640 con 0x7f3d8c14c250 2024-01-22T10:13:28.191 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-01-22T10:13:28.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.210+0000 7f3d9161e640 1 -- 172.21.15.88:0/3329872173 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f3d6c06b330 msgr2=0x7f3d6c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.210+0000 7f3d9161e640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f3d6c06b330 0x7f3d6c06d7f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c004ea0 tx=0x7f3d7c009040 comp rx=0 tx=0).stop 2024-01-22T10:13:28.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.210+0000 7f3d9161e640 1 -- 172.21.15.88:0/3329872173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c14c250 msgr2=0x7f3d8c1419e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.210+0000 7f3d9161e640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c14c250 0x7f3d8c1419e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c780 tx=0x7f3d8400cc40 comp rx=0 tx=0).stop 2024-01-22T10:13:28.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.210+0000 7f3d9161e640 1 -- 172.21.15.88:0/3329872173 shutdown_connections 2024-01-22T10:13:28.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.210+0000 7f3d9161e640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f3d6c06b330 0x7f3d6c06d7f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.210+0000 7f3d9161e640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c071fc0 0x7f3d8c1460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.210+0000 7f3d9161e640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d8c14c250 0x7f3d8c1419e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.210+0000 7f3d9161e640 1 --2- 172.21.15.88:0/3329872173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c06a960 0x7f3d8c149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.210+0000 7f3d9161e640 1 -- 172.21.15.88:0/3329872173 >> 172.21.15.88:0/3329872173 conn(0x7f3d8c06e9b0 msgr2=0x7f3d8c0bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:28.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.210+0000 7f3d9161e640 1 -- 172.21.15.88:0/3329872173 shutdown_connections 2024-01-22T10:13:28.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.210+0000 7f3d9161e640 1 -- 172.21.15.88:0/3329872173 wait complete. 2024-01-22T10:13:28.203 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T10:13:28.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.323+0000 7fae83fbe640 1 Processor -- start 2024-01-22T10:13:28.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.323+0000 7fae83fbe640 1 -- start start 2024-01-22T10:13:28.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.324+0000 7fae83fbe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fae7c0727d0 0x7fae7c14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.324+0000 7fae83fbe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae7c0b5520 0x7fae7c14d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.324+0000 7fae83fbe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fae7c143040 0x7fae7c1434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.324+0000 7fae83fbe640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0b78a0 con 0x7fae7c0727d0 2024-01-22T10:13:28.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.324+0000 7fae83fbe640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0b6cd0 con 0x7fae7c143040 2024-01-22T10:13:28.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.324+0000 7fae83fbe640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0b6f70 con 0x7fae7c0b5520 2024-01-22T10:13:28.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.324+0000 7fae81d5a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fae7c0727d0 0x7fae7c14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.324+0000 7fae81d5a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fae7c0727d0 0x7fae7c14cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54142/0 (socket says 172.21.15.88:54142) 2024-01-22T10:13:28.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.324+0000 7fae81d5a640 1 -- 172.21.15.88:0/1896845242 learned_addr learned my addr 172.21.15.88:0/1896845242 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:28.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.324+0000 7fae81d5a640 1 -- 172.21.15.88:0/1896845242 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae7c0b5520 msgr2=0x7fae7c14d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:28.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.325+0000 7fae81d5a640 1 --2- 172.21.15.88:0/1896845242 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae7c0b5520 0x7fae7c14d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.325+0000 7fae81d5a640 1 -- 172.21.15.88:0/1896845242 >> v2:172.21.15.119:3300/0 conn(0x7fae7c143040 msgr2=0x7fae7c1434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:28.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.325+0000 7fae8255b640 1 --2- 172.21.15.88:0/1896845242 >> v2:172.21.15.119:3300/0 conn(0x7fae7c143040 0x7fae7c1434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.325+0000 7fae81d5a640 1 --2- 172.21.15.88:0/1896845242 >> v2:172.21.15.119:3300/0 conn(0x7fae7c143040 0x7fae7c1434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.325+0000 7fae81d5a640 1 -- 172.21.15.88:0/1896845242 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c0b7250 con 0x7fae7c0727d0 2024-01-22T10:13:28.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.325+0000 7fae8255b640 1 --2- 172.21.15.88:0/1896845242 >> v2:172.21.15.119:3300/0 conn(0x7fae7c143040 0x7fae7c1434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:28.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.325+0000 7fae81d5a640 1 --2- 172.21.15.88:0/1896845242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae7c0727d0 0x7fae7c14cba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0b5be0 tx=0x7fae6c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9fc21d5a870c58 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:28.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.325+0000 7fae80d58640 1 -- 172.21.15.88:0/1896845242 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c02cb00 con 0x7fae7c0727d0 2024-01-22T10:13:28.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.325+0000 7fae80d58640 1 -- 172.21.15.88:0/1896845242 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c02cc60 con 0x7fae7c0727d0 2024-01-22T10:13:28.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.325+0000 7fae80d58640 1 -- 172.21.15.88:0/1896845242 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0343f0 con 0x7fae7c0727d0 2024-01-22T10:13:28.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.326+0000 7fae83fbe640 1 -- 172.21.15.88:0/1896845242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae7c0727d0 msgr2=0x7fae7c14cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.326+0000 7fae83fbe640 1 --2- 172.21.15.88:0/1896845242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae7c0727d0 0x7fae7c14cba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0b5be0 tx=0x7fae6c02bf60 comp rx=0 tx=0).stop 2024-01-22T10:13:28.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.326+0000 7fae83fbe640 1 -- 172.21.15.88:0/1896845242 shutdown_connections 2024-01-22T10:13:28.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.326+0000 7fae83fbe640 1 --2- 172.21.15.88:0/1896845242 >> v2:172.21.15.119:3300/0 conn(0x7fae7c143040 0x7fae7c1434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.326+0000 7fae83fbe640 1 --2- 172.21.15.88:0/1896845242 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae7c0b5520 0x7fae7c14d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.326+0000 7fae83fbe640 1 --2- 172.21.15.88:0/1896845242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae7c0727d0 0x7fae7c14cba0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.326+0000 7fae83fbe640 1 -- 172.21.15.88:0/1896845242 >> 172.21.15.88:0/1896845242 conn(0x7fae7c06be30 msgr2=0x7fae7c0bdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:28.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.326+0000 7fae83fbe640 1 -- 172.21.15.88:0/1896845242 shutdown_connections 2024-01-22T10:13:28.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.326+0000 7fae83fbe640 1 -- 172.21.15.88:0/1896845242 wait complete. 2024-01-22T10:13:28.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.327+0000 7fae83fbe640 1 Processor -- start 2024-01-22T10:13:28.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.327+0000 7fae83fbe640 1 -- start start 2024-01-22T10:13:28.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae83fbe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae7c0727d0 0x7fae7c149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae83fbe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae7c0b5520 0x7fae7c144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae83fbe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae7c143040 0x7fae7c147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae83fbe640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c149a90 con 0x7fae7c0b5520 2024-01-22T10:13:28.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae83fbe640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c1447d0 con 0x7fae7c0727d0 2024-01-22T10:13:28.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae83fbe640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c072170 con 0x7fae7c143040 2024-01-22T10:13:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae81559640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae7c0b5520 0x7fae7c144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae81559640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae7c0b5520 0x7fae7c144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54152/0 (socket says 172.21.15.88:54152) 2024-01-22T10:13:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae81559640 1 -- 172.21.15.88:0/831610943 learned_addr learned my addr 172.21.15.88:0/831610943 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae8255b640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae7c143040 0x7fae7c147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae81d5a640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae7c0727d0 0x7fae7c149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae81559640 1 -- 172.21.15.88:0/831610943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae7c143040 msgr2=0x7fae7c147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae81559640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae7c143040 0x7fae7c147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae81559640 1 -- 172.21.15.88:0/831610943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae7c0727d0 msgr2=0x7fae7c149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae81559640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae7c0727d0 0x7fae7c149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae81559640 1 -- 172.21.15.88:0/831610943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c009b30 con 0x7fae7c0b5520 2024-01-22T10:13:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae81d5a640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae7c0727d0 0x7fae7c149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:28.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae81559640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae7c0b5520 0x7fae7c144290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fae7000b4a0 tx=0x7fae7000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae7a7fc640 1 -- 172.21.15.88:0/831610943 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70010610 con 0x7fae7c0b5520 2024-01-22T10:13:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae7a7fc640 1 -- 172.21.15.88:0/831610943 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70010770 con 0x7fae7c0b5520 2024-01-22T10:13:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae7a7fc640 1 -- 172.21.15.88:0/831610943 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70010b20 con 0x7fae7c0b5520 2024-01-22T10:13:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae83fbe640 1 -- 172.21.15.88:0/831610943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c1e0be0 con 0x7fae7c0b5520 2024-01-22T10:13:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.328+0000 7fae83fbe640 1 -- 172.21.15.88:0/831610943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c1e11a0 con 0x7fae7c0b5520 2024-01-22T10:13:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.329+0000 7fae83fbe640 1 -- 172.21.15.88:0/831610943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c04ea30 con 0x7fae7c0b5520 2024-01-22T10:13:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.330+0000 7fae7a7fc640 1 -- 172.21.15.88:0/831610943 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fae70010c80 con 0x7fae7c0b5520 2024-01-22T10:13:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.330+0000 7fae7a7fc640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fae6806b360 0x7fae6806d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.330+0000 7fae81d5a640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fae6806b360 0x7fae6806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.330+0000 7fae7a7fc640 1 -- 172.21.15.88:0/831610943 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae70089740 con 0x7fae7c0b5520 2024-01-22T10:13:28.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.331+0000 7fae81d5a640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fae6806b360 0x7fae6806d820 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae6c035000 tx=0x7fae6c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:28.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.335+0000 7fae7a7fc640 1 -- 172.21.15.88:0/831610943 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fae70054480 con 0x7fae7c0b5520 2024-01-22T10:13:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.503+0000 7fae83fbe640 1 -- 172.21.15.88:0/831610943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae7c14a3e0 con 0x7fae7c0b5520 2024-01-22T10:13:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.504+0000 7fae7a7fc640 1 -- 172.21.15.88:0/831610943 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae70014020 con 0x7fae7c0b5520 2024-01-22T10:13:28.487 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-01-22T10:13:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.506+0000 7fae83fbe640 1 -- 172.21.15.88:0/831610943 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fae6806b360 msgr2=0x7fae6806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.506+0000 7fae83fbe640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fae6806b360 0x7fae6806d820 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae6c035000 tx=0x7fae6c030000 comp rx=0 tx=0).stop 2024-01-22T10:13:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.506+0000 7fae83fbe640 1 -- 172.21.15.88:0/831610943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae7c0b5520 msgr2=0x7fae7c144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.506+0000 7fae83fbe640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae7c0b5520 0x7fae7c144290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fae7000b4a0 tx=0x7fae7000b960 comp rx=0 tx=0).stop 2024-01-22T10:13:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.506+0000 7fae83fbe640 1 -- 172.21.15.88:0/831610943 shutdown_connections 2024-01-22T10:13:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.506+0000 7fae83fbe640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fae6806b360 0x7fae6806d820 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.506+0000 7fae83fbe640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae7c143040 0x7fae7c147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.506+0000 7fae83fbe640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae7c0b5520 0x7fae7c144290 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.506+0000 7fae83fbe640 1 --2- 172.21.15.88:0/831610943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae7c0727d0 0x7fae7c149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.506+0000 7fae83fbe640 1 -- 172.21.15.88:0/831610943 >> 172.21.15.88:0/831610943 conn(0x7fae7c06be30 msgr2=0x7fae7c0ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:28.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.506+0000 7fae83fbe640 1 -- 172.21.15.88:0/831610943 shutdown_connections 2024-01-22T10:13:28.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.506+0000 7fae83fbe640 1 -- 172.21.15.88:0/831610943 wait complete. 2024-01-22T10:13:28.499 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-22T10:13:28.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.616+0000 7fc1cca0e640 1 Processor -- start 2024-01-22T10:13:28.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.616+0000 7fc1cca0e640 1 -- start start 2024-01-22T10:13:28.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.617+0000 7fc1cca0e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1c81437e0 0x7fc1c8071200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.617+0000 7fc1cca0e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c806b1c0 con 0x7fc1c8149e90 2024-01-22T10:13:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.617+0000 7fc1cca0e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c806c4b0 con 0x7fc1c80b7370 2024-01-22T10:13:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.617+0000 7fc1cca0e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c8143bc0 con 0x7fc1c81437e0 2024-01-22T10:13:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.617+0000 7fc1c6d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc1c8149e90 0x7fc1c8153d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42066/0 (socket says 172.21.15.88:42066) 2024-01-22T10:13:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.617+0000 7fc1c6d9d640 1 -- 172.21.15.88:0/912207378 learned_addr learned my addr 172.21.15.88:0/912207378 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c659c640 1 --2- 172.21.15.88:0/912207378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1c81437e0 0x7fc1c8071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306972360 0 0) 0x7fc1c806b1c0 con 0x7fc1c8149e90 2024-01-22T10:13:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b4003520 con 0x7fc1c8149e90 2024-01-22T10:13:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2787621458 0 0) 0x7fc1b4003520 con 0x7fc1c8149e90 2024-01-22T10:13:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1c81437e0 msgr2=0x7fc1c8071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 --2- 172.21.15.88:0/912207378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1c81437e0 0x7fc1c8071200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 >> v1:172.21.15.119:6789/0 conn(0x7fc1c80b7370 legacy=0x7fc1c8149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c806a890 con 0x7fc1c8149e90 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fc1c00019f0 con 0x7fc1c8149e90 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 >> v1:172.21.15.88:6789/0 conn(0x7fc1c8149e90 legacy=0x7fc1c8153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 --2- 172.21.15.88:0/912207378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1b4003a80 0x7fc1b4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 --2- 172.21.15.88:0/912207378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1b40047c0 0x7fc1b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 --2- 172.21.15.88:0/912207378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1c81437e0 0x7fc1b4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c8143bc0 con 0x7fc1b4003a80 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b400bba0 con 0x7fc1b40047c0 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b400bd30 con 0x7fc1c81437e0 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c659c640 1 --2- 172.21.15.88:0/912207378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1b4003a80 0x7fc1b4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c5d9b640 1 --2- 172.21.15.88:0/912207378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1b40047c0 0x7fc1b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c6d9d640 1 --2- 172.21.15.88:0/912207378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1c81437e0 0x7fc1b4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c659c640 1 -- 172.21.15.88:0/912207378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1c81437e0 msgr2=0x7fc1b4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c659c640 1 --2- 172.21.15.88:0/912207378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1c81437e0 0x7fc1b4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c659c640 1 -- 172.21.15.88:0/912207378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1b40047c0 msgr2=0x7fc1b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c659c640 1 --2- 172.21.15.88:0/912207378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1b40047c0 0x7fc1b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.618+0000 7fc1c659c640 1 -- 172.21.15.88:0/912207378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b4003520 con 0x7fc1b4003a80 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.619+0000 7fc1c659c640 1 --2- 172.21.15.88:0/912207378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1b4003a80 0x7fc1b4003ea0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009ac0 tx=0x7fc1b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9740761635120cb2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.619+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b002c6b0 con 0x7fc1b4003a80 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.619+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b002c810 con 0x7fc1b4003a80 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.619+0000 7fc1c559a640 1 -- 172.21.15.88:0/912207378 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b002cba0 con 0x7fc1b4003a80 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.619+0000 7fc1cca0e640 1 -- 172.21.15.88:0/912207378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1b4003a80 msgr2=0x7fc1b4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.619+0000 7fc1cca0e640 1 --2- 172.21.15.88:0/912207378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1b4003a80 0x7fc1b4003ea0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009ac0 tx=0x7fc1b40057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.619+0000 7fc1c6d9d640 1 -- 172.21.15.88:0/912207378 reap_dead start 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.620+0000 7fc1cca0e640 1 -- 172.21.15.88:0/912207378 shutdown_connections 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.620+0000 7fc1cca0e640 1 -- 172.21.15.88:0/912207378 >> 172.21.15.88:0/912207378 conn(0x7fc1c806b800 msgr2=0x7fc1c806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.620+0000 7fc1cca0e640 1 -- 172.21.15.88:0/912207378 shutdown_connections 2024-01-22T10:13:28.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.620+0000 7fc1cca0e640 1 -- 172.21.15.88:0/912207378 wait complete. 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.621+0000 7fc1cca0e640 1 Processor -- start 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.621+0000 7fc1cca0e640 1 -- start start 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.621+0000 7fc1cca0e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1b4003a80 0x7fc1c81d6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.621+0000 7fc1cca0e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1c80bc780 0x7fc1c80bd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.621+0000 7fc1cca0e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1c81472a0 0x7fc1c81e1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.621+0000 7fc1cca0e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c81d6690 con 0x7fc1b4003a80 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.621+0000 7fc1cca0e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c80bc2f0 con 0x7fc1c80bc780 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.621+0000 7fc1cca0e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c80bbd10 con 0x7fc1c81472a0 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.621+0000 7fc1c659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1b4003a80 0x7fc1c81d6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.621+0000 7fc1c659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1b4003a80 0x7fc1c81d6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54170/0 (socket says 172.21.15.88:54170) 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.622+0000 7fc1c659c640 1 -- 172.21.15.88:0/394926453 learned_addr learned my addr 172.21.15.88:0/394926453 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.622+0000 7fc1c659c640 1 -- 172.21.15.88:0/394926453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1c81472a0 msgr2=0x7fc1c81e1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.622+0000 7fc1c659c640 1 --2- 172.21.15.88:0/394926453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1c81472a0 0x7fc1c81e1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.622+0000 7fc1c659c640 1 -- 172.21.15.88:0/394926453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1c80bc780 msgr2=0x7fc1c80bd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.622+0000 7fc1c659c640 1 --2- 172.21.15.88:0/394926453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1c80bc780 0x7fc1c80bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.622+0000 7fc1c659c640 1 -- 172.21.15.88:0/394926453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c80bd850 con 0x7fc1b4003a80 2024-01-22T10:13:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.622+0000 7fc1c659c640 1 --2- 172.21.15.88:0/394926453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1b4003a80 0x7fc1c81d6150 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0037040 tx=0x7fc1b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.622+0000 7fc1beffd640 1 -- 172.21.15.88:0/394926453 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0003810 con 0x7fc1b4003a80 2024-01-22T10:13:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.622+0000 7fc1beffd640 1 -- 172.21.15.88:0/394926453 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b0003970 con 0x7fc1b4003a80 2024-01-22T10:13:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.622+0000 7fc1cca0e640 1 -- 172.21.15.88:0/394926453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c8137840 con 0x7fc1b4003a80 2024-01-22T10:13:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.622+0000 7fc1beffd640 1 -- 172.21.15.88:0/394926453 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0003ce0 con 0x7fc1b4003a80 2024-01-22T10:13:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.622+0000 7fc1cca0e640 1 -- 172.21.15.88:0/394926453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c80bdad0 con 0x7fc1b4003a80 2024-01-22T10:13:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.623+0000 7fc1cca0e640 1 -- 172.21.15.88:0/394926453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c804ea30 con 0x7fc1b4003a80 2024-01-22T10:13:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.623+0000 7fc1beffd640 1 -- 172.21.15.88:0/394926453 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fc1b0040450 con 0x7fc1b4003a80 2024-01-22T10:13:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.624+0000 7fc1beffd640 1 --2- 172.21.15.88:0/394926453 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc1a806b360 0x7fc1a806d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.624+0000 7fc1c5d9b640 1 --2- 172.21.15.88:0/394926453 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc1a806b360 0x7fc1a806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.624+0000 7fc1beffd640 1 -- 172.21.15.88:0/394926453 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1b00ab9a0 con 0x7fc1b4003a80 2024-01-22T10:13:28.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.624+0000 7fc1c5d9b640 1 --2- 172.21.15.88:0/394926453 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc1a806b360 0x7fc1a806d820 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8007fd0 tx=0x7fc1b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:28.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.628+0000 7fc1beffd640 1 -- 172.21.15.88:0/394926453 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc1b0076630 con 0x7fc1b4003a80 2024-01-22T10:13:28.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.809+0000 7fc1cca0e640 1 -- 172.21.15.88:0/394926453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1c80ba540 con 0x7fc1b4003a80 2024-01-22T10:13:28.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.809+0000 7fc1beffd640 1 -- 172.21.15.88:0/394926453 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc1b00044e0 con 0x7fc1b4003a80 2024-01-22T10:13:28.792 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2024-01-22T10:13:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.811+0000 7fc1cca0e640 1 -- 172.21.15.88:0/394926453 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc1a806b360 msgr2=0x7fc1a806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.811+0000 7fc1cca0e640 1 --2- 172.21.15.88:0/394926453 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc1a806b360 0x7fc1a806d820 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8007fd0 tx=0x7fc1b8009040 comp rx=0 tx=0).stop 2024-01-22T10:13:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.811+0000 7fc1cca0e640 1 -- 172.21.15.88:0/394926453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1b4003a80 msgr2=0x7fc1c81d6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.811+0000 7fc1cca0e640 1 --2- 172.21.15.88:0/394926453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1b4003a80 0x7fc1c81d6150 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0037040 tx=0x7fc1b0004730 comp rx=0 tx=0).stop 2024-01-22T10:13:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.811+0000 7fc1cca0e640 1 -- 172.21.15.88:0/394926453 shutdown_connections 2024-01-22T10:13:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.811+0000 7fc1cca0e640 1 --2- 172.21.15.88:0/394926453 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc1a806b360 0x7fc1a806d820 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.811+0000 7fc1cca0e640 1 --2- 172.21.15.88:0/394926453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1c81472a0 0x7fc1c81e1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.811+0000 7fc1cca0e640 1 --2- 172.21.15.88:0/394926453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1c80bc780 0x7fc1c80bd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.811+0000 7fc1cca0e640 1 --2- 172.21.15.88:0/394926453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1b4003a80 0x7fc1c81d6150 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.811+0000 7fc1cca0e640 1 -- 172.21.15.88:0/394926453 >> 172.21.15.88:0/394926453 conn(0x7fc1c806b800 msgr2=0x7fc1c8142570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.811+0000 7fc1cca0e640 1 -- 172.21.15.88:0/394926453 shutdown_connections 2024-01-22T10:13:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:28.811+0000 7fc1cca0e640 1 -- 172.21.15.88:0/394926453 wait complete. 2024-01-22T10:13:28.804 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T10:13:28.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:28.804 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-01-22T10:13:28.910 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2024-01-22T10:13:28.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:28.910 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T10:13:28.967 INFO:tasks.cephfs.cephfs_test_case:[] 2024-01-22T10:13:28.968 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:13:29.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.085+0000 7f9a97b4c640 1 Processor -- start 2024-01-22T10:13:29.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.085+0000 7f9a97b4c640 1 -- start start 2024-01-22T10:13:29.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.086+0000 7f9a97b4c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9a900b3630 0x7f9a900bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.086+0000 7f9a97b4c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a900b49c0 0x7f9a9014b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.086+0000 7f9a97b4c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a900b4e80 con 0x7f9a9014bea0 2024-01-22T10:13:29.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.086+0000 7f9a97b4c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a900b5370 con 0x7f9a900b3630 2024-01-22T10:13:29.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.086+0000 7f9a97b4c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9014c310 con 0x7f9a900b49c0 2024-01-22T10:13:29.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.086+0000 7f9a958e8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9a900b3630 0x7f9a900bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.086+0000 7f9a960e9640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f9a9014bea0 0x7f9a901483b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.88:43334/0 (socket says 172.21.15.88:43334) 2024-01-22T10:13:29.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.086+0000 7f9a950e7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a900b49c0 0x7f9a9014b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.086+0000 7f9a960e9640 1 -- 172.21.15.88:0/4277755141 learned_addr learned my addr 172.21.15.88:0/4277755141 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:29.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.087+0000 7f9a950e7640 1 -- 172.21.15.88:0/4277755141 >> v2:172.21.15.119:3300/0 conn(0x7f9a900b3630 msgr2=0x7f9a900bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:29.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.087+0000 7f9a950e7640 1 --2- 172.21.15.88:0/4277755141 >> v2:172.21.15.119:3300/0 conn(0x7f9a900b3630 0x7f9a900bd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.087+0000 7f9a950e7640 1 -- 172.21.15.88:0/4277755141 >> v1:172.21.15.119:6789/0 conn(0x7f9a9014bea0 legacy=0x7f9a901483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.087+0000 7f9a950e7640 1 -- 172.21.15.88:0/4277755141 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a900b5fd0 con 0x7f9a900b49c0 2024-01-22T10:13:29.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.087+0000 7f9a958e8640 1 --2- 172.21.15.88:0/4277755141 >> v2:172.21.15.119:3300/0 conn(0x7f9a900b3630 0x7f9a900bd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:29.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.087+0000 7f9a950e7640 1 --2- 172.21.15.88:0/4277755141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a900b49c0 0x7f9a9014b960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9a800097a0 tx=0x7f9a8002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=251847342574da61 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.087+0000 7f9a948e6640 1 -- 172.21.15.88:0/4277755141 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80031830 con 0x7f9a900b49c0 2024-01-22T10:13:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.088+0000 7f9a948e6640 1 -- 172.21.15.88:0/4277755141 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a80031990 con 0x7f9a900b49c0 2024-01-22T10:13:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.088+0000 7f9a948e6640 1 -- 172.21.15.88:0/4277755141 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80031d20 con 0x7f9a900b49c0 2024-01-22T10:13:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.088+0000 7f9a97b4c640 1 -- 172.21.15.88:0/4277755141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a900b49c0 msgr2=0x7f9a9014b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.088+0000 7f9a97b4c640 1 --2- 172.21.15.88:0/4277755141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a900b49c0 0x7f9a9014b960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9a800097a0 tx=0x7f9a8002b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.088+0000 7f9a97b4c640 1 -- 172.21.15.88:0/4277755141 shutdown_connections 2024-01-22T10:13:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.088+0000 7f9a97b4c640 1 --2- 172.21.15.88:0/4277755141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a900b49c0 0x7f9a9014b960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.088+0000 7f9a97b4c640 1 --2- 172.21.15.88:0/4277755141 >> v2:172.21.15.119:3300/0 conn(0x7f9a900b3630 0x7f9a900bd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.088+0000 7f9a97b4c640 1 -- 172.21.15.88:0/4277755141 >> 172.21.15.88:0/4277755141 conn(0x7f9a9006acf0 msgr2=0x7f9a900bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.088+0000 7f9a97b4c640 1 -- 172.21.15.88:0/4277755141 shutdown_connections 2024-01-22T10:13:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.088+0000 7f9a97b4c640 1 -- 172.21.15.88:0/4277755141 wait complete. 2024-01-22T10:13:29.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.089+0000 7f9a97b4c640 1 Processor -- start 2024-01-22T10:13:29.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.089+0000 7f9a97b4c640 1 -- start start 2024-01-22T10:13:29.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a97b4c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a900b3630 0x7f9a90071750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a97b4c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900b49c0 0x7f9a901e2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a97b4c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a9014bea0 0x7f9a901df210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a97b4c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90071c90 con 0x7f9a900b49c0 2024-01-22T10:13:29.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a97b4c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a901e24c0 con 0x7f9a900b3630 2024-01-22T10:13:29.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a97b4c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9013bc80 con 0x7f9a9014bea0 2024-01-22T10:13:29.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a950e7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900b49c0 0x7f9a901e2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a950e7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900b49c0 0x7f9a901e2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54184/0 (socket says 172.21.15.88:54184) 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a950e7640 1 -- 172.21.15.88:0/2495850037 learned_addr learned my addr 172.21.15.88:0/2495850037 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a958e8640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a900b3630 0x7f9a90071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a960e9640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a9014bea0 0x7f9a901df210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a950e7640 1 -- 172.21.15.88:0/2495850037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a9014bea0 msgr2=0x7f9a901df210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a950e7640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a9014bea0 0x7f9a901df210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a950e7640 1 -- 172.21.15.88:0/2495850037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a900b3630 msgr2=0x7f9a90071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a950e7640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a900b3630 0x7f9a90071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a950e7640 1 -- 172.21.15.88:0/2495850037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c009400 con 0x7f9a900b49c0 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.090+0000 7f9a950e7640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900b49c0 0x7f9a901e2950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a800098c0 tx=0x7f9a800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.091+0000 7f9a867fc640 1 -- 172.21.15.88:0/2495850037 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8003a6f0 con 0x7f9a900b49c0 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.091+0000 7f9a867fc640 1 -- 172.21.15.88:0/2495850037 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8003a870 con 0x7f9a900b49c0 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.091+0000 7f9a97b4c640 1 -- 172.21.15.88:0/2495850037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a80009400 con 0x7f9a900b49c0 2024-01-22T10:13:29.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.091+0000 7f9a867fc640 1 -- 172.21.15.88:0/2495850037 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8003ac20 con 0x7f9a900b49c0 2024-01-22T10:13:29.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.091+0000 7f9a97b4c640 1 -- 172.21.15.88:0/2495850037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a901ded20 con 0x7f9a900b49c0 2024-01-22T10:13:29.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.092+0000 7f9a97b4c640 1 -- 172.21.15.88:0/2495850037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a901e2630 con 0x7f9a900b49c0 2024-01-22T10:13:29.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.092+0000 7f9a867fc640 1 -- 172.21.15.88:0/2495850037 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f9a8004c3b0 con 0x7f9a900b49c0 2024-01-22T10:13:29.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.092+0000 7f9a867fc640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9a7406b330 0x7f9a7406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.092+0000 7f9a867fc640 1 -- 172.21.15.88:0/2495850037 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a800ab750 con 0x7f9a900b49c0 2024-01-22T10:13:29.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.092+0000 7f9a958e8640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9a7406b330 0x7f9a7406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.093+0000 7f9a958e8640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9a7406b330 0x7f9a7406d7f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009cd0 tx=0x7f9a8c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.096+0000 7f9a867fc640 1 -- 172.21.15.88:0/2495850037 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9a80076640 con 0x7f9a900b49c0 2024-01-22T10:13:29.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.301+0000 7f9a97b4c640 1 -- 172.21.15.88:0/2495850037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a9004ea30 con 0x7f9a900b49c0 2024-01-22T10:13:29.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.301+0000 7f9a867fc640 1 -- 172.21.15.88:0/2495850037 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4145 (secure 0 0 0) 0x7f9a80079c60 con 0x7f9a900b49c0 2024-01-22T10:13:29.284 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:29.284 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3660245466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3660245466},{"type":"v1","addr":"172.21.15.119:6833","nonce":3660245466}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/3438486113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3438486113},{"type":"v1","addr":"172.21.15.88:6836","nonce":3438486113}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T10:13:02.851192+0000","modified":"2024-01-22T10:13:04.853526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/1505620357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1505620357},{"type":"v1","addr":"172.21.15.88:6837","nonce":1505620357}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-22T10:13:29.285 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 6 2024-01-22T10:13:29.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.303+0000 7f9a97b4c640 1 -- 172.21.15.88:0/2495850037 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9a7406b330 msgr2=0x7f9a7406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.303+0000 7f9a97b4c640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9a7406b330 0x7f9a7406d7f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009cd0 tx=0x7f9a8c009190 comp rx=0 tx=0).stop 2024-01-22T10:13:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.303+0000 7f9a97b4c640 1 -- 172.21.15.88:0/2495850037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900b49c0 msgr2=0x7f9a901e2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.303+0000 7f9a97b4c640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900b49c0 0x7f9a901e2950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a800098c0 tx=0x7f9a800046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.303+0000 7f9a97b4c640 1 -- 172.21.15.88:0/2495850037 shutdown_connections 2024-01-22T10:13:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.303+0000 7f9a97b4c640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9a7406b330 0x7f9a7406d7f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.303+0000 7f9a97b4c640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a9014bea0 0x7f9a901df210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.303+0000 7f9a97b4c640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a900b49c0 0x7f9a901e2950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.303+0000 7f9a97b4c640 1 --2- 172.21.15.88:0/2495850037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a900b3630 0x7f9a90071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.303+0000 7f9a97b4c640 1 -- 172.21.15.88:0/2495850037 >> 172.21.15.88:0/2495850037 conn(0x7f9a9006acf0 msgr2=0x7f9a90141a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.303+0000 7f9a97b4c640 1 -- 172.21.15.88:0/2495850037 shutdown_connections 2024-01-22T10:13:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.304+0000 7f9a97b4c640 1 -- 172.21.15.88:0/2495850037 wait complete. 2024-01-22T10:13:29.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:29.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.413+0000 7f72ae3b0640 1 Processor -- start 2024-01-22T10:13:29.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.413+0000 7f72ae3b0640 1 -- start start 2024-01-22T10:13:29.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.414+0000 7f72ae3b0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72a806d2b0 0x7f72a814bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.414+0000 7f72ae3b0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f72a806bee0 0x7f72a8155f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.414+0000 7f72ae3b0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a814b700 con 0x7f72a806baa0 2024-01-22T10:13:29.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.414+0000 7f72ae3b0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a806f340 con 0x7f72a806bee0 2024-01-22T10:13:29.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.414+0000 7f72ae3b0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a806de90 con 0x7f72a806d2b0 2024-01-22T10:13:29.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.414+0000 7f72a7fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72a806d2b0 0x7f72a814bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.414+0000 7f72ac94d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f72a806bee0 0x7f72a8155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.414+0000 7f72ac94d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f72a806bee0 0x7f72a8155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.88:58972/0 (socket says 172.21.15.88:58972) 2024-01-22T10:13:29.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.414+0000 7f72a7fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72a806d2b0 0x7f72a814bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:50658/0 (socket says 172.21.15.88:50658) 2024-01-22T10:13:29.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.414+0000 7f72ac94d640 1 -- 172.21.15.88:0/2414195790 learned_addr learned my addr 172.21.15.88:0/2414195790 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:29.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.415+0000 7f72a7fff640 1 -- 172.21.15.88:0/2414195790 >> v2:172.21.15.119:3300/0 conn(0x7f72a806bee0 msgr2=0x7f72a8155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:29.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.415+0000 7f72a7fff640 1 --2- 172.21.15.88:0/2414195790 >> v2:172.21.15.119:3300/0 conn(0x7f72a806bee0 0x7f72a8155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.415+0000 7f72a7fff640 1 -- 172.21.15.88:0/2414195790 >> v1:172.21.15.119:6789/0 conn(0x7f72a806baa0 legacy=0x7f72a80a40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.415+0000 7f72a7fff640 1 -- 172.21.15.88:0/2414195790 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a806f5e0 con 0x7f72a806d2b0 2024-01-22T10:13:29.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.415+0000 7f72ac94d640 1 --2- 172.21.15.88:0/2414195790 >> v2:172.21.15.119:3300/0 conn(0x7f72a806bee0 0x7f72a8155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.415+0000 7f72a7fff640 1 --2- 172.21.15.88:0/2414195790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72a806d2b0 0x7f72a814bee0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f72980097a0 tx=0x7f729802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=701b88ab7ee6ff50 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.415+0000 7f72a6ffd640 1 -- 172.21.15.88:0/2414195790 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298031830 con 0x7f72a806d2b0 2024-01-22T10:13:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.416+0000 7f72a6ffd640 1 -- 172.21.15.88:0/2414195790 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7298031990 con 0x7f72a806d2b0 2024-01-22T10:13:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.416+0000 7f72a6ffd640 1 -- 172.21.15.88:0/2414195790 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298031d20 con 0x7f72a806d2b0 2024-01-22T10:13:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.416+0000 7f72ae3b0640 1 -- 172.21.15.88:0/2414195790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72a806d2b0 msgr2=0x7f72a814bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.416+0000 7f72ae3b0640 1 --2- 172.21.15.88:0/2414195790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72a806d2b0 0x7f72a814bee0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f72980097a0 tx=0x7f729802b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.416+0000 7f72ae3b0640 1 -- 172.21.15.88:0/2414195790 shutdown_connections 2024-01-22T10:13:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.416+0000 7f72ae3b0640 1 --2- 172.21.15.88:0/2414195790 >> v2:172.21.15.119:3300/0 conn(0x7f72a806bee0 0x7f72a8155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.416+0000 7f72ae3b0640 1 --2- 172.21.15.88:0/2414195790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72a806d2b0 0x7f72a814bee0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.416+0000 7f72ae3b0640 1 -- 172.21.15.88:0/2414195790 >> 172.21.15.88:0/2414195790 conn(0x7f72a80bb8d0 msgr2=0x7f72a80bbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.416+0000 7f72ae3b0640 1 -- 172.21.15.88:0/2414195790 shutdown_connections 2024-01-22T10:13:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.416+0000 7f72ae3b0640 1 -- 172.21.15.88:0/2414195790 wait complete. 2024-01-22T10:13:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.417+0000 7f72ae3b0640 1 Processor -- start 2024-01-22T10:13:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.417+0000 7f72ae3b0640 1 -- start start 2024-01-22T10:13:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72ae3b0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72a806baa0 0x7f72a80be300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72ae3b0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a806bee0 0x7f72a81e48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72ae3b0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72a806d2b0 0x7f72a81e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72ae3b0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80be840 con 0x7f72a806bee0 2024-01-22T10:13:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72ae3b0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a81e4450 con 0x7f72a806d2b0 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72ae3b0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a81391c0 con 0x7f72a806baa0 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72a77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a806bee0 0x7f72a81e48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72a77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a806bee0 0x7f72a81e48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54196/0 (socket says 172.21.15.88:54196) 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72a77fe640 1 -- 172.21.15.88:0/357273134 learned_addr learned my addr 172.21.15.88:0/357273134 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72a7fff640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72a806baa0 0x7f72a80be300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72ac94d640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72a806d2b0 0x7f72a81e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72a77fe640 1 -- 172.21.15.88:0/357273134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72a806baa0 msgr2=0x7f72a80be300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72a77fe640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72a806baa0 0x7f72a80be300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72a77fe640 1 -- 172.21.15.88:0/357273134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72a806d2b0 msgr2=0x7f72a81e4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72a77fe640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72a806d2b0 0x7f72a81e4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72a77fe640 1 -- 172.21.15.88:0/357273134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0009b30 con 0x7f72a806bee0 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72ac94d640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72a806d2b0 0x7f72a81e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.418+0000 7f72a77fe640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a806bee0 0x7f72a81e48e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f729c00c400 tx=0x7f729c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.419+0000 7f72a4ff9640 1 -- 172.21.15.88:0/357273134 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c0052d0 con 0x7f72a806bee0 2024-01-22T10:13:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.419+0000 7f72a4ff9640 1 -- 172.21.15.88:0/357273134 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c005450 con 0x7f72a806bee0 2024-01-22T10:13:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.419+0000 7f72ae3b0640 1 -- 172.21.15.88:0/357273134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7298009400 con 0x7f72a806bee0 2024-01-22T10:13:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.419+0000 7f72a4ff9640 1 -- 172.21.15.88:0/357273134 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c007260 con 0x7f72a806bee0 2024-01-22T10:13:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.419+0000 7f72ae3b0640 1 -- 172.21.15.88:0/357273134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a8143e40 con 0x7f72a806bee0 2024-01-22T10:13:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.420+0000 7f72ae3b0640 1 -- 172.21.15.88:0/357273134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a8067c40 con 0x7f72a806bee0 2024-01-22T10:13:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.420+0000 7f72a4ff9640 1 -- 172.21.15.88:0/357273134 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f729c0073c0 con 0x7f72a806bee0 2024-01-22T10:13:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.420+0000 7f72a4ff9640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f729406b330 0x7f729406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.421+0000 7f72a4ff9640 1 -- 172.21.15.88:0/357273134 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f729c088ec0 con 0x7f72a806bee0 2024-01-22T10:13:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.421+0000 7f72a7fff640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f729406b330 0x7f729406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.421+0000 7f72a7fff640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f729406b330 0x7f729406d7f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7298036000 tx=0x7f729803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:29.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.425+0000 7f72a4ff9640 1 -- 172.21.15.88:0/357273134 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f729c053c90 con 0x7f72a806bee0 2024-01-22T10:13:29.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.596+0000 7f72ae3b0640 1 -- 172.21.15.88:0/357273134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72a804ea30 con 0x7f72a806bee0 2024-01-22T10:13:29.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.597+0000 7f72a4ff9640 1 -- 172.21.15.88:0/357273134 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f729c0572b0 con 0x7f72a806bee0 2024-01-22T10:13:29.579 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:29.579 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.599+0000 7f72ae3b0640 1 -- 172.21.15.88:0/357273134 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f729406b330 msgr2=0x7f729406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.599+0000 7f72ae3b0640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f729406b330 0x7f729406d7f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7298036000 tx=0x7f729803c040 comp rx=0 tx=0).stop 2024-01-22T10:13:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.599+0000 7f72ae3b0640 1 -- 172.21.15.88:0/357273134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a806bee0 msgr2=0x7f72a81e48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.599+0000 7f72ae3b0640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a806bee0 0x7f72a81e48e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f729c00c400 tx=0x7f729c00c8c0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.599+0000 7f72ae3b0640 1 -- 172.21.15.88:0/357273134 shutdown_connections 2024-01-22T10:13:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.599+0000 7f72ae3b0640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f729406b330 0x7f729406d7f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.599+0000 7f72ae3b0640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72a806d2b0 0x7f72a81e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.599+0000 7f72ae3b0640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72a806bee0 0x7f72a81e48e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.599+0000 7f72ae3b0640 1 --2- 172.21.15.88:0/357273134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72a806baa0 0x7f72a80be300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.599+0000 7f72ae3b0640 1 -- 172.21.15.88:0/357273134 >> 172.21.15.88:0/357273134 conn(0x7f72a80bb8d0 msgr2=0x7f72a8149360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.599+0000 7f72ae3b0640 1 -- 172.21.15.88:0/357273134 shutdown_connections 2024-01-22T10:13:29.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.599+0000 7f72ae3b0640 1 -- 172.21.15.88:0/357273134 wait complete. 2024-01-22T10:13:29.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T10:13:00.844842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T10:13:01.816849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:13:29.592 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:13:29.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.712+0000 7f65b45d5640 1 Processor -- start 2024-01-22T10:13:29.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.712+0000 7f65b45d5640 1 -- start start 2024-01-22T10:13:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.713+0000 7f65b45d5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f65ac148e50 0x7f65ac06de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.713+0000 7f65b45d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65ac0b8cf0 0x7f65ac09f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.713+0000 7f65b45d5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac066850 con 0x7f65ac0b9150 2024-01-22T10:13:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.713+0000 7f65b45d5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac06da00 con 0x7f65ac148e50 2024-01-22T10:13:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.713+0000 7f65b45d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac066520 con 0x7f65ac0b8cf0 2024-01-22T10:13:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.713+0000 7f65b2b72640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f65ac0b9150 0x7f65ac09de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42076/0 (socket says 172.21.15.88:42076) 2024-01-22T10:13:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.713+0000 7f65b2b72640 1 -- 172.21.15.88:0/2668593711 learned_addr learned my addr 172.21.15.88:0/2668593711 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.713+0000 7f65b1b70640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65ac0b8cf0 0x7f65ac09f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.713+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112873872 0 0) 0x7f65ac066850 con 0x7f65ac0b9150 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.713+0000 7f65b2371640 1 --2- 172.21.15.88:0/2668593711 >> v2:172.21.15.119:3300/0 conn(0x7f65ac148e50 0x7f65ac06de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.713+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6598003520 con 0x7f65ac0b9150 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 567476111 0 0) 0x7f6598003520 con 0x7f65ac0b9150 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65ac0b8cf0 msgr2=0x7f65ac09f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65ac0b8cf0 0x7f65ac09f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 >> v2:172.21.15.119:3300/0 conn(0x7f65ac148e50 msgr2=0x7f65ac06de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 --2- 172.21.15.88:0/2668593711 >> v2:172.21.15.119:3300/0 conn(0x7f65ac148e50 0x7f65ac06de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac06c980 con 0x7f65ac0b9150 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f65a4001670 con 0x7f65ac0b9150 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 >> v1:172.21.15.88:6789/0 conn(0x7f65ac0b9150 legacy=0x7f65ac09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598003970 0x7f6598003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65ac0b8cf0 0x7f65980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6598004d00 0x7f6598005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac06da00 con 0x7f6598003970 2024-01-22T10:13:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac066520 con 0x7f6598004d00 2024-01-22T10:13:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659800b980 con 0x7f65ac0b8cf0 2024-01-22T10:13:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b2371640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598003970 0x7f6598003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b1b70640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65ac0b8cf0 0x7f65980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b2b72640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6598004d00 0x7f6598005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b2371640 1 -- 172.21.15.88:0/2668593711 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65ac0b8cf0 msgr2=0x7f65980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b2371640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65ac0b8cf0 0x7f65980047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b2371640 1 -- 172.21.15.88:0/2668593711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6598004d00 msgr2=0x7f6598005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b2371640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6598004d00 0x7f6598005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b2371640 1 -- 172.21.15.88:0/2668593711 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6598003520 con 0x7f6598003970 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.714+0000 7f65b2b72640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6598004d00 0x7f6598005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.715+0000 7f65b2371640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598003970 0x7f6598003d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009fc0 tx=0x7f65980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e96e0980c8eedc server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.715+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a802cc60 con 0x7f6598003970 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.715+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a800f040 con 0x7f6598003970 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.715+0000 7f65b136f640 1 -- 172.21.15.88:0/2668593711 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a8034440 con 0x7f6598003970 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.715+0000 7f65b45d5640 1 -- 172.21.15.88:0/2668593711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598003970 msgr2=0x7f6598003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.715+0000 7f65b45d5640 1 --2- 172.21.15.88:0/2668593711 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6598003970 0x7f6598003d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009fc0 tx=0x7f65980057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.715+0000 7f65b2b72640 1 -- 172.21.15.88:0/2668593711 reap_dead start 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.716+0000 7f65b45d5640 1 -- 172.21.15.88:0/2668593711 shutdown_connections 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.716+0000 7f65b45d5640 1 -- 172.21.15.88:0/2668593711 >> 172.21.15.88:0/2668593711 conn(0x7f65ac06a6f0 msgr2=0x7f65ac06ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.716+0000 7f65b45d5640 1 -- 172.21.15.88:0/2668593711 shutdown_connections 2024-01-22T10:13:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.716+0000 7f65b45d5640 1 -- 172.21.15.88:0/2668593711 wait complete. 2024-01-22T10:13:29.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b45d5640 1 Processor -- start 2024-01-22T10:13:29.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b45d5640 1 -- start start 2024-01-22T10:13:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b45d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6598003970 0x7f65ac14c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b45d5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ac071db0 0x7f65ac14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b45d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65ac14a120 0x7f65ac14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b45d5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac14c7a0 con 0x7f65ac071db0 2024-01-22T10:13:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b45d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac072240 con 0x7f65ac14a120 2024-01-22T10:13:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b45d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac072520 con 0x7f6598003970 2024-01-22T10:13:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b1b70640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ac071db0 0x7f65ac14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b1b70640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ac071db0 0x7f65ac14b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54212/0 (socket says 172.21.15.88:54212) 2024-01-22T10:13:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b1b70640 1 -- 172.21.15.88:0/1161742318 learned_addr learned my addr 172.21.15.88:0/1161742318 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b2371640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6598003970 0x7f65ac14c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.717+0000 7f65b2b72640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65ac14a120 0x7f65ac14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.718+0000 7f65b1b70640 1 -- 172.21.15.88:0/1161742318 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6598003970 msgr2=0x7f65ac14c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.718+0000 7f65b1b70640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6598003970 0x7f65ac14c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.718+0000 7f65b1b70640 1 -- 172.21.15.88:0/1161742318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65ac14a120 msgr2=0x7f65ac14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.718+0000 7f65b1b70640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65ac14a120 0x7f65ac14a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.718+0000 7f65b1b70640 1 -- 172.21.15.88:0/1161742318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac072800 con 0x7f65ac071db0 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.718+0000 7f65b1b70640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ac071db0 0x7f65ac14b2a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f659c0119a0 tx=0x7f659c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.718+0000 7f65a2ffd640 1 -- 172.21.15.88:0/1161742318 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00faf0 con 0x7f65ac071db0 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.718+0000 7f65a2ffd640 1 -- 172.21.15.88:0/1161742318 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c00fc50 con 0x7f65ac071db0 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.718+0000 7f65a2ffd640 1 -- 172.21.15.88:0/1161742318 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c014440 con 0x7f65ac071db0 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.718+0000 7f65b45d5640 1 -- 172.21.15.88:0/1161742318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac14b7e0 con 0x7f65ac071db0 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.718+0000 7f65b45d5640 1 -- 172.21.15.88:0/1161742318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac1e41d0 con 0x7f65ac071db0 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.719+0000 7f65b45d5640 1 -- 172.21.15.88:0/1161742318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac0669e0 con 0x7f65ac071db0 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.719+0000 7f65a2ffd640 1 -- 172.21.15.88:0/1161742318 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f659c0145a0 con 0x7f65ac071db0 2024-01-22T10:13:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.720+0000 7f65a2ffd640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f659006b330 0x7f659006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.720+0000 7f65a2ffd640 1 -- 172.21.15.88:0/1161742318 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f659c08a520 con 0x7f65ac071db0 2024-01-22T10:13:29.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.720+0000 7f65b2371640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f659006b330 0x7f659006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.720+0000 7f65b2371640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f659006b330 0x7f659006d7f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f65a8036000 tx=0x7f65a802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:29.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.724+0000 7f65a2ffd640 1 -- 172.21.15.88:0/1161742318 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f659c0551b0 con 0x7f65ac071db0 2024-01-22T10:13:29.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.890+0000 7f65b45d5640 1 -- 172.21.15.88:0/1161742318 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65ac04ea30 con 0x7f65ac071db0 2024-01-22T10:13:29.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.891+0000 7f65a2ffd640 1 -- 172.21.15.88:0/1161742318 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f659c0587d0 con 0x7f65ac071db0 2024-01-22T10:13:29.873 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:13:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.893+0000 7f65b45d5640 1 -- 172.21.15.88:0/1161742318 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f659006b330 msgr2=0x7f659006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.893+0000 7f65b45d5640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f659006b330 0x7f659006d7f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f65a8036000 tx=0x7f65a802e000 comp rx=0 tx=0).stop 2024-01-22T10:13:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.893+0000 7f65b45d5640 1 -- 172.21.15.88:0/1161742318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ac071db0 msgr2=0x7f65ac14b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.893+0000 7f65b45d5640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ac071db0 0x7f65ac14b2a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f659c0119a0 tx=0x7f659c011e60 comp rx=0 tx=0).stop 2024-01-22T10:13:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.893+0000 7f65b45d5640 1 -- 172.21.15.88:0/1161742318 shutdown_connections 2024-01-22T10:13:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.893+0000 7f65b45d5640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f659006b330 0x7f659006d7f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.893+0000 7f65b45d5640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65ac14a120 0x7f65ac14a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.893+0000 7f65b45d5640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ac071db0 0x7f65ac14b2a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.893+0000 7f65b45d5640 1 --2- 172.21.15.88:0/1161742318 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6598003970 0x7f65ac14c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.893+0000 7f65b45d5640 1 -- 172.21.15.88:0/1161742318 >> 172.21.15.88:0/1161742318 conn(0x7f65ac06a6f0 msgr2=0x7f65ac0b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.893+0000 7f65b45d5640 1 -- 172.21.15.88:0/1161742318 shutdown_connections 2024-01-22T10:13:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:29.893+0000 7f65b45d5640 1 -- 172.21.15.88:0/1161742318 wait complete. 2024-01-22T10:13:29.886 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T10:13:29.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.005+0000 7f94e2cda640 1 Processor -- start 2024-01-22T10:13:29.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.005+0000 7f94e2cda640 1 -- start start 2024-01-22T10:13:29.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.005+0000 7f94e2cda640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94dc14d1c0 0x7f94dc149a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.005+0000 7f94e2cda640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94dc149f60 0x7f94dc153de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.005+0000 7f94e2cda640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94dc06f2e0 con 0x7f94dc0bc0e0 2024-01-22T10:13:29.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.005+0000 7f94e2cda640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94dc06f530 con 0x7f94dc149f60 2024-01-22T10:13:29.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.005+0000 7f94e2cda640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc06f810 con 0x7f94dc14d1c0 2024-01-22T10:13:29.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.006+0000 7f94e1277640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94dc149f60 0x7f94dc153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.006+0000 7f94e1277640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94dc149f60 0x7f94dc153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54224/0 (socket says 172.21.15.88:54224) 2024-01-22T10:13:29.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.006+0000 7f94e1277640 1 -- 172.21.15.88:0/2729014274 learned_addr learned my addr 172.21.15.88:0/2729014274 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:29.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.006+0000 7f94dbfff640 1 --2- 172.21.15.88:0/2729014274 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94dc14d1c0 0x7f94dc149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.006+0000 7f94e1277640 1 -- 172.21.15.88:0/2729014274 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94dc14d1c0 msgr2=0x7f94dc149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:29.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.006+0000 7f94e1277640 1 --2- 172.21.15.88:0/2729014274 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94dc14d1c0 0x7f94dc149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.006+0000 7f94e1277640 1 -- 172.21.15.88:0/2729014274 >> v1:172.21.15.119:6789/0 conn(0x7f94dc0bc0e0 legacy=0x7f94dc14cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:29.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.006+0000 7f94e1277640 1 -- 172.21.15.88:0/2729014274 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc06faf0 con 0x7f94dc149f60 2024-01-22T10:13:29.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.007+0000 7f94e1277640 1 --2- 172.21.15.88:0/2729014274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94dc149f60 0x7f94dc153de0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009e50 tx=0x7f94d402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876438376bc18d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:29.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.007+0000 7f94db7fe640 1 -- 172.21.15.88:0/2729014274 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d402ca70 con 0x7f94dc149f60 2024-01-22T10:13:29.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.007+0000 7f94db7fe640 1 -- 172.21.15.88:0/2729014274 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d402cbd0 con 0x7f94dc149f60 2024-01-22T10:13:29.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.007+0000 7f94db7fe640 1 -- 172.21.15.88:0/2729014274 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40343f0 con 0x7f94dc149f60 2024-01-22T10:13:29.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.007+0000 7f94e2cda640 1 -- 172.21.15.88:0/2729014274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94dc149f60 msgr2=0x7f94dc153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.007+0000 7f94e2cda640 1 --2- 172.21.15.88:0/2729014274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94dc149f60 0x7f94dc153de0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009e50 tx=0x7f94d402bed0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.007+0000 7f94e2cda640 1 -- 172.21.15.88:0/2729014274 shutdown_connections 2024-01-22T10:13:29.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.007+0000 7f94e2cda640 1 --2- 172.21.15.88:0/2729014274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94dc149f60 0x7f94dc153de0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.007+0000 7f94e2cda640 1 --2- 172.21.15.88:0/2729014274 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94dc14d1c0 0x7f94dc149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.007+0000 7f94e2cda640 1 -- 172.21.15.88:0/2729014274 >> 172.21.15.88:0/2729014274 conn(0x7f94dc0bf560 msgr2=0x7f94dc0bb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:29.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.007+0000 7f94e2cda640 1 -- 172.21.15.88:0/2729014274 shutdown_connections 2024-01-22T10:13:29.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.007+0000 7f94e2cda640 1 -- 172.21.15.88:0/2729014274 wait complete. 2024-01-22T10:13:29.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.008+0000 7f94e2cda640 1 Processor -- start 2024-01-22T10:13:29.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.008+0000 7f94e2cda640 1 -- start start 2024-01-22T10:13:29.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.009+0000 7f94e2cda640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94dc0bc0e0 0x7f94dc1deb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.009+0000 7f94e2cda640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94dc149f60 0x7f94dc0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.009+0000 7f94e2cda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94dc14d1c0 0x7f94dc144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.009+0000 7f94e2cda640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc137780 con 0x7f94dc14d1c0 2024-01-22T10:13:29.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.009+0000 7f94e2cda640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc137a20 con 0x7f94dc0bc0e0 2024-01-22T10:13:29.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.009+0000 7f94e2cda640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc135880 con 0x7f94dc149f60 2024-01-22T10:13:29.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.009+0000 7f94e1277640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94dc14d1c0 0x7f94dc144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.009+0000 7f94e1277640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94dc14d1c0 0x7f94dc144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54240/0 (socket says 172.21.15.88:54240) 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.009+0000 7f94e1277640 1 -- 172.21.15.88:0/3772950556 learned_addr learned my addr 172.21.15.88:0/3772950556 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.009+0000 7f94e0a76640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94dc0bc0e0 0x7f94dc1deb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.010+0000 7f94e1277640 1 -- 172.21.15.88:0/3772950556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94dc149f60 msgr2=0x7f94dc0b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.010+0000 7f94dbfff640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94dc149f60 0x7f94dc0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.010+0000 7f94e1277640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94dc149f60 0x7f94dc0b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.010+0000 7f94e1277640 1 -- 172.21.15.88:0/3772950556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94dc0bc0e0 msgr2=0x7f94dc1deb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.010+0000 7f94e1277640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94dc0bc0e0 0x7f94dc1deb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.010+0000 7f94e1277640 1 -- 172.21.15.88:0/3772950556 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d4009b30 con 0x7f94dc14d1c0 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.010+0000 7f94e1277640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94dc14d1c0 0x7f94dc144f40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009e50 tx=0x7f94d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.010+0000 7f94d97fa640 1 -- 172.21.15.88:0/3772950556 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4009510 con 0x7f94dc14d1c0 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.010+0000 7f94d97fa640 1 -- 172.21.15.88:0/3772950556 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d403e450 con 0x7f94dc14d1c0 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.010+0000 7f94e2cda640 1 -- 172.21.15.88:0/3772950556 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94dc0b21f0 con 0x7f94dc14d1c0 2024-01-22T10:13:29.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.010+0000 7f94d97fa640 1 -- 172.21.15.88:0/3772950556 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d403e800 con 0x7f94dc14d1c0 2024-01-22T10:13:29.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.010+0000 7f94e2cda640 1 -- 172.21.15.88:0/3772950556 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc0b5710 con 0x7f94dc14d1c0 2024-01-22T10:13:29.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.011+0000 7f94e2cda640 1 -- 172.21.15.88:0/3772950556 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94dc067c40 con 0x7f94dc14d1c0 2024-01-22T10:13:29.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.011+0000 7f94d97fa640 1 -- 172.21.15.88:0/3772950556 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f94d403e960 con 0x7f94dc14d1c0 2024-01-22T10:13:29.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.011+0000 7f94d97fa640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f94c006b330 0x7f94c006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:29.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.012+0000 7f94d97fa640 1 -- 172.21.15.88:0/3772950556 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94d40ac9e0 con 0x7f94dc14d1c0 2024-01-22T10:13:29.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.012+0000 7f94e0a76640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f94c006b330 0x7f94c006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:29.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.012+0000 7f94e0a76640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f94c006b330 0x7f94c006d7f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94d0003d90 tx=0x7f94d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:29.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.016+0000 7f94d97fa640 1 -- 172.21.15.88:0/3772950556 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f94d40777b0 con 0x7f94dc14d1c0 2024-01-22T10:13:30.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.184+0000 7f94e2cda640 1 -- 172.21.15.88:0/3772950556 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94dc0b7110 con 0x7f94dc14d1c0 2024-01-22T10:13:30.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.184+0000 7f94d97fa640 1 -- 172.21.15.88:0/3772950556 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94d407add0 con 0x7f94dc14d1c0 2024-01-22T10:13:30.167 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-01-22T10:13:30.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.186+0000 7f94e2cda640 1 -- 172.21.15.88:0/3772950556 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f94c006b330 msgr2=0x7f94c006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.186+0000 7f94e2cda640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f94c006b330 0x7f94c006d7f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94d0003d90 tx=0x7f94d0009040 comp rx=0 tx=0).stop 2024-01-22T10:13:30.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.186+0000 7f94e2cda640 1 -- 172.21.15.88:0/3772950556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94dc14d1c0 msgr2=0x7f94dc144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.186+0000 7f94e2cda640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94dc14d1c0 0x7f94dc144f40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009e50 tx=0x7f94d4004a40 comp rx=0 tx=0).stop 2024-01-22T10:13:30.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.186+0000 7f94e2cda640 1 -- 172.21.15.88:0/3772950556 shutdown_connections 2024-01-22T10:13:30.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.186+0000 7f94e2cda640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f94c006b330 0x7f94c006d7f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.186+0000 7f94e2cda640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94dc149f60 0x7f94dc0b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.186+0000 7f94e2cda640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94dc14d1c0 0x7f94dc144f40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.186+0000 7f94e2cda640 1 --2- 172.21.15.88:0/3772950556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94dc0bc0e0 0x7f94dc1deb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.186+0000 7f94e2cda640 1 -- 172.21.15.88:0/3772950556 >> 172.21.15.88:0/3772950556 conn(0x7f94dc0bf560 msgr2=0x7f94dc0bcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:30.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.186+0000 7f94e2cda640 1 -- 172.21.15.88:0/3772950556 shutdown_connections 2024-01-22T10:13:30.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.186+0000 7f94e2cda640 1 -- 172.21.15.88:0/3772950556 wait complete. 2024-01-22T10:13:30.179 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T10:13:30.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.299+0000 7fb031c2b640 1 Processor -- start 2024-01-22T10:13:30.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.299+0000 7fb031c2b640 1 -- start start 2024-01-22T10:13:30.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.299+0000 7fb031c2b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2f00 0x7fb02c0b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.299+0000 7fb031c2b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c0b75a0 con 0x7fb02c145590 2024-01-22T10:13:30.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.299+0000 7fb031c2b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c0b4cc0 con 0x7fb02c1504e0 2024-01-22T10:13:30.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.299+0000 7fb031c2b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0b3c80 con 0x7fb02c0b2f00 2024-01-22T10:13:30.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb02c145590 0x7fb02c148320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42078/0 (socket says 172.21.15.88:42078) 2024-01-22T10:13:30.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02b7fe640 1 -- 172.21.15.88:0/2076252484 learned_addr learned my addr 172.21.15.88:0/2076252484 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:30.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218087898 0 0) 0x7fb02c0b75a0 con 0x7fb02c145590 2024-01-22T10:13:30.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02affd640 1 --2- 172.21.15.88:0/2076252484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2f00 0x7fb02c0b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb014003440 con 0x7fb02c145590 2024-01-22T10:13:30.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1859171053 0 0) 0x7fb014003440 con 0x7fb02c145590 2024-01-22T10:13:30.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2f00 msgr2=0x7fb02c0b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:30.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 --2- 172.21.15.88:0/2076252484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2f00 0x7fb02c0b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 >> v1:172.21.15.119:6789/0 conn(0x7fb02c1504e0 legacy=0x7fb02c1528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c147e20 con 0x7fb02c145590 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fb01c001670 con 0x7fb02c145590 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 >> v1:172.21.15.88:6789/0 conn(0x7fb02c145590 legacy=0x7fb02c148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 --2- 172.21.15.88:0/2076252484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb014003b70 0x7fb014003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 --2- 172.21.15.88:0/2076252484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0140088c0 0x7fb01400ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 --2- 172.21.15.88:0/2076252484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2f00 0x7fb01400d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0b3c80 con 0x7fb0140088c0 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01400dda0 con 0x7fb014003b70 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01400df60 con 0x7fb02c0b2f00 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02affd640 1 --2- 172.21.15.88:0/2076252484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0140088c0 0x7fb01400ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02b7fe640 1 --2- 172.21.15.88:0/2076252484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb014003b70 0x7fb014003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02bfff640 1 --2- 172.21.15.88:0/2076252484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2f00 0x7fb01400d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02affd640 1 -- 172.21.15.88:0/2076252484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2f00 msgr2=0x7fb01400d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02affd640 1 --2- 172.21.15.88:0/2076252484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c0b2f00 0x7fb01400d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.300+0000 7fb02affd640 1 -- 172.21.15.88:0/2076252484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb014003b70 msgr2=0x7fb014003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.301+0000 7fb02affd640 1 --2- 172.21.15.88:0/2076252484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb014003b70 0x7fb014003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.301+0000 7fb02affd640 1 -- 172.21.15.88:0/2076252484 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014003440 con 0x7fb0140088c0 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.301+0000 7fb02affd640 1 --2- 172.21.15.88:0/2076252484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0140088c0 0x7fb01400ad50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb020009ac0 tx=0x7fb0140036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8694b1a1fde3946b server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.301+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02002c6b0 con 0x7fb0140088c0 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.301+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02002c810 con 0x7fb0140088c0 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.301+0000 7fb02a7fc640 1 -- 172.21.15.88:0/2076252484 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02002cba0 con 0x7fb0140088c0 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.302+0000 7fb031c2b640 1 -- 172.21.15.88:0/2076252484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0140088c0 msgr2=0x7fb01400ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.302+0000 7fb031c2b640 1 --2- 172.21.15.88:0/2076252484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0140088c0 0x7fb01400ad50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb020009ac0 tx=0x7fb0140036f0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.302+0000 7fb02bfff640 1 -- 172.21.15.88:0/2076252484 reap_dead start 2024-01-22T10:13:30.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.302+0000 7fb031c2b640 1 -- 172.21.15.88:0/2076252484 shutdown_connections 2024-01-22T10:13:30.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.302+0000 7fb031c2b640 1 -- 172.21.15.88:0/2076252484 >> 172.21.15.88:0/2076252484 conn(0x7fb02c06a6f0 msgr2=0x7fb02c06ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:30.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.302+0000 7fb031c2b640 1 -- 172.21.15.88:0/2076252484 shutdown_connections 2024-01-22T10:13:30.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.302+0000 7fb031c2b640 1 -- 172.21.15.88:0/2076252484 wait complete. 2024-01-22T10:13:30.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.303+0000 7fb031c2b640 1 Processor -- start 2024-01-22T10:13:30.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.303+0000 7fb031c2b640 1 -- start start 2024-01-22T10:13:30.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb031c2b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0140088c0 0x7fb02c13c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb031c2b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c135f80 0x7fb02c1363c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb031c2b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c13a270 0x7fb02c13a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb031c2b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c13ac30 con 0x7fb0140088c0 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb031c2b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c072590 con 0x7fb02c135f80 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb031c2b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c1dd1a0 con 0x7fb02c13a270 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb02b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0140088c0 0x7fb02c13c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb02b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0140088c0 0x7fb02c13c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54256/0 (socket says 172.21.15.88:54256) 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb02b7fe640 1 -- 172.21.15.88:0/1711497747 learned_addr learned my addr 172.21.15.88:0/1711497747 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb02affd640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c135f80 0x7fb02c1363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb02bfff640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c13a270 0x7fb02c13a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb02b7fe640 1 -- 172.21.15.88:0/1711497747 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c13a270 msgr2=0x7fb02c13a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb02b7fe640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c13a270 0x7fb02c13a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb02b7fe640 1 -- 172.21.15.88:0/1711497747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c135f80 msgr2=0x7fb02c1363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb02b7fe640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c135f80 0x7fb02c1363c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb02b7fe640 1 -- 172.21.15.88:0/1711497747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c1dd480 con 0x7fb0140088c0 2024-01-22T10:13:30.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb02affd640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c135f80 0x7fb02c1363c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb02b7fe640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0140088c0 0x7fb02c13c3b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0072c0 tx=0x7fb01c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb013fff640 1 -- 172.21.15.88:0/1711497747 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c004ea0 con 0x7fb0140088c0 2024-01-22T10:13:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb013fff640 1 -- 172.21.15.88:0/1711497747 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c00f960 con 0x7fb0140088c0 2024-01-22T10:13:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb031c2b640 1 -- 172.21.15.88:0/1711497747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c1dd760 con 0x7fb0140088c0 2024-01-22T10:13:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb013fff640 1 -- 172.21.15.88:0/1711497747 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00fd10 con 0x7fb0140088c0 2024-01-22T10:13:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.304+0000 7fb031c2b640 1 -- 172.21.15.88:0/1711497747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c13d150 con 0x7fb0140088c0 2024-01-22T10:13:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.305+0000 7fb031c2b640 1 -- 172.21.15.88:0/1711497747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c1dd9a0 con 0x7fb0140088c0 2024-01-22T10:13:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.306+0000 7fb013fff640 1 -- 172.21.15.88:0/1711497747 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fb01c01d460 con 0x7fb0140088c0 2024-01-22T10:13:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.306+0000 7fb013fff640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb01806b330 0x7fb01806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.306+0000 7fb013fff640 1 -- 172.21.15.88:0/1711497747 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb01c089e10 con 0x7fb0140088c0 2024-01-22T10:13:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.306+0000 7fb02affd640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb01806b330 0x7fb01806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.307+0000 7fb02affd640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb01806b330 0x7fb01806d7f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb020036000 tx=0x7fb020030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:30.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.311+0000 7fb013fff640 1 -- 172.21.15.88:0/1711497747 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb02c1dd9a0 con 0x7fb0140088c0 2024-01-22T10:13:30.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.480+0000 7fb031c2b640 1 -- 172.21.15.88:0/1711497747 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb02c1dd9a0 con 0x7fb0140088c0 2024-01-22T10:13:30.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.480+0000 7fb013fff640 1 -- 172.21.15.88:0/1711497747 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb02c1dd9a0 con 0x7fb0140088c0 2024-01-22T10:13:30.463 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-01-22T10:13:30.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.482+0000 7fb031c2b640 1 -- 172.21.15.88:0/1711497747 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb01806b330 msgr2=0x7fb01806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.482+0000 7fb031c2b640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb01806b330 0x7fb01806d7f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb020036000 tx=0x7fb020030000 comp rx=0 tx=0).stop 2024-01-22T10:13:30.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.482+0000 7fb031c2b640 1 -- 172.21.15.88:0/1711497747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0140088c0 msgr2=0x7fb02c13c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.482+0000 7fb031c2b640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0140088c0 0x7fb02c13c3b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0072c0 tx=0x7fb01c007780 comp rx=0 tx=0).stop 2024-01-22T10:13:30.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.482+0000 7fb031c2b640 1 -- 172.21.15.88:0/1711497747 shutdown_connections 2024-01-22T10:13:30.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.482+0000 7fb031c2b640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb01806b330 0x7fb01806d7f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.482+0000 7fb031c2b640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb02c13a270 0x7fb02c13a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.482+0000 7fb031c2b640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb02c135f80 0x7fb02c1363c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.482+0000 7fb031c2b640 1 --2- 172.21.15.88:0/1711497747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0140088c0 0x7fb02c13c3b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.482+0000 7fb031c2b640 1 -- 172.21.15.88:0/1711497747 >> 172.21.15.88:0/1711497747 conn(0x7fb02c06a6f0 msgr2=0x7fb02c144660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:30.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.482+0000 7fb031c2b640 1 -- 172.21.15.88:0/1711497747 shutdown_connections 2024-01-22T10:13:30.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.482+0000 7fb031c2b640 1 -- 172.21.15.88:0/1711497747 wait complete. 2024-01-22T10:13:30.475 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:13:30.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.592+0000 7f08cafa9640 1 Processor -- start 2024-01-22T10:13:30.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.592+0000 7f08cafa9640 1 -- start start 2024-01-22T10:13:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.593+0000 7f08cafa9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f08c406ff80 0x7f08c40b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.593+0000 7f08cafa9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c4071ef0 con 0x7f08c406f6e0 2024-01-22T10:13:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.593+0000 7f08cafa9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c40726a0 con 0x7f08c4070360 2024-01-22T10:13:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.593+0000 7f08cafa9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c4071720 con 0x7f08c406ff80 2024-01-22T10:13:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.593+0000 7f08c8d45640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f08c406ff80 0x7f08c40b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.593+0000 7f08c3fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f08c406f6e0 0x7f08c4143590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42088/0 (socket says 172.21.15.88:42088) 2024-01-22T10:13:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.593+0000 7f08c3fff640 1 -- 172.21.15.88:0/1110525541 learned_addr learned my addr 172.21.15.88:0/1110525541 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.593+0000 7f08c8d45640 1 -- 172.21.15.88:0/1110525541 >> v1:172.21.15.119:6789/0 conn(0x7f08c4070360 legacy=0x7f08c414ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.593+0000 7f08c8d45640 1 -- 172.21.15.88:0/1110525541 >> v1:172.21.15.88:6789/0 conn(0x7f08c406f6e0 legacy=0x7f08c4143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.593+0000 7f08c37fe640 1 -- 172.21.15.88:0/1110525541 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748299243 0 0) 0x7f08c4071ef0 con 0x7f08c406f6e0 2024-01-22T10:13:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.593+0000 7f08c8d45640 1 -- 172.21.15.88:0/1110525541 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c4070770 con 0x7f08c406ff80 2024-01-22T10:13:30.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.594+0000 7f08c8d45640 1 --2- 172.21.15.88:0/1110525541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08c406ff80 0x7f08c40b6f50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f08b40097a0 tx=0x7f08b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b783acdd700768 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:30.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.594+0000 7f08c37fe640 1 -- 172.21.15.88:0/1110525541 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4031830 con 0x7f08c406ff80 2024-01-22T10:13:30.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.594+0000 7f08c37fe640 1 -- 172.21.15.88:0/1110525541 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4031990 con 0x7f08c406ff80 2024-01-22T10:13:30.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.594+0000 7f08c37fe640 1 -- 172.21.15.88:0/1110525541 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4031d20 con 0x7f08c406ff80 2024-01-22T10:13:30.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.595+0000 7f08cafa9640 1 -- 172.21.15.88:0/1110525541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08c406ff80 msgr2=0x7f08c40b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.595+0000 7f08cafa9640 1 --2- 172.21.15.88:0/1110525541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08c406ff80 0x7f08c40b6f50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f08b40097a0 tx=0x7f08b402b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.595+0000 7f08cafa9640 1 -- 172.21.15.88:0/1110525541 shutdown_connections 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.595+0000 7f08cafa9640 1 --2- 172.21.15.88:0/1110525541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08c406ff80 0x7f08c40b6f50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.595+0000 7f08cafa9640 1 -- 172.21.15.88:0/1110525541 >> 172.21.15.88:0/1110525541 conn(0x7f08c40badd0 msgr2=0x7f08c40bb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.595+0000 7f08cafa9640 1 -- 172.21.15.88:0/1110525541 shutdown_connections 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.595+0000 7f08cafa9640 1 -- 172.21.15.88:0/1110525541 wait complete. 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.596+0000 7f08cafa9640 1 Processor -- start 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.596+0000 7f08cafa9640 1 -- start start 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08cafa9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08c406f6e0 0x7f08c413fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08cafa9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08c406ff80 0x7f08c413eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08cafa9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c4070360 0x7f08c40b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08cafa9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c413eff0 con 0x7f08c406ff80 2024-01-22T10:13:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08cafa9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c413ad60 con 0x7f08c4070360 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08cafa9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c41df530 con 0x7f08c406f6e0 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08c406ff80 0x7f08c413eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08c406ff80 0x7f08c413eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54278/0 (socket says 172.21.15.88:54278) 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c3fff640 1 -- 172.21.15.88:0/1362887767 learned_addr learned my addr 172.21.15.88:0/1362887767 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c9546640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c4070360 0x7f08c40b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c8d45640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08c406f6e0 0x7f08c413fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c3fff640 1 -- 172.21.15.88:0/1362887767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08c406f6e0 msgr2=0x7f08c413fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c3fff640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08c406f6e0 0x7f08c413fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c3fff640 1 -- 172.21.15.88:0/1362887767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c4070360 msgr2=0x7f08c40b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c3fff640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c4070360 0x7f08c40b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c3fff640 1 -- 172.21.15.88:0/1362887767 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b4009400 con 0x7f08c406ff80 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c8d45640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08c406f6e0 0x7f08c413fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c3fff640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08c406ff80 0x7f08c413eab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f08b800c4d0 tx=0x7f08b800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c17fa640 1 -- 172.21.15.88:0/1362887767 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b80074e0 con 0x7f08c406ff80 2024-01-22T10:13:30.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c17fa640 1 -- 172.21.15.88:0/1362887767 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b8007660 con 0x7f08c406ff80 2024-01-22T10:13:30.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08c17fa640 1 -- 172.21.15.88:0/1362887767 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8004a20 con 0x7f08c406ff80 2024-01-22T10:13:30.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08cafa9640 1 -- 172.21.15.88:0/1362887767 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c40b4d50 con 0x7f08c406ff80 2024-01-22T10:13:30.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.597+0000 7f08cafa9640 1 -- 172.21.15.88:0/1362887767 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c41deee0 con 0x7f08c406ff80 2024-01-22T10:13:30.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.598+0000 7f08cafa9640 1 -- 172.21.15.88:0/1362887767 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c40b88b0 con 0x7f08c406ff80 2024-01-22T10:13:30.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.599+0000 7f08c17fa640 1 -- 172.21.15.88:0/1362887767 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f08b8004b80 con 0x7f08c406ff80 2024-01-22T10:13:30.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.599+0000 7f08c17fa640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f08b006b360 0x7f08b006d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.599+0000 7f08c17fa640 1 -- 172.21.15.88:0/1362887767 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08b8089050 con 0x7f08c406ff80 2024-01-22T10:13:30.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.599+0000 7f08c8d45640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f08b006b360 0x7f08b006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.600+0000 7f08c8d45640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f08b006b360 0x7f08b006d820 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f08b4036000 tx=0x7f08b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:30.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.603+0000 7f08c17fa640 1 -- 172.21.15.88:0/1362887767 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f08b8053d70 con 0x7f08c406ff80 2024-01-22T10:13:30.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.808+0000 7f08cafa9640 1 -- 172.21.15.88:0/1362887767 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08c41df6a0 con 0x7f08c406ff80 2024-01-22T10:13:30.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.809+0000 7f08c17fa640 1 -- 172.21.15.88:0/1362887767 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4145 (secure 0 0 0) 0x7f08b8018090 con 0x7f08c406ff80 2024-01-22T10:13:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:30.792 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3660245466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3660245466},{"type":"v1","addr":"172.21.15.119:6833","nonce":3660245466}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/3438486113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3438486113},{"type":"v1","addr":"172.21.15.88:6836","nonce":3438486113}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T10:13:02.851192+0000","modified":"2024-01-22T10:13:04.853526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/1505620357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1505620357},{"type":"v1","addr":"172.21.15.88:6837","nonce":1505620357}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-22T10:13:30.792 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 6 2024-01-22T10:13:30.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.811+0000 7f08cafa9640 1 -- 172.21.15.88:0/1362887767 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f08b006b360 msgr2=0x7f08b006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.811+0000 7f08cafa9640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f08b006b360 0x7f08b006d820 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f08b4036000 tx=0x7f08b4008030 comp rx=0 tx=0).stop 2024-01-22T10:13:30.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.811+0000 7f08cafa9640 1 -- 172.21.15.88:0/1362887767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08c406ff80 msgr2=0x7f08c413eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.811+0000 7f08cafa9640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08c406ff80 0x7f08c413eab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f08b800c4d0 tx=0x7f08b800c990 comp rx=0 tx=0).stop 2024-01-22T10:13:30.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.811+0000 7f08cafa9640 1 -- 172.21.15.88:0/1362887767 shutdown_connections 2024-01-22T10:13:30.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.811+0000 7f08cafa9640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f08b006b360 0x7f08b006d820 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.811+0000 7f08cafa9640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c4070360 0x7f08c40b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.811+0000 7f08cafa9640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08c406ff80 0x7f08c413eab0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.811+0000 7f08cafa9640 1 --2- 172.21.15.88:0/1362887767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08c406f6e0 0x7f08c413fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.811+0000 7f08cafa9640 1 -- 172.21.15.88:0/1362887767 >> 172.21.15.88:0/1362887767 conn(0x7f08c40badd0 msgr2=0x7f08c40bc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:30.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.811+0000 7f08cafa9640 1 -- 172.21.15.88:0/1362887767 shutdown_connections 2024-01-22T10:13:30.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.811+0000 7f08cafa9640 1 -- 172.21.15.88:0/1362887767 wait complete. 2024-01-22T10:13:30.804 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.920+0000 7ff60de5c640 1 Processor -- start 2024-01-22T10:13:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.920+0000 7ff60de5c640 1 -- start start 2024-01-22T10:13:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff60de5c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6080bdee0 0x7ff60814b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff60de5c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff608148c30 0x7ff608149050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff60de5c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff60814ece0 0x7ff60814f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff60de5c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6080bbb50 con 0x7ff608148c30 2024-01-22T10:13:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff60de5c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6080bc520 con 0x7ff60814ece0 2024-01-22T10:13:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff60de5c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6080bb800 con 0x7ff6080bdee0 2024-01-22T10:13:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff606ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff608148c30 0x7ff608149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff606ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff608148c30 0x7ff608149050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54288/0 (socket says 172.21.15.88:54288) 2024-01-22T10:13:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff606ffd640 1 -- 172.21.15.88:0/3614986020 learned_addr learned my addr 172.21.15.88:0/3614986020 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff607fff640 1 --2- 172.21.15.88:0/3614986020 >> v2:172.21.15.119:3300/0 conn(0x7ff60814ece0 0x7ff60814f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff6077fe640 1 --2- 172.21.15.88:0/3614986020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6080bdee0 0x7ff60814b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff606ffd640 1 -- 172.21.15.88:0/3614986020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6080bdee0 msgr2=0x7ff60814b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff606ffd640 1 --2- 172.21.15.88:0/3614986020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6080bdee0 0x7ff60814b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff606ffd640 1 -- 172.21.15.88:0/3614986020 >> v2:172.21.15.119:3300/0 conn(0x7ff60814ece0 msgr2=0x7ff60814f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff606ffd640 1 --2- 172.21.15.88:0/3614986020 >> v2:172.21.15.119:3300/0 conn(0x7ff60814ece0 0x7ff60814f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.921+0000 7ff606ffd640 1 -- 172.21.15.88:0/3614986020 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6080bf820 con 0x7ff608148c30 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.922+0000 7ff606ffd640 1 --2- 172.21.15.88:0/3614986020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff608148c30 0x7ff608149050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff6080befc0 tx=0x7ff5fc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a702aac2a70efa server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.922+0000 7ff6067fc640 1 -- 172.21.15.88:0/3614986020 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0317e0 con 0x7ff608148c30 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.922+0000 7ff6067fc640 1 -- 172.21.15.88:0/3614986020 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc031940 con 0x7ff608148c30 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.922+0000 7ff6067fc640 1 -- 172.21.15.88:0/3614986020 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc031cd0 con 0x7ff608148c30 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.923+0000 7ff60de5c640 1 -- 172.21.15.88:0/3614986020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff608148c30 msgr2=0x7ff608149050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.923+0000 7ff60de5c640 1 --2- 172.21.15.88:0/3614986020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff608148c30 0x7ff608149050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff6080befc0 tx=0x7ff5fc02b880 comp rx=0 tx=0).stop 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.923+0000 7ff60de5c640 1 -- 172.21.15.88:0/3614986020 shutdown_connections 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.923+0000 7ff60de5c640 1 --2- 172.21.15.88:0/3614986020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff608148c30 0x7ff608149050 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.923+0000 7ff60de5c640 1 --2- 172.21.15.88:0/3614986020 >> v2:172.21.15.119:3300/0 conn(0x7ff60814ece0 0x7ff60814f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.923+0000 7ff60de5c640 1 --2- 172.21.15.88:0/3614986020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6080bdee0 0x7ff60814b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.923+0000 7ff60de5c640 1 -- 172.21.15.88:0/3614986020 >> 172.21.15.88:0/3614986020 conn(0x7ff6080a2d80 msgr2=0x7ff6080a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.923+0000 7ff60de5c640 1 -- 172.21.15.88:0/3614986020 shutdown_connections 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.923+0000 7ff60de5c640 1 -- 172.21.15.88:0/3614986020 wait complete. 2024-01-22T10:13:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.924+0000 7ff60de5c640 1 Processor -- start 2024-01-22T10:13:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.924+0000 7ff60de5c640 1 -- start start 2024-01-22T10:13:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff60de5c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6080bdee0 0x7ff6080a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff60de5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff608148c30 0x7ff6081e4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff60de5c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff60814ece0 0x7ff6081e4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff60de5c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6080a6750 con 0x7ff6080bdee0 2024-01-22T10:13:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff60de5c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff608145d80 con 0x7ff608148c30 2024-01-22T10:13:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff60de5c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6080bb530 con 0x7ff60814ece0 2024-01-22T10:13:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff6077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6080bdee0 0x7ff6080a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff6077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6080bdee0 0x7ff6080a6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54292/0 (socket says 172.21.15.88:54292) 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff6077fe640 1 -- 172.21.15.88:0/2803275688 learned_addr learned my addr 172.21.15.88:0/2803275688 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff607fff640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff60814ece0 0x7ff6081e4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff606ffd640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff608148c30 0x7ff6081e4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff6077fe640 1 -- 172.21.15.88:0/2803275688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff60814ece0 msgr2=0x7ff6081e4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff6077fe640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff60814ece0 0x7ff6081e4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff6077fe640 1 -- 172.21.15.88:0/2803275688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff608148c30 msgr2=0x7ff6081e4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff6077fe640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff608148c30 0x7ff6081e4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff6077fe640 1 -- 172.21.15.88:0/2803275688 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc0094d0 con 0x7ff6080bdee0 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff6077fe640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6080bdee0 0x7ff6080a6210 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800e890 tx=0x7ff5f800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff5effff640 1 -- 172.21.15.88:0/2803275688 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800c940 con 0x7ff6080bdee0 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff5effff640 1 -- 172.21.15.88:0/2803275688 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f800caa0 con 0x7ff6080bdee0 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff60de5c640 1 -- 172.21.15.88:0/2803275688 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6081492d0 con 0x7ff6080bdee0 2024-01-22T10:13:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff5effff640 1 -- 172.21.15.88:0/2803275688 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800ce30 con 0x7ff6080bdee0 2024-01-22T10:13:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.925+0000 7ff60de5c640 1 -- 172.21.15.88:0/2803275688 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6080b7420 con 0x7ff6080bdee0 2024-01-22T10:13:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.926+0000 7ff60de5c640 1 -- 172.21.15.88:0/2803275688 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60804ea30 con 0x7ff6080bdee0 2024-01-22T10:13:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.927+0000 7ff5effff640 1 -- 172.21.15.88:0/2803275688 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7ff5f8013470 con 0x7ff6080bdee0 2024-01-22T10:13:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.927+0000 7ff5effff640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff5f406b330 0x7ff5f406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.927+0000 7ff5effff640 1 -- 172.21.15.88:0/2803275688 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5f8089cc0 con 0x7ff6080bdee0 2024-01-22T10:13:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.927+0000 7ff606ffd640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff5f406b330 0x7ff5f406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.928+0000 7ff606ffd640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff5f406b330 0x7ff5f406d7f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc036000 tx=0x7ff5fc03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:30.931+0000 7ff5effff640 1 -- 172.21.15.88:0/2803275688 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff5f8054a90 con 0x7ff6080bdee0 2024-01-22T10:13:31.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.100+0000 7ff60de5c640 1 -- 172.21.15.88:0/2803275688 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6080bff70 con 0x7ff6080bdee0 2024-01-22T10:13:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.101+0000 7ff5effff640 1 -- 172.21.15.88:0/2803275688 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7ff5f8017090 con 0x7ff6080bdee0 2024-01-22T10:13:31.084 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:31.084 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.103+0000 7ff60de5c640 1 -- 172.21.15.88:0/2803275688 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff5f406b330 msgr2=0x7ff5f406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.103+0000 7ff60de5c640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff5f406b330 0x7ff5f406d7f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc036000 tx=0x7ff5fc03d040 comp rx=0 tx=0).stop 2024-01-22T10:13:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.103+0000 7ff60de5c640 1 -- 172.21.15.88:0/2803275688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6080bdee0 msgr2=0x7ff6080a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.103+0000 7ff60de5c640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6080bdee0 0x7ff6080a6210 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800e890 tx=0x7ff5f800ed50 comp rx=0 tx=0).stop 2024-01-22T10:13:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.103+0000 7ff60de5c640 1 -- 172.21.15.88:0/2803275688 shutdown_connections 2024-01-22T10:13:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.103+0000 7ff60de5c640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff5f406b330 0x7ff5f406d7f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.103+0000 7ff60de5c640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff60814ece0 0x7ff6081e4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.103+0000 7ff60de5c640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff608148c30 0x7ff6081e4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.103+0000 7ff60de5c640 1 --2- 172.21.15.88:0/2803275688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6080bdee0 0x7ff6080a6210 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.103+0000 7ff60de5c640 1 -- 172.21.15.88:0/2803275688 >> 172.21.15.88:0/2803275688 conn(0x7ff6080a2d80 msgr2=0x7ff60814d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.103+0000 7ff60de5c640 1 -- 172.21.15.88:0/2803275688 shutdown_connections 2024-01-22T10:13:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.103+0000 7ff60de5c640 1 -- 172.21.15.88:0/2803275688 wait complete. 2024-01-22T10:13:31.097 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T10:13:31.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:13:31.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.214+0000 7f2f4e93e640 1 Processor -- start 2024-01-22T10:13:31.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.214+0000 7f2f4e93e640 1 -- start start 2024-01-22T10:13:31.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.214+0000 7f2f4e93e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f480bab30 0x7f2f480b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.214+0000 7f2f4e93e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2f480b5bb0 0x7f2f48156020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.214+0000 7f2f4e93e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4806bf10 con 0x7f2f480b5750 2024-01-22T10:13:31.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.214+0000 7f2f4e93e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4806d150 con 0x7f2f480b5bb0 2024-01-22T10:13:31.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.214+0000 7f2f4e93e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480baf10 con 0x7f2f480bab30 2024-01-22T10:13:31.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.215+0000 7f2f4cedb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2f480b5bb0 0x7f2f48156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.215+0000 7f2f477fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2f480b5750 0x7f2f4806b800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42092/0 (socket says 172.21.15.88:42092) 2024-01-22T10:13:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.215+0000 7f2f477fe640 1 -- 172.21.15.88:0/1948185948 learned_addr learned my addr 172.21.15.88:0/1948185948 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.215+0000 7f2f47fff640 1 --2- 172.21.15.88:0/1948185948 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f480bab30 0x7f2f480b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.215+0000 7f2f4cedb640 1 -- 172.21.15.88:0/1948185948 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f480bab30 msgr2=0x7f2f480b9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.215+0000 7f2f4cedb640 1 --2- 172.21.15.88:0/1948185948 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f480bab30 0x7f2f480b9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.215+0000 7f2f4cedb640 1 -- 172.21.15.88:0/1948185948 >> v1:172.21.15.88:6789/0 conn(0x7f2f480b5750 legacy=0x7f2f4806b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.215+0000 7f2f4cedb640 1 -- 172.21.15.88:0/1948185948 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4814b710 con 0x7f2f480b5bb0 2024-01-22T10:13:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.215+0000 7f2f46ffd640 1 -- 172.21.15.88:0/1948185948 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292161992 0 0) 0x7f2f4806bf10 con 0x7f2f480b5750 2024-01-22T10:13:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.216+0000 7f2f4cedb640 1 --2- 172.21.15.88:0/1948185948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f480b5bb0 0x7f2f48156020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009d90 tx=0x7f2f4002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8dc9b15b3238f1d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.216+0000 7f2f46ffd640 1 -- 172.21.15.88:0/1948185948 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4002cc50 con 0x7f2f480b5bb0 2024-01-22T10:13:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.216+0000 7f2f46ffd640 1 -- 172.21.15.88:0/1948185948 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4002cdb0 con 0x7f2f480b5bb0 2024-01-22T10:13:31.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.216+0000 7f2f46ffd640 1 -- 172.21.15.88:0/1948185948 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40034660 con 0x7f2f480b5bb0 2024-01-22T10:13:31.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.216+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1948185948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f480b5bb0 msgr2=0x7f2f48156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.216+0000 7f2f4e93e640 1 --2- 172.21.15.88:0/1948185948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f480b5bb0 0x7f2f48156020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009d90 tx=0x7f2f4002bea0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.216+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1948185948 shutdown_connections 2024-01-22T10:13:31.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.216+0000 7f2f4e93e640 1 --2- 172.21.15.88:0/1948185948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f480b5bb0 0x7f2f48156020 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.216+0000 7f2f4e93e640 1 --2- 172.21.15.88:0/1948185948 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f480bab30 0x7f2f480b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.216+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1948185948 >> 172.21.15.88:0/1948185948 conn(0x7f2f480bb840 msgr2=0x7f2f480bbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:31.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.216+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1948185948 shutdown_connections 2024-01-22T10:13:31.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.216+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1948185948 wait complete. 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.217+0000 7f2f4e93e640 1 Processor -- start 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.217+0000 7f2f4e93e640 1 -- start start 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4e93e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f480b5750 0x7f2f48149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4e93e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f480b5bb0 0x7f2f480b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4e93e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f480bab30 0x7f2f48145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4e93e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480b8b50 con 0x7f2f480bab30 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4e93e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f48148600 con 0x7f2f480b5bb0 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4e93e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f48147cd0 con 0x7f2f480b5750 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4cedb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f480bab30 0x7f2f48145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4cedb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f480bab30 0x7f2f48145d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54306/0 (socket says 172.21.15.88:54306) 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4cedb640 1 -- 172.21.15.88:0/1385425449 learned_addr learned my addr 172.21.15.88:0/1385425449 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f477fe640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f480b5bb0 0x7f2f480b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f47fff640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f480b5750 0x7f2f48149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4cedb640 1 -- 172.21.15.88:0/1385425449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f480b5750 msgr2=0x7f2f48149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4cedb640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f480b5750 0x7f2f48149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4cedb640 1 -- 172.21.15.88:0/1385425449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f480b5bb0 msgr2=0x7f2f480b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4cedb640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f480b5bb0 0x7f2f480b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f4cedb640 1 -- 172.21.15.88:0/1385425449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f40009a70 con 0x7f2f480bab30 2024-01-22T10:13:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.218+0000 7f2f477fe640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f480b5bb0 0x7f2f480b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.219+0000 7f2f4cedb640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f480bab30 0x7f2f48145d60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009d90 tx=0x7f2f40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.219+0000 7f2f44ff9640 1 -- 172.21.15.88:0/1385425449 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40040650 con 0x7f2f480bab30 2024-01-22T10:13:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.219+0000 7f2f44ff9640 1 -- 172.21.15.88:0/1385425449 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f400407d0 con 0x7f2f480bab30 2024-01-22T10:13:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.219+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1385425449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f48147fb0 con 0x7f2f480bab30 2024-01-22T10:13:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.219+0000 7f2f44ff9640 1 -- 172.21.15.88:0/1385425449 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40040b80 con 0x7f2f480bab30 2024-01-22T10:13:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.219+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1385425449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f48147840 con 0x7f2f480bab30 2024-01-22T10:13:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.220+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1385425449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f480bb500 con 0x7f2f480bab30 2024-01-22T10:13:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.220+0000 7f2f44ff9640 1 -- 172.21.15.88:0/1385425449 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f2f40040ce0 con 0x7f2f480bab30 2024-01-22T10:13:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.220+0000 7f2f44ff9640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2f3406b330 0x7f2f3406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.221+0000 7f2f47fff640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2f3406b330 0x7f2f3406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.221+0000 7f2f44ff9640 1 -- 172.21.15.88:0/1385425449 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f400aca00 con 0x7f2f480bab30 2024-01-22T10:13:31.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.221+0000 7f2f47fff640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2f3406b330 0x7f2f3406d7f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2f38006fd0 tx=0x7f2f38008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:31.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.225+0000 7f2f44ff9640 1 -- 172.21.15.88:0/1385425449 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2f40077680 con 0x7f2f480bab30 2024-01-22T10:13:31.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.429+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1385425449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f4804ea30 con 0x7f2f480bab30 2024-01-22T10:13:31.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.429+0000 7f2f44ff9640 1 -- 172.21.15.88:0/1385425449 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4145 (secure 0 0 0) 0x7f2f4007aca0 con 0x7f2f480bab30 2024-01-22T10:13:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:31.412 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3660245466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3660245466},{"type":"v1","addr":"172.21.15.119:6833","nonce":3660245466}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/3438486113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3438486113},{"type":"v1","addr":"172.21.15.88:6836","nonce":3438486113}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T10:13:02.851192+0000","modified":"2024-01-22T10:13:04.853526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/1505620357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1505620357},{"type":"v1","addr":"172.21.15.88:6837","nonce":1505620357}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-22T10:13:31.412 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 6 2024-01-22T10:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.431+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1385425449 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2f3406b330 msgr2=0x7f2f3406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.431+0000 7f2f4e93e640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2f3406b330 0x7f2f3406d7f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2f38006fd0 tx=0x7f2f38008040 comp rx=0 tx=0).stop 2024-01-22T10:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.431+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1385425449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f480bab30 msgr2=0x7f2f48145d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.431+0000 7f2f4e93e640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f480bab30 0x7f2f48145d60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009d90 tx=0x7f2f40004a40 comp rx=0 tx=0).stop 2024-01-22T10:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.431+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1385425449 shutdown_connections 2024-01-22T10:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.431+0000 7f2f4e93e640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2f3406b330 0x7f2f3406d7f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.431+0000 7f2f4e93e640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f480bab30 0x7f2f48145d60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.431+0000 7f2f4e93e640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f480b5bb0 0x7f2f480b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.431+0000 7f2f4e93e640 1 --2- 172.21.15.88:0/1385425449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f480b5750 0x7f2f48149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.431+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1385425449 >> 172.21.15.88:0/1385425449 conn(0x7f2f480bb840 msgr2=0x7f2f480b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.431+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1385425449 shutdown_connections 2024-01-22T10:13:31.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.431+0000 7f2f4e93e640 1 -- 172.21.15.88:0/1385425449 wait complete. 2024-01-22T10:13:31.424 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:13:31.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.542+0000 7fe20d90f640 1 Processor -- start 2024-01-22T10:13:31.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.542+0000 7fe20d90f640 1 -- start start 2024-01-22T10:13:31.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe20d90f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2080bad30 0x7fe208149530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe20d90f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe20806fa90 0x7fe208153db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe20d90f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2080b4450 con 0x7fe20806f6b0 2024-01-22T10:13:31.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe20d90f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2080b4bc0 con 0x7fe20806fa90 2024-01-22T10:13:31.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe20d90f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe208149a70 con 0x7fe2080bad30 2024-01-22T10:13:31.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe2077fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe20806fa90 0x7fe208153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe2077fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe20806fa90 0x7fe208153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54314/0 (socket says 172.21.15.88:54314) 2024-01-22T10:13:31.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe2077fe640 1 -- 172.21.15.88:0/1118024514 learned_addr learned my addr 172.21.15.88:0/1118024514 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:31.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe2067fc640 1 --2- 172.21.15.88:0/1118024514 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2080bad30 0x7fe208149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe2077fe640 1 -- 172.21.15.88:0/1118024514 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2080bad30 msgr2=0x7fe208149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:31.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe2077fe640 1 --2- 172.21.15.88:0/1118024514 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2080bad30 0x7fe208149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe2077fe640 1 -- 172.21.15.88:0/1118024514 >> v1:172.21.15.119:6789/0 conn(0x7fe20806f6b0 legacy=0x7fe2080b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.543+0000 7fe2077fe640 1 -- 172.21.15.88:0/1118024514 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe208143cb0 con 0x7fe20806fa90 2024-01-22T10:13:31.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.544+0000 7fe2077fe640 1 --2- 172.21.15.88:0/1118024514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe20806fa90 0x7fe208153db0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe200009870 tx=0x7fe20002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f64a02d713b4ae server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:31.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.544+0000 7fe205ffb640 1 -- 172.21.15.88:0/1118024514 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2000317c0 con 0x7fe20806fa90 2024-01-22T10:13:31.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.544+0000 7fe205ffb640 1 -- 172.21.15.88:0/1118024514 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe200031920 con 0x7fe20806fa90 2024-01-22T10:13:31.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.544+0000 7fe205ffb640 1 -- 172.21.15.88:0/1118024514 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200031cb0 con 0x7fe20806fa90 2024-01-22T10:13:31.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.545+0000 7fe20d90f640 1 -- 172.21.15.88:0/1118024514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe20806fa90 msgr2=0x7fe208153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.545+0000 7fe20d90f640 1 --2- 172.21.15.88:0/1118024514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe20806fa90 0x7fe208153db0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe200009870 tx=0x7fe20002b860 comp rx=0 tx=0).stop 2024-01-22T10:13:31.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.545+0000 7fe20d90f640 1 -- 172.21.15.88:0/1118024514 shutdown_connections 2024-01-22T10:13:31.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.545+0000 7fe20d90f640 1 --2- 172.21.15.88:0/1118024514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe20806fa90 0x7fe208153db0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.545+0000 7fe20d90f640 1 --2- 172.21.15.88:0/1118024514 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2080bad30 0x7fe208149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.545+0000 7fe20d90f640 1 -- 172.21.15.88:0/1118024514 >> 172.21.15.88:0/1118024514 conn(0x7fe208071500 msgr2=0x7fe208071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:31.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.545+0000 7fe20d90f640 1 -- 172.21.15.88:0/1118024514 shutdown_connections 2024-01-22T10:13:31.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.545+0000 7fe20d90f640 1 -- 172.21.15.88:0/1118024514 wait complete. 2024-01-22T10:13:31.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.546+0000 7fe20d90f640 1 Processor -- start 2024-01-22T10:13:31.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.546+0000 7fe20d90f640 1 -- start start 2024-01-22T10:13:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe20d90f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe20806f6b0 0x7fe20814c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe20d90f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe20806fa90 0x7fe2081e2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe20d90f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2080bad30 0x7fe2081dea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe20d90f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2081e20d0 con 0x7fe2080bad30 2024-01-22T10:13:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe20d90f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2081e23b0 con 0x7fe20806fa90 2024-01-22T10:13:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe20d90f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2081e2690 con 0x7fe20806f6b0 2024-01-22T10:13:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe2077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2080bad30 0x7fe2081dea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe2077fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2080bad30 0x7fe2081dea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54330/0 (socket says 172.21.15.88:54330) 2024-01-22T10:13:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe2077fe640 1 -- 172.21.15.88:0/1169177992 learned_addr learned my addr 172.21.15.88:0/1169177992 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe2077fe640 1 -- 172.21.15.88:0/1169177992 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe20806f6b0 msgr2=0x7fe20814c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe2077fe640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe20806f6b0 0x7fe20814c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe2077fe640 1 -- 172.21.15.88:0/1169177992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe20806fa90 msgr2=0x7fe2081e2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe2067fc640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe20806fa90 0x7fe2081e2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe2077fe640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe20806fa90 0x7fe2081e2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe2077fe640 1 -- 172.21.15.88:0/1169177992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000094d0 con 0x7fe2080bad30 2024-01-22T10:13:31.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe2077fe640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2080bad30 0x7fe2081dea60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe2000090b0 tx=0x7fe2000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:31.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe1effff640 1 -- 172.21.15.88:0/1169177992 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200032860 con 0x7fe2080bad30 2024-01-22T10:13:31.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe1effff640 1 -- 172.21.15.88:0/1169177992 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2000329e0 con 0x7fe2080bad30 2024-01-22T10:13:31.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe20d90f640 1 -- 172.21.15.88:0/1169177992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe208140090 con 0x7fe2080bad30 2024-01-22T10:13:31.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe1effff640 1 -- 172.21.15.88:0/1169177992 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200032d90 con 0x7fe2080bad30 2024-01-22T10:13:31.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.547+0000 7fe20d90f640 1 -- 172.21.15.88:0/1169177992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20814d780 con 0x7fe2080bad30 2024-01-22T10:13:31.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.548+0000 7fe20d90f640 1 -- 172.21.15.88:0/1169177992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2081e28a0 con 0x7fe2080bad30 2024-01-22T10:13:31.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.549+0000 7fe1effff640 1 -- 172.21.15.88:0/1169177992 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fe20004e450 con 0x7fe2080bad30 2024-01-22T10:13:31.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.549+0000 7fe1effff640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe1f406b330 0x7fe1f406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.549+0000 7fe1effff640 1 -- 172.21.15.88:0/1169177992 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2000abdb0 con 0x7fe2080bad30 2024-01-22T10:13:31.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.549+0000 7fe206ffd640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe1f406b330 0x7fe1f406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.549+0000 7fe206ffd640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe1f406b330 0x7fe1f406d7f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80012e0 tx=0x7fe1f8007d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:31.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.553+0000 7fe1effff640 1 -- 172.21.15.88:0/1169177992 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe200076ad0 con 0x7fe2080bad30 2024-01-22T10:13:31.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.759+0000 7fe20d90f640 1 -- 172.21.15.88:0/1169177992 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2081e2210 con 0x7fe2080bad30 2024-01-22T10:13:31.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.760+0000 7fe1effff640 1 -- 172.21.15.88:0/1169177992 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4145 (secure 0 0 0) 0x7fe2081e2210 con 0x7fe2080bad30 2024-01-22T10:13:31.743 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:31.743 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/3660245466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3660245466},{"type":"v1","addr":"172.21.15.119:6833","nonce":3660245466}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/3438486113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":3438486113},{"type":"v1","addr":"172.21.15.88:6836","nonce":3438486113}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T10:13:02.851192+0000","modified":"2024-01-22T10:13:04.853526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6837/1505620357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1505620357},{"type":"v1","addr":"172.21.15.88:6837","nonce":1505620357}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-22T10:13:31.743 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 6 2024-01-22T10:13:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.762+0000 7fe20d90f640 1 -- 172.21.15.88:0/1169177992 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe1f406b330 msgr2=0x7fe1f406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.762+0000 7fe20d90f640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe1f406b330 0x7fe1f406d7f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80012e0 tx=0x7fe1f8007d50 comp rx=0 tx=0).stop 2024-01-22T10:13:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.762+0000 7fe20d90f640 1 -- 172.21.15.88:0/1169177992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2080bad30 msgr2=0x7fe2081dea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.762+0000 7fe20d90f640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2080bad30 0x7fe2081dea60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe2000090b0 tx=0x7fe2000046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.762+0000 7fe20d90f640 1 -- 172.21.15.88:0/1169177992 shutdown_connections 2024-01-22T10:13:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.762+0000 7fe20d90f640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fe1f406b330 0x7fe1f406d7f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.762+0000 7fe20d90f640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2080bad30 0x7fe2081dea60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.762+0000 7fe20d90f640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe20806fa90 0x7fe2081e2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.762+0000 7fe20d90f640 1 --2- 172.21.15.88:0/1169177992 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe20806f6b0 0x7fe20814c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.762+0000 7fe20d90f640 1 -- 172.21.15.88:0/1169177992 >> 172.21.15.88:0/1169177992 conn(0x7fe208071500 msgr2=0x7fe2081473f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:31.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.762+0000 7fe20d90f640 1 -- 172.21.15.88:0/1169177992 shutdown_connections 2024-01-22T10:13:31.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.762+0000 7fe20d90f640 1 -- 172.21.15.88:0/1169177992 wait complete. 2024-01-22T10:13:31.755 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:31.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.871+0000 7f92300e5640 1 Processor -- start 2024-01-22T10:13:31.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.871+0000 7f92300e5640 1 -- start start 2024-01-22T10:13:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.872+0000 7f92300e5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f92280bb8b0 0x7f92280b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.872+0000 7f92300e5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9228149760 0x7f9228149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.872+0000 7f92300e5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92280b8850 con 0x7f92280b5830 2024-01-22T10:13:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.872+0000 7f92300e5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92280b9060 con 0x7f92280bb8b0 2024-01-22T10:13:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.872+0000 7f92300e5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92280bab60 con 0x7f9228149760 2024-01-22T10:13:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.872+0000 7f922de81640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f92280bb8b0 0x7f92280b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.872+0000 7f922d680640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f92280b5830 0x7f9228143240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42094/0 (socket says 172.21.15.88:42094) 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.872+0000 7f922d680640 1 -- 172.21.15.88:0/1731001052 learned_addr learned my addr 172.21.15.88:0/1731001052 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.872+0000 7f922e682640 1 --2- 172.21.15.88:0/1731001052 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9228149760 0x7f9228149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.873+0000 7f922de81640 1 -- 172.21.15.88:0/1731001052 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9228149760 msgr2=0x7f9228149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.873+0000 7f922de81640 1 --2- 172.21.15.88:0/1731001052 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9228149760 0x7f9228149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.873+0000 7f922de81640 1 -- 172.21.15.88:0/1731001052 >> v1:172.21.15.88:6789/0 conn(0x7f92280b5830 legacy=0x7f9228143240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.873+0000 7f922de81640 1 -- 172.21.15.88:0/1731001052 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922814a130 con 0x7f92280bb8b0 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.873+0000 7f922ce7f640 1 -- 172.21.15.88:0/1731001052 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509563108 0 0) 0x7f92280b8850 con 0x7f92280b5830 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.873+0000 7f922de81640 1 --2- 172.21.15.88:0/1731001052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92280bb8b0 0x7f92280b95b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9220009d90 tx=0x7f922002bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f38dcf65f88299 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.873+0000 7f922ce7f640 1 -- 172.21.15.88:0/1731001052 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922002cce0 con 0x7f92280bb8b0 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.873+0000 7f922ce7f640 1 -- 172.21.15.88:0/1731001052 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922002ce40 con 0x7f92280bb8b0 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.873+0000 7f922ce7f640 1 -- 172.21.15.88:0/1731001052 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9220034660 con 0x7f92280bb8b0 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.874+0000 7f92300e5640 1 -- 172.21.15.88:0/1731001052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92280bb8b0 msgr2=0x7f92280b95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.874+0000 7f92300e5640 1 --2- 172.21.15.88:0/1731001052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92280bb8b0 0x7f92280b95b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9220009d90 tx=0x7f922002bf30 comp rx=0 tx=0).stop 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.874+0000 7f92300e5640 1 -- 172.21.15.88:0/1731001052 shutdown_connections 2024-01-22T10:13:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.874+0000 7f92300e5640 1 --2- 172.21.15.88:0/1731001052 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9228149760 0x7f9228149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.874+0000 7f92300e5640 1 --2- 172.21.15.88:0/1731001052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92280bb8b0 0x7f92280b95b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.874+0000 7f92300e5640 1 -- 172.21.15.88:0/1731001052 >> 172.21.15.88:0/1731001052 conn(0x7f9228066380 msgr2=0x7f9228066760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.874+0000 7f92300e5640 1 -- 172.21.15.88:0/1731001052 shutdown_connections 2024-01-22T10:13:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.874+0000 7f92300e5640 1 -- 172.21.15.88:0/1731001052 wait complete. 2024-01-22T10:13:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.875+0000 7f92300e5640 1 Processor -- start 2024-01-22T10:13:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.875+0000 7f92300e5640 1 -- start start 2024-01-22T10:13:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f92300e5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92280b5830 0x7f9228146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f92300e5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92280bb8b0 0x7f9228146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f92300e5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9228149760 0x7f9228145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f92300e5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922814d490 con 0x7f9228149760 2024-01-22T10:13:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f92300e5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922813af30 con 0x7f92280b5830 2024-01-22T10:13:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f92300e5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92281df140 con 0x7f92280bb8b0 2024-01-22T10:13:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f922e682640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9228149760 0x7f9228145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f922e682640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9228149760 0x7f9228145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54346/0 (socket says 172.21.15.88:54346) 2024-01-22T10:13:31.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f922e682640 1 -- 172.21.15.88:0/4236678918 learned_addr learned my addr 172.21.15.88:0/4236678918 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f922d680640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92280bb8b0 0x7f9228146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f922de81640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92280b5830 0x7f9228146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f922e682640 1 -- 172.21.15.88:0/4236678918 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92280bb8b0 msgr2=0x7f9228146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f922e682640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92280bb8b0 0x7f9228146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f922e682640 1 -- 172.21.15.88:0/4236678918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92280b5830 msgr2=0x7f9228146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f922e682640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92280b5830 0x7f9228146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f922e682640 1 -- 172.21.15.88:0/4236678918 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220009a70 con 0x7f9228149760 2024-01-22T10:13:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f922e682640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9228149760 0x7f9228145540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f922400d5d0 tx=0x7f922400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f921e7fc640 1 -- 172.21.15.88:0/4236678918 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92240125f0 con 0x7f9228149760 2024-01-22T10:13:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f921e7fc640 1 -- 172.21.15.88:0/4236678918 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9224012770 con 0x7f9228149760 2024-01-22T10:13:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f92300e5640 1 -- 172.21.15.88:0/4236678918 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92281df420 con 0x7f9228149760 2024-01-22T10:13:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f921e7fc640 1 -- 172.21.15.88:0/4236678918 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224012b20 con 0x7f9228149760 2024-01-22T10:13:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.876+0000 7f92300e5640 1 -- 172.21.15.88:0/4236678918 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92281dfc20 con 0x7f9228149760 2024-01-22T10:13:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.877+0000 7f92300e5640 1 -- 172.21.15.88:0/4236678918 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92280ba370 con 0x7f9228149760 2024-01-22T10:13:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.878+0000 7f921e7fc640 1 -- 172.21.15.88:0/4236678918 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f9224012c80 con 0x7f9228149760 2024-01-22T10:13:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.878+0000 7f921e7fc640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f920c06b330 0x7f920c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.878+0000 7f921e7fc640 1 -- 172.21.15.88:0/4236678918 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f922408a050 con 0x7f9228149760 2024-01-22T10:13:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.878+0000 7f922de81640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f920c06b330 0x7f920c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.878+0000 7f922de81640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f920c06b330 0x7f920c06d7f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9220036000 tx=0x7f9220030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:31.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:31.882+0000 7f921e7fc640 1 -- 172.21.15.88:0/4236678918 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9224054cf0 con 0x7f9228149760 2024-01-22T10:13:32.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.051+0000 7f92300e5640 1 -- 172.21.15.88:0/4236678918 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92281df940 con 0x7f9228149760 2024-01-22T10:13:32.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.052+0000 7f921e7fc640 1 -- 172.21.15.88:0/4236678918 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f92281df940 con 0x7f9228149760 2024-01-22T10:13:32.034 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:32.035 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:04.479008+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:00.844842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:01.816849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:32.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.054+0000 7f92300e5640 1 -- 172.21.15.88:0/4236678918 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f920c06b330 msgr2=0x7f920c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:32.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.054+0000 7f92300e5640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f920c06b330 0x7f920c06d7f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9220036000 tx=0x7f9220030000 comp rx=0 tx=0).stop 2024-01-22T10:13:32.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.054+0000 7f92300e5640 1 -- 172.21.15.88:0/4236678918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9228149760 msgr2=0x7f9228145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:32.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.054+0000 7f92300e5640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9228149760 0x7f9228145540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f922400d5d0 tx=0x7f922400da90 comp rx=0 tx=0).stop 2024-01-22T10:13:32.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.054+0000 7f92300e5640 1 -- 172.21.15.88:0/4236678918 shutdown_connections 2024-01-22T10:13:32.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.054+0000 7f92300e5640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f920c06b330 0x7f920c06d7f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.054+0000 7f92300e5640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92280bb8b0 0x7f9228146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.054+0000 7f92300e5640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9228149760 0x7f9228145540 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.054+0000 7f92300e5640 1 --2- 172.21.15.88:0/4236678918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92280b5830 0x7f9228146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.054+0000 7f92300e5640 1 -- 172.21.15.88:0/4236678918 >> 172.21.15.88:0/4236678918 conn(0x7f9228066380 msgr2=0x7f9228147970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:32.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.054+0000 7f92300e5640 1 -- 172.21.15.88:0/4236678918 shutdown_connections 2024-01-22T10:13:32.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.054+0000 7f92300e5640 1 -- 172.21.15.88:0/4236678918 wait complete. 2024-01-22T10:13:32.047 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-22T10:13:32.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.164+0000 7fdddc0ec640 1 Processor -- start 2024-01-22T10:13:32.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.165+0000 7fdddc0ec640 1 -- start start 2024-01-22T10:13:32.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.165+0000 7fdddc0ec640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddd40b6c70 0x7fddd41493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:32.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.165+0000 7fdddc0ec640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd40b2960 con 0x7fddd40bd490 2024-01-22T10:13:32.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.165+0000 7fdddc0ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd40b2090 con 0x7fddd40b8eb0 2024-01-22T10:13:32.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.165+0000 7fdddc0ec640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd40b3160 con 0x7fddd40b6c70 2024-01-22T10:13:32.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.165+0000 7fddd9687640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddd40b6c70 0x7fddd41493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:32.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.165+0000 7fddd9e88640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fddd40bd490 0x7fddd41433d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42104/0 (socket says 172.21.15.88:42104) 2024-01-22T10:13:32.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.165+0000 7fddd9687640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddd40b6c70 0x7fddd41493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54360/0 (socket says 172.21.15.88:54360) 2024-01-22T10:13:32.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.165+0000 7fddd9e88640 1 -- 172.21.15.88:0/984188516 learned_addr learned my addr 172.21.15.88:0/984188516 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:32.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.166+0000 7fddd9687640 1 -- 172.21.15.88:0/984188516 >> v1:172.21.15.119:6789/0 conn(0x7fddd40b8eb0 legacy=0x7fddd4153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:32.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.166+0000 7fddd9687640 1 -- 172.21.15.88:0/984188516 >> v1:172.21.15.88:6789/0 conn(0x7fddd40bd490 legacy=0x7fddd41433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:32.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.166+0000 7fddd9687640 1 -- 172.21.15.88:0/984188516 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4143ae0 con 0x7fddd40b6c70 2024-01-22T10:13:32.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.166+0000 7fddd9687640 1 --2- 172.21.15.88:0/984188516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd40b6c70 0x7fddd41493c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fddc40097a0 tx=0x7fddc402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c65c1a4e7a3f33 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:32.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.167+0000 7fddd8e86640 1 -- 172.21.15.88:0/984188516 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4031830 con 0x7fddd40b6c70 2024-01-22T10:13:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.167+0000 7fddd8e86640 1 -- 172.21.15.88:0/984188516 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4031990 con 0x7fddd40b6c70 2024-01-22T10:13:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.167+0000 7fddd8e86640 1 -- 172.21.15.88:0/984188516 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4031d20 con 0x7fddd40b6c70 2024-01-22T10:13:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.167+0000 7fdddc0ec640 1 -- 172.21.15.88:0/984188516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd40b6c70 msgr2=0x7fddd41493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.167+0000 7fdddc0ec640 1 --2- 172.21.15.88:0/984188516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd40b6c70 0x7fddd41493c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fddc40097a0 tx=0x7fddc402b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.167+0000 7fdddc0ec640 1 -- 172.21.15.88:0/984188516 shutdown_connections 2024-01-22T10:13:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.167+0000 7fdddc0ec640 1 --2- 172.21.15.88:0/984188516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd40b6c70 0x7fddd41493c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.167+0000 7fdddc0ec640 1 -- 172.21.15.88:0/984188516 >> 172.21.15.88:0/984188516 conn(0x7fddd406acf0 msgr2=0x7fddd40bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.167+0000 7fdddc0ec640 1 -- 172.21.15.88:0/984188516 shutdown_connections 2024-01-22T10:13:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.167+0000 7fdddc0ec640 1 -- 172.21.15.88:0/984188516 wait complete. 2024-01-22T10:13:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.168+0000 7fdddc0ec640 1 Processor -- start 2024-01-22T10:13:32.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.168+0000 7fdddc0ec640 1 -- start start 2024-01-22T10:13:32.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fdddc0ec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd40b6c70 0x7fddd4147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fdddc0ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddd40b8eb0 0x7fddd40bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fdddc0ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddd40bd490 0x7fddd413c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fdddc0ec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40bca10 con 0x7fddd40b6c70 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fdddc0ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4147b50 con 0x7fddd40bd490 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fdddc0ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40b52d0 con 0x7fddd40b8eb0 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddd9e88640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd40b6c70 0x7fddd4147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddd9e88640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd40b6c70 0x7fddd4147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54376/0 (socket says 172.21.15.88:54376) 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddd9e88640 1 -- 172.21.15.88:0/475927411 learned_addr learned my addr 172.21.15.88:0/475927411 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddd9687640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddd40b8eb0 0x7fddd40bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddda689640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddd40bd490 0x7fddd413c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddd9e88640 1 -- 172.21.15.88:0/475927411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddd40b8eb0 msgr2=0x7fddd40bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddd9e88640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddd40b8eb0 0x7fddd40bc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddd9e88640 1 -- 172.21.15.88:0/475927411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddd40bd490 msgr2=0x7fddd413c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:32.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddd9e88640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddd40bd490 0x7fddd413c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddd9e88640 1 -- 172.21.15.88:0/475927411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4009400 con 0x7fddd40b6c70 2024-01-22T10:13:32.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddd9e88640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd40b6c70 0x7fddd4147f70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fddd000c3c0 tx=0x7fddd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:32.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddca7fc640 1 -- 172.21.15.88:0/475927411 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0005ce0 con 0x7fddd40b6c70 2024-01-22T10:13:32.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddca7fc640 1 -- 172.21.15.88:0/475927411 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd0005e40 con 0x7fddd40b6c70 2024-01-22T10:13:32.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fddca7fc640 1 -- 172.21.15.88:0/475927411 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd00072d0 con 0x7fddd40b6c70 2024-01-22T10:13:32.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fdddc0ec640 1 -- 172.21.15.88:0/475927411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd40bb710 con 0x7fddd40b6c70 2024-01-22T10:13:32.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.169+0000 7fdddc0ec640 1 -- 172.21.15.88:0/475927411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd40bbcd0 con 0x7fddd40b6c70 2024-01-22T10:13:32.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.170+0000 7fdddc0ec640 1 -- 172.21.15.88:0/475927411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd4067c40 con 0x7fddd40b6c70 2024-01-22T10:13:32.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.171+0000 7fddca7fc640 1 -- 172.21.15.88:0/475927411 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fddd00074f0 con 0x7fddd40b6c70 2024-01-22T10:13:32.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.171+0000 7fddca7fc640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fddb806b330 0x7fddb806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:32.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.171+0000 7fddca7fc640 1 -- 172.21.15.88:0/475927411 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddd0089170 con 0x7fddd40b6c70 2024-01-22T10:13:32.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.171+0000 7fddd9687640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fddb806b330 0x7fddb806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:32.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.172+0000 7fddd9687640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fddb806b330 0x7fddb806d7f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fddc4036000 tx=0x7fddc403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:32.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.175+0000 7fddca7fc640 1 -- 172.21.15.88:0/475927411 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fddd0053e00 con 0x7fddd40b6c70 2024-01-22T10:13:32.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.377+0000 7fdddc0ec640 1 -- 172.21.15.88:0/475927411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fddd404ea30 con 0x7fddd40b6c70 2024-01-22T10:13:32.360 INFO:tasks.ceph.mon.a.smithi088.stderr:2024-01-22T10:13:32.378+0000 7f542a1e7640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-22T10:13:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.379+0000 7fddca7fc640 1 -- 172.21.15.88:0/475927411 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7fddd0057420 con 0x7fddd40b6c70 2024-01-22T10:13:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-22T10:13:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.382+0000 7fdddc0ec640 1 -- 172.21.15.88:0/475927411 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fddb806b330 msgr2=0x7fddb806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.382+0000 7fdddc0ec640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fddb806b330 0x7fddb806d7f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fddc4036000 tx=0x7fddc403c040 comp rx=0 tx=0).stop 2024-01-22T10:13:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.382+0000 7fdddc0ec640 1 -- 172.21.15.88:0/475927411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd40b6c70 msgr2=0x7fddd4147f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.382+0000 7fdddc0ec640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd40b6c70 0x7fddd4147f70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fddd000c3c0 tx=0x7fddd000c880 comp rx=0 tx=0).stop 2024-01-22T10:13:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.382+0000 7fdddc0ec640 1 -- 172.21.15.88:0/475927411 shutdown_connections 2024-01-22T10:13:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.382+0000 7fdddc0ec640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fddb806b330 0x7fddb806d7f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.382+0000 7fdddc0ec640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddd40b8eb0 0x7fddd40bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.382+0000 7fdddc0ec640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddd40bd490 0x7fddd413c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.382+0000 7fdddc0ec640 1 --2- 172.21.15.88:0/475927411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddd40b6c70 0x7fddd4147f70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.382+0000 7fdddc0ec640 1 -- 172.21.15.88:0/475927411 >> 172.21.15.88:0/475927411 conn(0x7fddd406acf0 msgr2=0x7fddd413e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.382+0000 7fdddc0ec640 1 -- 172.21.15.88:0/475927411 shutdown_connections 2024-01-22T10:13:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.382+0000 7fdddc0ec640 1 -- 172.21.15.88:0/475927411 wait complete. 2024-01-22T10:13:32.366 INFO:tasks.ceph.mds.c.smithi088.stderr: -6031> 2024-01-22T10:12:56.468+0000 7f10b5146640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-01-22T10:13:32.366 INFO:tasks.ceph.mds.c.smithi088.stderr: -4861> 2024-01-22T10:13:06.478+0000 7f10af13a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T10:13:32.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-22T10:13:32.395 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2024-01-22T10:13:32.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.495+0000 7f826295a640 1 Processor -- start 2024-01-22T10:13:32.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.495+0000 7f826295a640 1 -- start start 2024-01-22T10:13:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f826295a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f825c0727d0 0x7f825c14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f826295a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f825c143750 0x7f825c14d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f826295a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c0b78a0 con 0x7f825c0b5520 2024-01-22T10:13:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f826295a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c143bb0 con 0x7f825c143750 2024-01-22T10:13:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f826295a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825c0b6cd0 con 0x7f825c0727d0 2024-01-22T10:13:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f8260ef7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f825c143750 0x7f825c14d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f825b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f825c0b5520 0x7f825c143040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42134/0 (socket says 172.21.15.88:42134) 2024-01-22T10:13:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f825b7fe640 1 -- 172.21.15.88:0/602804378 learned_addr learned my addr 172.21.15.88:0/602804378 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f825bfff640 1 --2- 172.21.15.88:0/602804378 >> v2:172.21.15.119:3300/0 conn(0x7f825c0727d0 0x7f825c14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f8260ef7640 1 -- 172.21.15.88:0/602804378 >> v2:172.21.15.119:3300/0 conn(0x7f825c0727d0 msgr2=0x7f825c14cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f8260ef7640 1 --2- 172.21.15.88:0/602804378 >> v2:172.21.15.119:3300/0 conn(0x7f825c0727d0 0x7f825c14cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f8260ef7640 1 -- 172.21.15.88:0/602804378 >> v1:172.21.15.88:6789/0 conn(0x7f825c0b5520 legacy=0x7f825c143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:32.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f8260ef7640 1 -- 172.21.15.88:0/602804378 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c0b6f70 con 0x7f825c143750 2024-01-22T10:13:32.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.496+0000 7f825bfff640 1 --2- 172.21.15.88:0/602804378 >> v2:172.21.15.119:3300/0 conn(0x7f825c0727d0 0x7f825c14cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:32.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.497+0000 7f8260ef7640 1 --2- 172.21.15.88:0/602804378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c143750 0x7f825c14d0e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f825c0674e0 tx=0x7f825402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b30cebc561584 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:32.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.497+0000 7f825affd640 1 -- 172.21.15.88:0/602804378 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825402cd00 con 0x7f825c143750 2024-01-22T10:13:32.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.497+0000 7f825affd640 1 -- 172.21.15.88:0/602804378 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825402ce60 con 0x7f825c143750 2024-01-22T10:13:32.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.497+0000 7f825affd640 1 -- 172.21.15.88:0/602804378 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254034660 con 0x7f825c143750 2024-01-22T10:13:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.498+0000 7f826295a640 1 -- 172.21.15.88:0/602804378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c143750 msgr2=0x7f825c14d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.498+0000 7f826295a640 1 --2- 172.21.15.88:0/602804378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c143750 0x7f825c14d0e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f825c0674e0 tx=0x7f825402bf50 comp rx=0 tx=0).stop 2024-01-22T10:13:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.498+0000 7f826295a640 1 -- 172.21.15.88:0/602804378 shutdown_connections 2024-01-22T10:13:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.498+0000 7f826295a640 1 --2- 172.21.15.88:0/602804378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c143750 0x7f825c14d0e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.498+0000 7f826295a640 1 --2- 172.21.15.88:0/602804378 >> v2:172.21.15.119:3300/0 conn(0x7f825c0727d0 0x7f825c14cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.498+0000 7f826295a640 1 -- 172.21.15.88:0/602804378 >> 172.21.15.88:0/602804378 conn(0x7f825c06be30 msgr2=0x7f825c0bdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.498+0000 7f826295a640 1 -- 172.21.15.88:0/602804378 shutdown_connections 2024-01-22T10:13:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.498+0000 7f826295a640 1 -- 172.21.15.88:0/602804378 wait complete. 2024-01-22T10:13:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.499+0000 7f826295a640 1 Processor -- start 2024-01-22T10:13:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.499+0000 7f826295a640 1 -- start start 2024-01-22T10:13:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f826295a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c0727d0 0x7f825c148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:32.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f826295a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f825c0b5520 0x7f825c1dee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f826295a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f825c143750 0x7f825c1df340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f826295a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1491b0 con 0x7f825c0727d0 2024-01-22T10:13:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f826295a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c148410 con 0x7f825c0b5520 2024-01-22T10:13:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f826295a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c146770 con 0x7f825c143750 2024-01-22T10:13:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f825bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c0727d0 0x7f825c148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f825bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c0727d0 0x7f825c148c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54406/0 (socket says 172.21.15.88:54406) 2024-01-22T10:13:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f825bfff640 1 -- 172.21.15.88:0/3132789316 learned_addr learned my addr 172.21.15.88:0/3132789316 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f825b7fe640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f825c0b5520 0x7f825c1dee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f8260ef7640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f825c143750 0x7f825c1df340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f825bfff640 1 -- 172.21.15.88:0/3132789316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f825c143750 msgr2=0x7f825c1df340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f825bfff640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f825c143750 0x7f825c1df340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f825bfff640 1 -- 172.21.15.88:0/3132789316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f825c0b5520 msgr2=0x7f825c1dee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f825bfff640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f825c0b5520 0x7f825c1dee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f825bfff640 1 -- 172.21.15.88:0/3132789316 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8254009a70 con 0x7f825c0727d0 2024-01-22T10:13:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f8260ef7640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f825c143750 0x7f825c1df340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f825bfff640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c0727d0 0x7f825c148c70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f824c00c7f0 tx=0x7f824c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f8258ff9640 1 -- 172.21.15.88:0/3132789316 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c007a30 con 0x7f825c0727d0 2024-01-22T10:13:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f8258ff9640 1 -- 172.21.15.88:0/3132789316 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c007b90 con 0x7f825c0727d0 2024-01-22T10:13:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f826295a640 1 -- 172.21.15.88:0/3132789316 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c147b70 con 0x7f825c0727d0 2024-01-22T10:13:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f8258ff9640 1 -- 172.21.15.88:0/3132789316 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c00ce40 con 0x7f825c0727d0 2024-01-22T10:13:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.500+0000 7f826295a640 1 -- 172.21.15.88:0/3132789316 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c148130 con 0x7f825c0727d0 2024-01-22T10:13:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.501+0000 7f826295a640 1 -- 172.21.15.88:0/3132789316 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c1deb20 con 0x7f825c0727d0 2024-01-22T10:13:32.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.502+0000 7f8258ff9640 1 -- 172.21.15.88:0/3132789316 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f824c0113f0 con 0x7f825c0727d0 2024-01-22T10:13:32.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.502+0000 7f8258ff9640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f824806b330 0x7f824806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:32.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.502+0000 7f825b7fe640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f824806b330 0x7f824806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:32.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.502+0000 7f8258ff9640 1 -- 172.21.15.88:0/3132789316 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f824c089d10 con 0x7f825c0727d0 2024-01-22T10:13:32.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.503+0000 7f825b7fe640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f824806b330 0x7f824806d7f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f825c0bb2b0 tx=0x7f8250009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:32.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.506+0000 7f8258ff9640 1 -- 172.21.15.88:0/3132789316 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f825c1deb20 con 0x7f825c0727d0 2024-01-22T10:13:32.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:32.713+0000 7f826295a640 1 -- 172.21.15.88:0/3132789316 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f825c1deb20 con 0x7f825c0727d0 2024-01-22T10:13:33.017 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:13:33.019 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:13:33.022 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:13:33.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.380+0000 7f8258ff9640 1 -- 172.21.15.88:0/3132789316 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f825c1deb20 con 0x7f825c0727d0 2024-01-22T10:13:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.383+0000 7f826295a640 1 -- 172.21.15.88:0/3132789316 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f824806b330 msgr2=0x7f824806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.383+0000 7f826295a640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f824806b330 0x7f824806d7f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f825c0bb2b0 tx=0x7f8250009040 comp rx=0 tx=0).stop 2024-01-22T10:13:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.383+0000 7f826295a640 1 -- 172.21.15.88:0/3132789316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c0727d0 msgr2=0x7f825c148c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.383+0000 7f826295a640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c0727d0 0x7f825c148c70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f824c00c7f0 tx=0x7f824c00cbf0 comp rx=0 tx=0).stop 2024-01-22T10:13:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.383+0000 7f826295a640 1 -- 172.21.15.88:0/3132789316 shutdown_connections 2024-01-22T10:13:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.383+0000 7f826295a640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f824806b330 0x7f824806d7f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.383+0000 7f826295a640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f825c143750 0x7f825c1df340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.383+0000 7f826295a640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f825c0b5520 0x7f825c1dee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.383+0000 7f826295a640 1 --2- 172.21.15.88:0/3132789316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f825c0727d0 0x7f825c148c70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.383+0000 7f826295a640 1 -- 172.21.15.88:0/3132789316 >> 172.21.15.88:0/3132789316 conn(0x7f825c06be30 msgr2=0x7f825c14a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.384+0000 7f826295a640 1 -- 172.21.15.88:0/3132789316 shutdown_connections 2024-01-22T10:13:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.384+0000 7f826295a640 1 -- 172.21.15.88:0/3132789316 wait complete. 2024-01-22T10:13:33.377 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-22T10:13:33.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.499+0000 7fa81f256640 1 Processor -- start 2024-01-22T10:13:33.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.499+0000 7fa81f256640 1 -- start start 2024-01-22T10:13:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81f256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8180b5e30 0x7fa8180b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81f256640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8180b3f70 0x7fa8181484c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81f256640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa818141960 0x7fa818141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81f256640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8180b46e0 con 0x7fa818141960 2024-01-22T10:13:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81f256640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8180b6f60 con 0x7fa8180b3f70 2024-01-22T10:13:33.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81f256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa818148a00 con 0x7fa8180b5e30 2024-01-22T10:13:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81d7f3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa818141960 0x7fa818141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81d7f3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa818141960 0x7fa818141dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54418/0 (socket says 172.21.15.88:54418) 2024-01-22T10:13:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81d7f3640 1 -- 172.21.15.88:0/3524327518 learned_addr learned my addr 172.21.15.88:0/3524327518 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81d7f3640 1 -- 172.21.15.88:0/3524327518 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8180b5e30 msgr2=0x7fa8180b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81d7f3640 1 --2- 172.21.15.88:0/3524327518 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8180b5e30 0x7fa8180b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81d7f3640 1 -- 172.21.15.88:0/3524327518 >> v2:172.21.15.119:3300/0 conn(0x7fa8180b3f70 msgr2=0x7fa8181484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81d7f3640 1 --2- 172.21.15.88:0/3524327518 >> v2:172.21.15.119:3300/0 conn(0x7fa8180b3f70 0x7fa8181484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:33.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.500+0000 7fa81d7f3640 1 -- 172.21.15.88:0/3524327518 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8180b65b0 con 0x7fa818141960 2024-01-22T10:13:33.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.501+0000 7fa81d7f3640 1 --2- 172.21.15.88:0/3524327518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818141960 0x7fa818141dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa81806b580 tx=0x7fa81002d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6517468121d0143a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.501+0000 7fa8177fe640 1 -- 172.21.15.88:0/3524327518 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81002dc10 con 0x7fa818141960 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.501+0000 7fa8177fe640 1 -- 172.21.15.88:0/3524327518 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81002dd70 con 0x7fa818141960 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.501+0000 7fa8177fe640 1 -- 172.21.15.88:0/3524327518 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810035610 con 0x7fa818141960 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.502+0000 7fa81f256640 1 -- 172.21.15.88:0/3524327518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818141960 msgr2=0x7fa818141dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.502+0000 7fa81f256640 1 --2- 172.21.15.88:0/3524327518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818141960 0x7fa818141dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa81806b580 tx=0x7fa81002d070 comp rx=0 tx=0).stop 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.502+0000 7fa81f256640 1 -- 172.21.15.88:0/3524327518 shutdown_connections 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.502+0000 7fa81f256640 1 --2- 172.21.15.88:0/3524327518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818141960 0x7fa818141dc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.502+0000 7fa81f256640 1 --2- 172.21.15.88:0/3524327518 >> v2:172.21.15.119:3300/0 conn(0x7fa8180b3f70 0x7fa8181484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.502+0000 7fa81f256640 1 --2- 172.21.15.88:0/3524327518 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8180b5e30 0x7fa8180b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.502+0000 7fa81f256640 1 -- 172.21.15.88:0/3524327518 >> 172.21.15.88:0/3524327518 conn(0x7fa81806ad20 msgr2=0x7fa8180bcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.502+0000 7fa81f256640 1 -- 172.21.15.88:0/3524327518 shutdown_connections 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.502+0000 7fa81f256640 1 -- 172.21.15.88:0/3524327518 wait complete. 2024-01-22T10:13:33.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.503+0000 7fa81f256640 1 Processor -- start 2024-01-22T10:13:33.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.503+0000 7fa81f256640 1 -- start start 2024-01-22T10:13:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa81f256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8180b5e30 0x7fa8181392c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa81f256640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818141960 0x7fa8181dea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa81f256640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8181def70 0x7fa818149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa81f256640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa818072160 con 0x7fa818141960 2024-01-22T10:13:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa81f256640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa818139800 con 0x7fa8181def70 2024-01-22T10:13:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa81f256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81813baf0 con 0x7fa8180b5e30 2024-01-22T10:13:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa817fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818141960 0x7fa8181dea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa817fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818141960 0x7fa8181dea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54426/0 (socket says 172.21.15.88:54426) 2024-01-22T10:13:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa817fff640 1 -- 172.21.15.88:0/3060447536 learned_addr learned my addr 172.21.15.88:0/3060447536 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:33.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa81cff2640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8180b5e30 0x7fa8181392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa81d7f3640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8181def70 0x7fa818149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa817fff640 1 -- 172.21.15.88:0/3060447536 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8180b5e30 msgr2=0x7fa8181392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa817fff640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8180b5e30 0x7fa8181392c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa817fff640 1 -- 172.21.15.88:0/3060447536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8181def70 msgr2=0x7fa818149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa817fff640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8181def70 0x7fa818149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa817fff640 1 -- 172.21.15.88:0/3060447536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa810009b30 con 0x7fa818141960 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.504+0000 7fa817fff640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818141960 0x7fa8181dea30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa80400b4d0 tx=0x7fa80400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.505+0000 7fa8157fa640 1 -- 172.21.15.88:0/3060447536 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804010870 con 0x7fa818141960 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.505+0000 7fa8157fa640 1 -- 172.21.15.88:0/3060447536 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8040109d0 con 0x7fa818141960 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.505+0000 7fa81f256640 1 -- 172.21.15.88:0/3060447536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa818071f10 con 0x7fa818141960 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.505+0000 7fa8157fa640 1 -- 172.21.15.88:0/3060447536 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804010d80 con 0x7fa818141960 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.505+0000 7fa81f256640 1 -- 172.21.15.88:0/3060447536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81813a470 con 0x7fa818141960 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.506+0000 7fa81f256640 1 -- 172.21.15.88:0/3060447536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81804ea30 con 0x7fa818141960 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.506+0000 7fa8157fa640 1 -- 172.21.15.88:0/3060447536 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fa80400f3c0 con 0x7fa818141960 2024-01-22T10:13:33.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.506+0000 7fa8157fa640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa7fc06b330 0x7fa7fc06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:33.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.507+0000 7fa81cff2640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa7fc06b330 0x7fa7fc06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:33.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.507+0000 7fa8157fa640 1 -- 172.21.15.88:0/3060447536 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa804089bd0 con 0x7fa818141960 2024-01-22T10:13:33.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.507+0000 7fa81cff2640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa7fc06b330 0x7fa7fc06d7f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009890 tx=0x7fa80c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:33.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.511+0000 7fa8157fa640 1 -- 172.21.15.88:0/3060447536 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa804054800 con 0x7fa818141960 2024-01-22T10:13:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:33.686+0000 7fa81f256640 1 -- 172.21.15.88:0/3060447536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa8180b20e0 con 0x7fa818141960 2024-01-22T10:13:34.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.547+0000 7fa8157fa640 1 -- 172.21.15.88:0/3060447536 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa8040140d0 con 0x7fa818141960 2024-01-22T10:13:34.529 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2024-01-22T10:13:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.550+0000 7fa81f256640 1 -- 172.21.15.88:0/3060447536 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa7fc06b330 msgr2=0x7fa7fc06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:34.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.550+0000 7fa81f256640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa7fc06b330 0x7fa7fc06d7f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009890 tx=0x7fa80c008040 comp rx=0 tx=0).stop 2024-01-22T10:13:34.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.550+0000 7fa81f256640 1 -- 172.21.15.88:0/3060447536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818141960 msgr2=0x7fa8181dea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:34.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.550+0000 7fa81f256640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818141960 0x7fa8181dea30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa80400b4d0 tx=0x7fa80400b990 comp rx=0 tx=0).stop 2024-01-22T10:13:34.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.551+0000 7fa81f256640 1 -- 172.21.15.88:0/3060447536 shutdown_connections 2024-01-22T10:13:34.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.551+0000 7fa81f256640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa7fc06b330 0x7fa7fc06d7f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:34.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.551+0000 7fa81f256640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8181def70 0x7fa818149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:34.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.551+0000 7fa81f256640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa818141960 0x7fa8181dea30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:34.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.551+0000 7fa81f256640 1 --2- 172.21.15.88:0/3060447536 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8180b5e30 0x7fa8181392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:34.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.551+0000 7fa81f256640 1 -- 172.21.15.88:0/3060447536 >> 172.21.15.88:0/3060447536 conn(0x7fa81806ad20 msgr2=0x7fa818140f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:34.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.551+0000 7fa81f256640 1 -- 172.21.15.88:0/3060447536 shutdown_connections 2024-01-22T10:13:34.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.551+0000 7fa81f256640 1 -- 172.21.15.88:0/3060447536 wait complete. 2024-01-22T10:13:34.546 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-22T10:13:34.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.670+0000 7efcdaf1d640 1 Processor -- start 2024-01-22T10:13:34.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.670+0000 7efcdaf1d640 1 -- start start 2024-01-22T10:13:34.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcdaf1d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efcd4071c30 0x7efcd4070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:34.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcdaf1d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efcd4071190 0x7efcd4155f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:34.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcdaf1d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd40b9f30 con 0x7efcd4145b40 2024-01-22T10:13:34.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcdaf1d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd406e7e0 con 0x7efcd4071190 2024-01-22T10:13:34.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcdaf1d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd406efa0 con 0x7efcd4071c30 2024-01-22T10:13:34.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcd94ba640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efcd4071190 0x7efcd4155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:34.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcd8cb9640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efcd4145b40 0x7efcd40b9820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42140/0 (socket says 172.21.15.88:42140) 2024-01-22T10:13:34.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcd8cb9640 1 -- 172.21.15.88:0/4035459637 learned_addr learned my addr 172.21.15.88:0/4035459637 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:34.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcd3fff640 1 --2- 172.21.15.88:0/4035459637 >> v2:172.21.15.119:3300/0 conn(0x7efcd4071c30 0x7efcd4070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:34.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcd94ba640 1 -- 172.21.15.88:0/4035459637 >> v2:172.21.15.119:3300/0 conn(0x7efcd4071c30 msgr2=0x7efcd4070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:34.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcd94ba640 1 --2- 172.21.15.88:0/4035459637 >> v2:172.21.15.119:3300/0 conn(0x7efcd4071c30 0x7efcd4070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:34.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcd94ba640 1 -- 172.21.15.88:0/4035459637 >> v1:172.21.15.88:6789/0 conn(0x7efcd4145b40 legacy=0x7efcd40b9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:34.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcd37fe640 1 -- 172.21.15.88:0/4035459637 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423153749 0 0) 0x7efcd40b9f30 con 0x7efcd4145b40 2024-01-22T10:13:34.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.671+0000 7efcd94ba640 1 -- 172.21.15.88:0/4035459637 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd40b2ec0 con 0x7efcd4071190 2024-01-22T10:13:34.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.672+0000 7efcd94ba640 1 --2- 172.21.15.88:0/4035459637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd4071190 0x7efcd4155f10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efcd40ba8b0 tx=0x7efccc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ab67e245b6ffee server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:34.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.672+0000 7efcd37fe640 1 -- 172.21.15.88:0/4035459637 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc02cc80 con 0x7efcd4071190 2024-01-22T10:13:34.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.672+0000 7efcd37fe640 1 -- 172.21.15.88:0/4035459637 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc02cde0 con 0x7efcd4071190 2024-01-22T10:13:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.672+0000 7efcd37fe640 1 -- 172.21.15.88:0/4035459637 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc034660 con 0x7efcd4071190 2024-01-22T10:13:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.673+0000 7efcdaf1d640 1 -- 172.21.15.88:0/4035459637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd4071190 msgr2=0x7efcd4155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.673+0000 7efcdaf1d640 1 --2- 172.21.15.88:0/4035459637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd4071190 0x7efcd4155f10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efcd40ba8b0 tx=0x7efccc02bed0 comp rx=0 tx=0).stop 2024-01-22T10:13:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.673+0000 7efcdaf1d640 1 -- 172.21.15.88:0/4035459637 shutdown_connections 2024-01-22T10:13:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.673+0000 7efcdaf1d640 1 --2- 172.21.15.88:0/4035459637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd4071190 0x7efcd4155f10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.673+0000 7efcdaf1d640 1 --2- 172.21.15.88:0/4035459637 >> v2:172.21.15.119:3300/0 conn(0x7efcd4071c30 0x7efcd4070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.673+0000 7efcdaf1d640 1 -- 172.21.15.88:0/4035459637 >> 172.21.15.88:0/4035459637 conn(0x7efcd40ba910 msgr2=0x7efcd40bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.673+0000 7efcdaf1d640 1 -- 172.21.15.88:0/4035459637 shutdown_connections 2024-01-22T10:13:34.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.673+0000 7efcdaf1d640 1 -- 172.21.15.88:0/4035459637 wait complete. 2024-01-22T10:13:34.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.674+0000 7efcdaf1d640 1 Processor -- start 2024-01-22T10:13:34.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.674+0000 7efcdaf1d640 1 -- start start 2024-01-22T10:13:34.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.674+0000 7efcdaf1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd4071190 0x7efcd4148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:34.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.674+0000 7efcdaf1d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd4071c30 0x7efcd41e1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:34.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.674+0000 7efcdaf1d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcd4145b40 0x7efcd41473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:34.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcdaf1d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd41480b0 con 0x7efcd4071190 2024-01-22T10:13:34.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcdaf1d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd40b9ac0 con 0x7efcd4071c30 2024-01-22T10:13:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcdaf1d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd41e1940 con 0x7efcd4145b40 2024-01-22T10:13:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd8cb9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd4071190 0x7efcd4148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd8cb9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd4071190 0x7efcd4148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54436/0 (socket says 172.21.15.88:54436) 2024-01-22T10:13:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd8cb9640 1 -- 172.21.15.88:0/2047885212 learned_addr learned my addr 172.21.15.88:0/2047885212 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd3fff640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd4071c30 0x7efcd41e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd94ba640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcd4145b40 0x7efcd41473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd8cb9640 1 -- 172.21.15.88:0/2047885212 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcd4145b40 msgr2=0x7efcd41473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd8cb9640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcd4145b40 0x7efcd41473b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd8cb9640 1 -- 172.21.15.88:0/2047885212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd4071c30 msgr2=0x7efcd41e1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd8cb9640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd4071c30 0x7efcd41e1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd8cb9640 1 -- 172.21.15.88:0/2047885212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc009a70 con 0x7efcd4071190 2024-01-22T10:13:34.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd3fff640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd4071c30 0x7efcd41e1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:34.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd8cb9640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd4071190 0x7efcd4148a60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efcc400c430 tx=0x7efcc400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:34.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd17fa640 1 -- 172.21.15.88:0/2047885212 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40074e0 con 0x7efcd4071190 2024-01-22T10:13:34.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd17fa640 1 -- 172.21.15.88:0/2047885212 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc4007660 con 0x7efcd4071190 2024-01-22T10:13:34.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcdaf1d640 1 -- 172.21.15.88:0/2047885212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd413b190 con 0x7efcd4071190 2024-01-22T10:13:34.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcd17fa640 1 -- 172.21.15.88:0/2047885212 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4004a20 con 0x7efcd4071190 2024-01-22T10:13:34.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.675+0000 7efcdaf1d640 1 -- 172.21.15.88:0/2047885212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd4147dd0 con 0x7efcd4071190 2024-01-22T10:13:34.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.676+0000 7efcdaf1d640 1 -- 172.21.15.88:0/2047885212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd404ea30 con 0x7efcd4071190 2024-01-22T10:13:34.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.676+0000 7efcd17fa640 1 -- 172.21.15.88:0/2047885212 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7efcc4004b80 con 0x7efcd4071190 2024-01-22T10:13:34.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.677+0000 7efcd17fa640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7efcc006b330 0x7efcc006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:34.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.677+0000 7efcd3fff640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7efcc006b330 0x7efcc006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:34.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.677+0000 7efcd17fa640 1 -- 172.21.15.88:0/2047885212 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7efcc40898c0 con 0x7efcd4071190 2024-01-22T10:13:34.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.677+0000 7efcd3fff640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7efcc006b330 0x7efcc006d7f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efcd413be50 tx=0x7efcc8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:34.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.681+0000 7efcd17fa640 1 -- 172.21.15.88:0/2047885212 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7efcc40546b0 con 0x7efcd4071190 2024-01-22T10:13:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:34.851+0000 7efcdaf1d640 1 -- 172.21.15.88:0/2047885212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efcd4070a30 con 0x7efcd4071190 2024-01-22T10:13:35.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.555+0000 7efcd17fa640 1 -- 172.21.15.88:0/2047885212 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7efcc4057cd0 con 0x7efcd4071190 2024-01-22T10:13:35.537 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2024-01-22T10:13:35.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.557+0000 7efcdaf1d640 1 -- 172.21.15.88:0/2047885212 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7efcc006b330 msgr2=0x7efcc006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:35.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.557+0000 7efcdaf1d640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7efcc006b330 0x7efcc006d7f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efcd413be50 tx=0x7efcc8008040 comp rx=0 tx=0).stop 2024-01-22T10:13:35.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.557+0000 7efcdaf1d640 1 -- 172.21.15.88:0/2047885212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd4071190 msgr2=0x7efcd4148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:35.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.557+0000 7efcdaf1d640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd4071190 0x7efcd4148a60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efcc400c430 tx=0x7efcc400c8f0 comp rx=0 tx=0).stop 2024-01-22T10:13:35.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.557+0000 7efcdaf1d640 1 -- 172.21.15.88:0/2047885212 shutdown_connections 2024-01-22T10:13:35.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.557+0000 7efcdaf1d640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7efcc006b330 0x7efcc006d7f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:35.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.557+0000 7efcdaf1d640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcd4145b40 0x7efcd41473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:35.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.557+0000 7efcdaf1d640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd4071c30 0x7efcd41e1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:35.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.557+0000 7efcdaf1d640 1 --2- 172.21.15.88:0/2047885212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcd4071190 0x7efcd4148a60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:35.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.557+0000 7efcdaf1d640 1 -- 172.21.15.88:0/2047885212 >> 172.21.15.88:0/2047885212 conn(0x7efcd40ba910 msgr2=0x7efcd406ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:35.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.557+0000 7efcdaf1d640 1 -- 172.21.15.88:0/2047885212 shutdown_connections 2024-01-22T10:13:35.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.557+0000 7efcdaf1d640 1 -- 172.21.15.88:0/2047885212 wait complete. 2024-01-22T10:13:35.553 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-22T10:13:35.553 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-22T10:13:35.554 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T10:13:35.554 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:13:35.554 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-22T10:13:35.554 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-22T10:13:35.554 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T10:13:35.554 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:13:35.555 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-22T10:13:35.555 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-22T10:13:35.555 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T10:13:35.555 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:13:35.563 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T10:13:35.563 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-22T10:13:35.564 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T10:13:35.565 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-22T10:13:35.566 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T10:13:35.566 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-22T10:13:35.606 INFO:tasks.ceph.mds.a:Started 2024-01-22T10:13:35.607 DEBUG:teuthology.parallel:result is None 2024-01-22T10:13:35.607 INFO:tasks.ceph.mds.c:Started 2024-01-22T10:13:35.608 DEBUG:teuthology.parallel:result is None 2024-01-22T10:13:35.608 INFO:tasks.ceph.mds.b:Started 2024-01-22T10:13:35.609 DEBUG:teuthology.parallel:result is None 2024-01-22T10:13:35.609 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-22T10:13:35.682 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2024-01-22T10:13:35.682 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2024-01-22T10:13:35.690 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2024-01-22T10:13:35.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.730+0000 7f98c63b6640 1 Processor -- start 2024-01-22T10:13:35.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.730+0000 7f98c63b6640 1 -- start start 2024-01-22T10:13:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98c63b6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98c0070630 0x7f98c00ba760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98c63b6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98c0148450 0x7f98c00b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98c63b6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c0071270 con 0x7f98c00b9e40 2024-01-22T10:13:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98c63b6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c00ba2d0 con 0x7f98c0070630 2024-01-22T10:13:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98c63b6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c00baca0 con 0x7f98c0148450 2024-01-22T10:13:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98bffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98c0070630 0x7f98c00ba760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98bffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98c0070630 0x7f98c00ba760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54480/0 (socket says 172.21.15.88:54480) 2024-01-22T10:13:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98c4953640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f98c00b9e40 0x7f98c01422b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42154/0 (socket says 172.21.15.88:42154) 2024-01-22T10:13:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98bffff640 1 -- 172.21.15.88:0/2559859582 learned_addr learned my addr 172.21.15.88:0/2559859582 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:35.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98bffff640 1 -- 172.21.15.88:0/2559859582 >> v2:172.21.15.119:3300/0 conn(0x7f98c0148450 msgr2=0x7f98c00b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:35.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98bffff640 1 --2- 172.21.15.88:0/2559859582 >> v2:172.21.15.119:3300/0 conn(0x7f98c0148450 0x7f98c00b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:35.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98bffff640 1 -- 172.21.15.88:0/2559859582 >> v1:172.21.15.88:6789/0 conn(0x7f98c00b9e40 legacy=0x7f98c01422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:35.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.731+0000 7f98bffff640 1 -- 172.21.15.88:0/2559859582 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c00714c0 con 0x7f98c0070630 2024-01-22T10:13:35.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.732+0000 7f98bffff640 1 --2- 172.21.15.88:0/2559859582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c0070630 0x7f98c00ba760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f98c006c5e0 tx=0x7f98b402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c967aa5a4448017 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.732+0000 7f98beffd640 1 -- 172.21.15.88:0/2559859582 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b402f850 con 0x7f98c0070630 2024-01-22T10:13:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.732+0000 7f98beffd640 1 -- 172.21.15.88:0/2559859582 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b402f9b0 con 0x7f98c0070630 2024-01-22T10:13:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.732+0000 7f98beffd640 1 -- 172.21.15.88:0/2559859582 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b402fd40 con 0x7f98c0070630 2024-01-22T10:13:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.732+0000 7f98c63b6640 1 -- 172.21.15.88:0/2559859582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c0070630 msgr2=0x7f98c00ba760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.732+0000 7f98c63b6640 1 --2- 172.21.15.88:0/2559859582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c0070630 0x7f98c00ba760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f98c006c5e0 tx=0x7f98b402ba30 comp rx=0 tx=0).stop 2024-01-22T10:13:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.733+0000 7f98c63b6640 1 -- 172.21.15.88:0/2559859582 shutdown_connections 2024-01-22T10:13:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.733+0000 7f98c63b6640 1 --2- 172.21.15.88:0/2559859582 >> v2:172.21.15.119:3300/0 conn(0x7f98c0148450 0x7f98c00b9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.733+0000 7f98c63b6640 1 --2- 172.21.15.88:0/2559859582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c0070630 0x7f98c00ba760 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.733+0000 7f98c63b6640 1 -- 172.21.15.88:0/2559859582 >> 172.21.15.88:0/2559859582 conn(0x7f98c006e970 msgr2=0x7f98c006b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.733+0000 7f98c63b6640 1 -- 172.21.15.88:0/2559859582 shutdown_connections 2024-01-22T10:13:35.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.733+0000 7f98c63b6640 1 -- 172.21.15.88:0/2559859582 wait complete. 2024-01-22T10:13:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.734+0000 7f98c63b6640 1 Processor -- start 2024-01-22T10:13:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.734+0000 7f98c63b6640 1 -- start start 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c63b6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98c0070630 0x7f98c00b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c63b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98c00b9e40 0x7f98c013e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c63b6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c0148450 0x7f98c01dc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c63b6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c013eb90 con 0x7f98c0148450 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c63b6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c01dc7e0 con 0x7f98c00b9e40 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c63b6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c0143ce0 con 0x7f98c0070630 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c4953640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c0148450 0x7f98c01dc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c4953640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c0148450 0x7f98c01dc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54496/0 (socket says 172.21.15.88:54496) 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c4953640 1 -- 172.21.15.88:0/2070898182 learned_addr learned my addr 172.21.15.88:0/2070898182 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98bffff640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98c0070630 0x7f98c00b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98bf7fe640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98c00b9e40 0x7f98c013e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c4953640 1 -- 172.21.15.88:0/2070898182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98c0070630 msgr2=0x7f98c00b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c4953640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98c0070630 0x7f98c00b7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c4953640 1 -- 172.21.15.88:0/2070898182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98c00b9e40 msgr2=0x7f98c013e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c4953640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98c00b9e40 0x7f98c013e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c4953640 1 -- 172.21.15.88:0/2070898182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b40094d0 con 0x7f98c0148450 2024-01-22T10:13:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98c4953640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c0148450 0x7f98c01dc2a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c780 tx=0x7f98b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.735+0000 7f98bcff9640 1 -- 172.21.15.88:0/2070898182 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800ce90 con 0x7f98c0148450 2024-01-22T10:13:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.736+0000 7f98bcff9640 1 -- 172.21.15.88:0/2070898182 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b800a640 con 0x7f98c0148450 2024-01-22T10:13:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.736+0000 7f98bcff9640 1 -- 172.21.15.88:0/2070898182 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800a9f0 con 0x7f98c0148450 2024-01-22T10:13:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.736+0000 7f98c63b6640 1 -- 172.21.15.88:0/2070898182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c00b77d0 con 0x7f98c0148450 2024-01-22T10:13:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.736+0000 7f98c63b6640 1 -- 172.21.15.88:0/2070898182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c0142d80 con 0x7f98c0148450 2024-01-22T10:13:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.737+0000 7f98c63b6640 1 -- 172.21.15.88:0/2070898182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c0074300 con 0x7f98c0148450 2024-01-22T10:13:35.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.737+0000 7f98bcff9640 1 -- 172.21.15.88:0/2070898182 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f98b800ab50 con 0x7f98c0148450 2024-01-22T10:13:35.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.737+0000 7f98bcff9640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f98ac06b330 0x7f98ac06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:35.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.738+0000 7f98bcff9640 1 -- 172.21.15.88:0/2070898182 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f98b8088fd0 con 0x7f98c0148450 2024-01-22T10:13:35.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.738+0000 7f98bffff640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f98ac06b330 0x7f98ac06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:35.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.738+0000 7f98bffff640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f98ac06b330 0x7f98ac06d7f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98b4036000 tx=0x7f98b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.742+0000 7f98bcff9640 1 -- 172.21.15.88:0/2070898182 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f98b8057aa0 con 0x7f98c0148450 2024-01-22T10:13:35.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:35.925+0000 7f98c63b6640 1 -- 172.21.15.88:0/2070898182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f98c004ea30 con 0x7f98c0148450 2024-01-22T10:13:36.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.567+0000 7f98bcff9640 1 -- 172.21.15.88:0/2070898182 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f98b8017080 con 0x7f98c0148450 2024-01-22T10:13:36.550 INFO:teuthology.orchestra.run.smithi088.stderr: removed all blocklist entries 2024-01-22T10:13:36.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.569+0000 7f98c63b6640 1 -- 172.21.15.88:0/2070898182 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f98ac06b330 msgr2=0x7f98ac06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:36.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.570+0000 7f98c63b6640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f98ac06b330 0x7f98ac06d7f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98b4036000 tx=0x7f98b4008030 comp rx=0 tx=0).stop 2024-01-22T10:13:36.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.570+0000 7f98c63b6640 1 -- 172.21.15.88:0/2070898182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c0148450 msgr2=0x7f98c01dc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:36.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.570+0000 7f98c63b6640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c0148450 0x7f98c01dc2a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c780 tx=0x7f98b800cc40 comp rx=0 tx=0).stop 2024-01-22T10:13:36.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.570+0000 7f98c63b6640 1 -- 172.21.15.88:0/2070898182 shutdown_connections 2024-01-22T10:13:36.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.570+0000 7f98c63b6640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f98ac06b330 0x7f98ac06d7f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.570+0000 7f98c63b6640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c0148450 0x7f98c01dc2a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.570+0000 7f98c63b6640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98c00b9e40 0x7f98c013e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.570+0000 7f98c63b6640 1 --2- 172.21.15.88:0/2070898182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98c0070630 0x7f98c00b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.570+0000 7f98c63b6640 1 -- 172.21.15.88:0/2070898182 >> 172.21.15.88:0/2070898182 conn(0x7f98c006e970 msgr2=0x7f98c006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:36.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.570+0000 7f98c63b6640 1 -- 172.21.15.88:0/2070898182 shutdown_connections 2024-01-22T10:13:36.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.570+0000 7f98c63b6640 1 -- 172.21.15.88:0/2070898182 wait complete. 2024-01-22T10:13:36.564 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-22T10:13:36.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.682+0000 7fc7309a4640 1 Processor -- start 2024-01-22T10:13:36.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.682+0000 7fc7309a4640 1 -- start start 2024-01-22T10:13:36.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.683+0000 7fc7309a4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0bdde0 0x7fc72c157020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:36.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.683+0000 7fc7309a4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c0bd1c0 con 0x7fc72c0b45a0 2024-01-22T10:13:36.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.683+0000 7fc7309a4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c14bc90 con 0x7fc72c0bbb00 2024-01-22T10:13:36.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.683+0000 7fc7309a4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0bc560 con 0x7fc72c0bdde0 2024-01-22T10:13:36.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.683+0000 7fc729d9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc72c0b45a0 0x7fc72c14b580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42156/0 (socket says 172.21.15.88:42156) 2024-01-22T10:13:36.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.683+0000 7fc729d9b640 1 -- 172.21.15.88:0/1202068121 learned_addr learned my addr 172.21.15.88:0/1202068121 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:36.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.683+0000 7fc72ad9d640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0bdde0 0x7fc72c157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:36.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026737474 0 0) 0x7fc72c0bd1c0 con 0x7fc72c0b45a0 2024-01-22T10:13:36.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc714003520 con 0x7fc72c0b45a0 2024-01-22T10:13:36.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561454961 0 0) 0x7fc72c14bc90 con 0x7fc72c0bbb00 2024-01-22T10:13:36.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc72c0bd1c0 con 0x7fc72c0bbb00 2024-01-22T10:13:36.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2771072261 0 0) 0x7fc714003520 con 0x7fc72c0b45a0 2024-01-22T10:13:36.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0bdde0 msgr2=0x7fc72c157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0bdde0 0x7fc72c157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 >> v1:172.21.15.119:6789/0 conn(0x7fc72c0bbb00 legacy=0x7fc72c14ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c0c0820 con 0x7fc72c0b45a0 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fc7200019f0 con 0x7fc72c0b45a0 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 >> v1:172.21.15.88:6789/0 conn(0x7fc72c0b45a0 legacy=0x7fc72c14b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc714003c10 0x7fc714004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7140047c0 0x7fc714004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0bdde0 0x7fc714005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71400bb10 con 0x7fc714003c10 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71400bc80 con 0x7fc7140047c0 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71400be40 con 0x7fc72c0bdde0 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72a59c640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc714003c10 0x7fc714004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc729d9b640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7140047c0 0x7fc714004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72ad9d640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0bdde0 0x7fc714005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:36.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72a59c640 1 -- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0bdde0 msgr2=0x7fc714005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72a59c640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0bdde0 0x7fc714005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72a59c640 1 -- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7140047c0 msgr2=0x7fc714004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72a59c640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7140047c0 0x7fc714004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72a59c640 1 -- 172.21.15.88:0/1202068121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc714003520 con 0x7fc714003c10 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc729d9b640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7140047c0 0x7fc714004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.684+0000 7fc72ad9d640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0bdde0 0x7fc714005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.685+0000 7fc72a59c640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc714003c10 0x7fc714004010 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc7240018a0 tx=0x7fc7140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7598420ce7d17fa0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.685+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240052d0 con 0x7fc714003c10 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.685+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc724005430 con 0x7fc714003c10 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.685+0000 7fc72959a640 1 -- 172.21.15.88:0/1202068121 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724003810 con 0x7fc714003c10 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.686+0000 7fc7309a4640 1 -- 172.21.15.88:0/1202068121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc714003c10 msgr2=0x7fc714004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.686+0000 7fc7309a4640 1 --2- 172.21.15.88:0/1202068121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc714003c10 0x7fc714004010 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc7240018a0 tx=0x7fc7140057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.686+0000 7fc72ad9d640 1 -- 172.21.15.88:0/1202068121 reap_dead start 2024-01-22T10:13:36.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.686+0000 7fc7309a4640 1 -- 172.21.15.88:0/1202068121 shutdown_connections 2024-01-22T10:13:36.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.686+0000 7fc7309a4640 1 -- 172.21.15.88:0/1202068121 >> 172.21.15.88:0/1202068121 conn(0x7fc72c0a2c20 msgr2=0x7fc72c0a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:36.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.686+0000 7fc7309a4640 1 -- 172.21.15.88:0/1202068121 shutdown_connections 2024-01-22T10:13:36.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.686+0000 7fc7309a4640 1 -- 172.21.15.88:0/1202068121 wait complete. 2024-01-22T10:13:36.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.687+0000 7fc7309a4640 1 Processor -- start 2024-01-22T10:13:36.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.687+0000 7fc7309a4640 1 -- start start 2024-01-22T10:13:36.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc7309a4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc714003c10 0x7fc72c1d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:36.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc7309a4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc72c1d2f90 0x7fc72c1d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:36.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc7309a4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0b71b0 0x7fc72c0b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc7309a4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0b6cd0 con 0x7fc72c1d2f90 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc7309a4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0b7b50 con 0x7fc714003c10 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc7309a4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0b41e0 con 0x7fc72c0b71b0 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc729d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc72c1d2f90 0x7fc72c1d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc729d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc72c1d2f90 0x7fc72c1d33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54518/0 (socket says 172.21.15.88:54518) 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc729d9b640 1 -- 172.21.15.88:0/2866785999 learned_addr learned my addr 172.21.15.88:0/2866785999 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc72a59c640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc714003c10 0x7fc72c1d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc72ad9d640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0b71b0 0x7fc72c0b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc729d9b640 1 -- 172.21.15.88:0/2866785999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0b71b0 msgr2=0x7fc72c0b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc729d9b640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0b71b0 0x7fc72c0b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc729d9b640 1 -- 172.21.15.88:0/2866785999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc714003c10 msgr2=0x7fc72c1d1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc729d9b640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc714003c10 0x7fc72c1d1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc729d9b640 1 -- 172.21.15.88:0/2866785999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c1d25b0 con 0x7fc72c1d2f90 2024-01-22T10:13:36.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc72a59c640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc714003c10 0x7fc72c1d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc729d9b640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc72c1d2f90 0x7fc72c1d33f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc720007a10 tx=0x7fc72000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc71affd640 1 -- 172.21.15.88:0/2866785999 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200019d0 con 0x7fc72c1d2f90 2024-01-22T10:13:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc71affd640 1 -- 172.21.15.88:0/2866785999 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72000ee50 con 0x7fc72c1d2f90 2024-01-22T10:13:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc7309a4640 1 -- 172.21.15.88:0/2866785999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72c1d8900 con 0x7fc72c1d2f90 2024-01-22T10:13:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc71affd640 1 -- 172.21.15.88:0/2866785999 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc720013640 con 0x7fc72c1d2f90 2024-01-22T10:13:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.688+0000 7fc7309a4640 1 -- 172.21.15.88:0/2866785999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72c1d2890 con 0x7fc72c1d2f90 2024-01-22T10:13:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.689+0000 7fc7309a4640 1 -- 172.21.15.88:0/2866785999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72c1d2400 con 0x7fc72c1d2f90 2024-01-22T10:13:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.690+0000 7fc71affd640 1 -- 172.21.15.88:0/2866785999 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fc7200137a0 con 0x7fc72c1d2f90 2024-01-22T10:13:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.690+0000 7fc71affd640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc70c06b330 0x7fc70c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.690+0000 7fc72a59c640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc70c06b330 0x7fc70c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.690+0000 7fc71affd640 1 -- 172.21.15.88:0/2866785999 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc720089f10 con 0x7fc72c1d2f90 2024-01-22T10:13:36.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.691+0000 7fc72a59c640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc70c06b330 0x7fc70c06d7f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc724034000 tx=0x7fc724031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:36.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.694+0000 7fc71affd640 1 -- 172.21.15.88:0/2866785999 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc720054f80 con 0x7fc72c1d2f90 2024-01-22T10:13:36.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.929+0000 7fc7309a4640 1 -- 172.21.15.88:0/2866785999 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc72c04ea30 con 0x7fc72c1d2f90 2024-01-22T10:13:36.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.930+0000 7fc71affd640 1 -- 172.21.15.88:0/2866785999 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+5491 (secure 0 0 0) 0x7fc7200585a0 con 0x7fc72c1d2f90 2024-01-22T10:13:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:36.913 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-01-22T10:13:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_dump": [ 2024-01-22T10:13:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.a", 2024-01-22T10:13:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB1P65lhbsgKBAA+XblNIh/8H8CcCb6d98Szw==", 2024-01-22T10:13:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2024-01-22T10:13:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2024-01-22T10:13:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2024-01-22T10:13:36.913 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.b", 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB1P65l2GatNBAAqZOQy739gefVCT0MdXsMtA==", 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.c", 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB1P65lnWJ8LxAAzAtJrfczAuNOeIRoUNpvgg==", 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.0", 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB5P65lGt67DxAADPFZ9WlQ5J8mbh1YMES4og==", 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.915 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.1", 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB8P65lhMMEDhAA3QhaJn54hRk2Kf2ChBrwug==", 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.2", 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB/P65lJloTDBAAJ6lBJHyV5/VQ1K8h6JTewA==", 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.3", 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCCP65lbRV0ChAA8A+7/NrwgivWWcXJGTqm7g==", 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-01-22T10:13:36.917 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.4", 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCIP65l/4svExAAxgIbclvj2hV0LZlRlz0LMg==", 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.5", 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCLP65lZZjOERAAw5r2VKLcaSlMhOPVRnoB2g==", 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.6", 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCOP65lO8M3EBAA3oDlaka1AKbdJ2KtIIFqaw==", 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.7", 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCRP65l1bT1DhAAlneZ8iUqnPWXYsk+yDKWTw==", 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.0", 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB2P65lTw4wAhAAHkWEm0pUd5uSTZi+mnQAVQ==", 2024-01-22T10:13:36.920 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow r", 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw", 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rwx" 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.admin", 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB0P65lLWqVOBAAlWua7slrv505WZTm9MO0Tw==", 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.921 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-mds", 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCWP65l8nmbKxAAT4SVbC0OFzLq4PiBiIKXaw==", 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-mds" 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-mgr", 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCWP65l74KbKxAAa1rH6oX02Na82l2WcpGLQw==", 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-osd", 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCWP65l3oqbKxAAk41KFebsh/yYk+2RD9wdxg==", 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-osd" 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rbd", 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCWP65l0JGbKxAAiWBUjXBA6Teh0j4vfkpG7A==", 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-22T10:13:36.923 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCWP65l+pibKxAA4yMafSU4nUjOC5YBJXjF5Q==", 2024-01-22T10:13:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-22T10:13:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rgw", 2024-01-22T10:13:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCWP65lGKCbKxAADPwDImxYeUYPg/I1OEtKAg==", 2024-01-22T10:13:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-22T10:13:36.924 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.x", 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB1P65lQeGVJBAAGrgMkgHxH6K49SO/T+4R7g==", 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.y", 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB1P65lTuEpIBAA0+8EP5AFhERJ6vGeRXFO9A==", 2024-01-22T10:13:36.925 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2024-01-22T10:13:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2024-01-22T10:13:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2024-01-22T10:13:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2024-01-22T10:13:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:36.926 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-01-22T10:13:36.926 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-01-22T10:13:36.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.932+0000 7fc7309a4640 1 -- 172.21.15.88:0/2866785999 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc70c06b330 msgr2=0x7fc70c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:36.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.932+0000 7fc7309a4640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc70c06b330 0x7fc70c06d7f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc724034000 tx=0x7fc724031000 comp rx=0 tx=0).stop 2024-01-22T10:13:36.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.932+0000 7fc7309a4640 1 -- 172.21.15.88:0/2866785999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc72c1d2f90 msgr2=0x7fc72c1d33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:36.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.932+0000 7fc7309a4640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc72c1d2f90 0x7fc72c1d33f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc720007a10 tx=0x7fc72000e530 comp rx=0 tx=0).stop 2024-01-22T10:13:36.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.932+0000 7fc7309a4640 1 -- 172.21.15.88:0/2866785999 shutdown_connections 2024-01-22T10:13:36.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.932+0000 7fc7309a4640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc70c06b330 0x7fc70c06d7f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.932+0000 7fc7309a4640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc72c0b71b0 0x7fc72c0b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.932+0000 7fc7309a4640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc72c1d2f90 0x7fc72c1d33f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.932+0000 7fc7309a4640 1 --2- 172.21.15.88:0/2866785999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc714003c10 0x7fc72c1d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:36.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.932+0000 7fc7309a4640 1 -- 172.21.15.88:0/2866785999 >> 172.21.15.88:0/2866785999 conn(0x7fc72c0a2c20 msgr2=0x7fc72c06b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:36.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.932+0000 7fc7309a4640 1 -- 172.21.15.88:0/2866785999 shutdown_connections 2024-01-22T10:13:36.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:36.932+0000 7fc7309a4640 1 -- 172.21.15.88:0/2866785999 wait complete. 2024-01-22T10:13:36.928 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-22T10:13:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.047+0000 7fa65b25c640 1 Processor -- start 2024-01-22T10:13:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.047+0000 7fa65b25c640 1 -- start start 2024-01-22T10:13:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.048+0000 7fa65b25c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65406ff80 0x7fa6540b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.048+0000 7fa65b25c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa654070360 0x7fa65414ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.048+0000 7fa65b25c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa654071ef0 con 0x7fa65406f6e0 2024-01-22T10:13:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.048+0000 7fa65b25c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa654071720 con 0x7fa654070360 2024-01-22T10:13:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.048+0000 7fa65b25c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540707d0 con 0x7fa65406ff80 2024-01-22T10:13:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.048+0000 7fa653fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa65406f6e0 0x7fa654143590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42166/0 (socket says 172.21.15.88:42166) 2024-01-22T10:13:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.048+0000 7fa653fff640 1 -- 172.21.15.88:0/2966033541 learned_addr learned my addr 172.21.15.88:0/2966033541 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:37.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.048+0000 7fa6597f9640 1 --2- 172.21.15.88:0/2966033541 >> v2:172.21.15.119:3300/0 conn(0x7fa654070360 0x7fa65414ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.048+0000 7fa658ff8640 1 --2- 172.21.15.88:0/2966033541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65406ff80 0x7fa6540b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.048+0000 7fa6537fe640 1 -- 172.21.15.88:0/2966033541 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333598150 0 0) 0x7fa654071ef0 con 0x7fa65406f6e0 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.048+0000 7fa6537fe640 1 -- 172.21.15.88:0/2966033541 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa63c003520 con 0x7fa65406f6e0 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.049+0000 7fa6537fe640 1 -- 172.21.15.88:0/2966033541 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 280354269 0 0) 0x7fa63c003520 con 0x7fa65406f6e0 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.049+0000 7fa658ff8640 1 -- 172.21.15.88:0/2966033541 >> v2:172.21.15.119:3300/0 conn(0x7fa654070360 msgr2=0x7fa65414ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.049+0000 7fa658ff8640 1 --2- 172.21.15.88:0/2966033541 >> v2:172.21.15.119:3300/0 conn(0x7fa654070360 0x7fa65414ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.049+0000 7fa658ff8640 1 -- 172.21.15.88:0/2966033541 >> v1:172.21.15.88:6789/0 conn(0x7fa65406f6e0 legacy=0x7fa654143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.049+0000 7fa658ff8640 1 -- 172.21.15.88:0/2966033541 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540726a0 con 0x7fa65406ff80 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.049+0000 7fa6597f9640 1 --2- 172.21.15.88:0/2966033541 >> v2:172.21.15.119:3300/0 conn(0x7fa654070360 0x7fa65414ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.049+0000 7fa658ff8640 1 --2- 172.21.15.88:0/2966033541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65406ff80 0x7fa6540b6f50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097a0 tx=0x7fa64402b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fa39aac9d73082e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.050+0000 7fa6537fe640 1 -- 172.21.15.88:0/2966033541 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648001670 con 0x7fa65406ff80 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.050+0000 7fa6537fe640 1 -- 172.21.15.88:0/2966033541 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64402e050 con 0x7fa65406ff80 2024-01-22T10:13:37.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.050+0000 7fa6537fe640 1 -- 172.21.15.88:0/2966033541 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa644030710 con 0x7fa65406ff80 2024-01-22T10:13:37.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.050+0000 7fa65b25c640 1 -- 172.21.15.88:0/2966033541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65406ff80 msgr2=0x7fa6540b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.050+0000 7fa65b25c640 1 --2- 172.21.15.88:0/2966033541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65406ff80 0x7fa6540b6f50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097a0 tx=0x7fa64402b790 comp rx=0 tx=0).stop 2024-01-22T10:13:37.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.050+0000 7fa65b25c640 1 -- 172.21.15.88:0/2966033541 shutdown_connections 2024-01-22T10:13:37.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.050+0000 7fa65b25c640 1 --2- 172.21.15.88:0/2966033541 >> v2:172.21.15.119:3300/0 conn(0x7fa654070360 0x7fa65414ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.050+0000 7fa65b25c640 1 --2- 172.21.15.88:0/2966033541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65406ff80 0x7fa6540b6f50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.050+0000 7fa65b25c640 1 -- 172.21.15.88:0/2966033541 >> 172.21.15.88:0/2966033541 conn(0x7fa6540badd0 msgr2=0x7fa6540bb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:37.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.050+0000 7fa65b25c640 1 -- 172.21.15.88:0/2966033541 shutdown_connections 2024-01-22T10:13:37.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.050+0000 7fa65b25c640 1 -- 172.21.15.88:0/2966033541 wait complete. 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.051+0000 7fa65b25c640 1 Processor -- start 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.051+0000 7fa65b25c640 1 -- start start 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa65b25c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65406f6e0 0x7fa6541422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa65b25c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa65406ff80 0x7fa6541e4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa65b25c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa654070360 0x7fa6541e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa65b25c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6541d4470 con 0x7fa65406ff80 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa65b25c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654142820 con 0x7fa654070360 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa65b25c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65406dab0 con 0x7fa65406f6e0 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa653fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa65406ff80 0x7fa6541e4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa653fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa65406ff80 0x7fa6541e4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54524/0 (socket says 172.21.15.88:54524) 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa653fff640 1 -- 172.21.15.88:0/1787838290 learned_addr learned my addr 172.21.15.88:0/1787838290 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa658ff8640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65406f6e0 0x7fa6541422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa6597f9640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa654070360 0x7fa6541e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa653fff640 1 -- 172.21.15.88:0/1787838290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65406f6e0 msgr2=0x7fa6541422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa653fff640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65406f6e0 0x7fa6541422e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa653fff640 1 -- 172.21.15.88:0/1787838290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa654070360 msgr2=0x7fa6541e4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa653fff640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa654070360 0x7fa6541e4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa653fff640 1 -- 172.21.15.88:0/1787838290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c009a70 con 0x7fa65406ff80 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.052+0000 7fa653fff640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa65406ff80 0x7fa6541e4770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c750 tx=0x7fa64800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.053+0000 7fa6517fa640 1 -- 172.21.15.88:0/1787838290 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648005ad0 con 0x7fa65406ff80 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.053+0000 7fa6517fa640 1 -- 172.21.15.88:0/1787838290 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa648005c50 con 0x7fa65406ff80 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.053+0000 7fa65b25c640 1 -- 172.21.15.88:0/1787838290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa644009400 con 0x7fa65406ff80 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.053+0000 7fa6517fa640 1 -- 172.21.15.88:0/1787838290 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648007070 con 0x7fa65406ff80 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.053+0000 7fa65b25c640 1 -- 172.21.15.88:0/1787838290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65406d460 con 0x7fa65406ff80 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.054+0000 7fa65b25c640 1 -- 172.21.15.88:0/1787838290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa654149dd0 con 0x7fa65406ff80 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.054+0000 7fa6517fa640 1 -- 172.21.15.88:0/1787838290 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fa6480071d0 con 0x7fa65406ff80 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.054+0000 7fa6517fa640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa64006b330 0x7fa64006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.054+0000 7fa6517fa640 1 -- 172.21.15.88:0/1787838290 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa648089610 con 0x7fa65406ff80 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.054+0000 7fa658ff8640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa64006b330 0x7fa64006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.055+0000 7fa658ff8640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa64006b330 0x7fa64006d7f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa644034000 tx=0x7fa64402f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:37.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.058+0000 7fa6517fa640 1 -- 172.21.15.88:0/1787838290 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa654149dd0 con 0x7fa65406ff80 2024-01-22T10:13:37.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.291+0000 7fa65b25c640 1 -- 172.21.15.88:0/1787838290 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fa65406dc60 con 0x7fa65406ff80 2024-01-22T10:13:37.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.293+0000 7fa6517fa640 1 -- 172.21.15.88:0/1787838290 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa65406dc60 con 0x7fa65406ff80 2024-01-22T10:13:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.295+0000 7fa65b25c640 1 -- 172.21.15.88:0/1787838290 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa64006b330 msgr2=0x7fa64006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.295+0000 7fa65b25c640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa64006b330 0x7fa64006d7f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa644034000 tx=0x7fa64402f000 comp rx=0 tx=0).stop 2024-01-22T10:13:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.295+0000 7fa65b25c640 1 -- 172.21.15.88:0/1787838290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa65406ff80 msgr2=0x7fa6541e4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.295+0000 7fa65b25c640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa65406ff80 0x7fa6541e4770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c750 tx=0x7fa64800cc10 comp rx=0 tx=0).stop 2024-01-22T10:13:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.295+0000 7fa65b25c640 1 -- 172.21.15.88:0/1787838290 shutdown_connections 2024-01-22T10:13:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.295+0000 7fa65b25c640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa64006b330 0x7fa64006d7f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.295+0000 7fa65b25c640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa654070360 0x7fa6541e4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.295+0000 7fa65b25c640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa65406ff80 0x7fa6541e4770 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.295+0000 7fa65b25c640 1 --2- 172.21.15.88:0/1787838290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65406f6e0 0x7fa6541422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.295+0000 7fa65b25c640 1 -- 172.21.15.88:0/1787838290 >> 172.21.15.88:0/1787838290 conn(0x7fa6540badd0 msgr2=0x7fa6540b7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.295+0000 7fa65b25c640 1 -- 172.21.15.88:0/1787838290 shutdown_connections 2024-01-22T10:13:37.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.295+0000 7fa65b25c640 1 -- 172.21.15.88:0/1787838290 wait complete. 2024-01-22T10:13:37.288 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-22T10:13:37.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.405+0000 7fd1d851d640 1 Processor -- start 2024-01-22T10:13:37.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.405+0000 7fd1d851d640 1 -- start start 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d851d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd1d0149850 0x7fd1d0149c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d851d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd1d00b6100 0x7fd1d006ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d851d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d014a310 con 0x7fd1d00b6570 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d851d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d006e790 con 0x7fd1d00b6100 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d851d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d006e1a0 con 0x7fd1d0149850 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d5ab8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd1d00b6100 0x7fd1d006ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d5ab8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd1d00b6100 0x7fd1d006ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54530/0 (socket says 172.21.15.88:54530) 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d5ab8640 1 -- 172.21.15.88:0/4061343512 learned_addr learned my addr 172.21.15.88:0/4061343512 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d62b9640 1 --2- 172.21.15.88:0/4061343512 >> v2:172.21.15.119:3300/0 conn(0x7fd1d0149850 0x7fd1d0149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d5ab8640 1 -- 172.21.15.88:0/4061343512 >> v2:172.21.15.119:3300/0 conn(0x7fd1d0149850 msgr2=0x7fd1d0149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d5ab8640 1 --2- 172.21.15.88:0/4061343512 >> v2:172.21.15.119:3300/0 conn(0x7fd1d0149850 0x7fd1d0149c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d5ab8640 1 -- 172.21.15.88:0/4061343512 >> v1:172.21.15.119:6789/0 conn(0x7fd1d00b6570 legacy=0x7fd1d0143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:37.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.406+0000 7fd1d5ab8640 1 -- 172.21.15.88:0/4061343512 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d006e3b0 con 0x7fd1d00b6100 2024-01-22T10:13:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.407+0000 7fd1d5ab8640 1 --2- 172.21.15.88:0/4061343512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1d00b6100 0x7fd1d006ebb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00bb750 tx=0x7fd1c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc9332afd582995 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.407+0000 7fd1d52b7640 1 -- 172.21.15.88:0/4061343512 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0031870 con 0x7fd1d00b6100 2024-01-22T10:13:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.407+0000 7fd1d52b7640 1 -- 172.21.15.88:0/4061343512 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c00319d0 con 0x7fd1d00b6100 2024-01-22T10:13:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.407+0000 7fd1d52b7640 1 -- 172.21.15.88:0/4061343512 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0031d60 con 0x7fd1d00b6100 2024-01-22T10:13:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.408+0000 7fd1d851d640 1 -- 172.21.15.88:0/4061343512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1d00b6100 msgr2=0x7fd1d006ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.408+0000 7fd1d851d640 1 --2- 172.21.15.88:0/4061343512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1d00b6100 0x7fd1d006ebb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00bb750 tx=0x7fd1c002b910 comp rx=0 tx=0).stop 2024-01-22T10:13:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.408+0000 7fd1d851d640 1 -- 172.21.15.88:0/4061343512 shutdown_connections 2024-01-22T10:13:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.408+0000 7fd1d851d640 1 --2- 172.21.15.88:0/4061343512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1d00b6100 0x7fd1d006ebb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.408+0000 7fd1d851d640 1 --2- 172.21.15.88:0/4061343512 >> v2:172.21.15.119:3300/0 conn(0x7fd1d0149850 0x7fd1d0149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.408+0000 7fd1d851d640 1 -- 172.21.15.88:0/4061343512 >> 172.21.15.88:0/4061343512 conn(0x7fd1d00bb780 msgr2=0x7fd1d00bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:37.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.408+0000 7fd1d851d640 1 -- 172.21.15.88:0/4061343512 shutdown_connections 2024-01-22T10:13:37.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.408+0000 7fd1d851d640 1 -- 172.21.15.88:0/4061343512 wait complete. 2024-01-22T10:13:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.409+0000 7fd1d851d640 1 Processor -- start 2024-01-22T10:13:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.409+0000 7fd1d851d640 1 -- start start 2024-01-22T10:13:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d851d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d00b6100 0x7fd1d0146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d851d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1d00b6570 0x7fd1d0146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d851d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1d0149850 0x7fd1d01e2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d851d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d01429d0 con 0x7fd1d0149850 2024-01-22T10:13:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d851d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d01e2280 con 0x7fd1d00b6100 2024-01-22T10:13:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d851d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00b5d40 con 0x7fd1d00b6570 2024-01-22T10:13:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d6aba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1d0149850 0x7fd1d01e2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d6aba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1d0149850 0x7fd1d01e2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54540/0 (socket says 172.21.15.88:54540) 2024-01-22T10:13:37.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d6aba640 1 -- 172.21.15.88:0/3522368277 learned_addr learned my addr 172.21.15.88:0/3522368277 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d62b9640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d00b6100 0x7fd1d0146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d5ab8640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1d00b6570 0x7fd1d0146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d6aba640 1 -- 172.21.15.88:0/3522368277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1d00b6570 msgr2=0x7fd1d0146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d6aba640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1d00b6570 0x7fd1d0146850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d6aba640 1 -- 172.21.15.88:0/3522368277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d00b6100 msgr2=0x7fd1d0146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d6aba640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d00b6100 0x7fd1d0146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d6aba640 1 -- 172.21.15.88:0/3522368277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c00094d0 con 0x7fd1d0149850 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d5ab8640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1d00b6570 0x7fd1d0146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d6aba640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1d0149850 0x7fd1d01e2710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800c780 tx=0x7fd1c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1c6ffd640 1 -- 172.21.15.88:0/3522368277 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8004b60 con 0x7fd1d0149850 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1c6ffd640 1 -- 172.21.15.88:0/3522368277 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c800ce90 con 0x7fd1d0149850 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d851d640 1 -- 172.21.15.88:0/3522368277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d01d39a0 con 0x7fd1d0149850 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1c6ffd640 1 -- 172.21.15.88:0/3522368277 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c800a850 con 0x7fd1d0149850 2024-01-22T10:13:37.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.410+0000 7fd1d851d640 1 -- 172.21.15.88:0/3522368277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d00b5a60 con 0x7fd1d0149850 2024-01-22T10:13:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.411+0000 7fd1d851d640 1 -- 172.21.15.88:0/3522368277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d01e2410 con 0x7fd1d0149850 2024-01-22T10:13:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.412+0000 7fd1c6ffd640 1 -- 172.21.15.88:0/3522368277 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fd1c800a9b0 con 0x7fd1d0149850 2024-01-22T10:13:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.412+0000 7fd1c6ffd640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd1b406b330 0x7fd1b406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.412+0000 7fd1d62b9640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd1b406b330 0x7fd1b406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.412+0000 7fd1c6ffd640 1 -- 172.21.15.88:0/3522368277 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd1c8089a10 con 0x7fd1d0149850 2024-01-22T10:13:37.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.413+0000 7fd1d62b9640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd1b406b330 0x7fd1b406d7f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0079a0 tx=0x7fd1cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:37.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.417+0000 7fd1c6ffd640 1 -- 172.21.15.88:0/3522368277 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd1c8054960 con 0x7fd1d0149850 2024-01-22T10:13:37.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.652+0000 7fd1d851d640 1 -- 172.21.15.88:0/3522368277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd1d004ea30 con 0x7fd1d0149850 2024-01-22T10:13:37.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.653+0000 7fd1c6ffd640 1 -- 172.21.15.88:0/3522368277 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd1c8057f80 con 0x7fd1d0149850 2024-01-22T10:13:37.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.655+0000 7fd1d851d640 1 -- 172.21.15.88:0/3522368277 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd1b406b330 msgr2=0x7fd1b406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.655+0000 7fd1d851d640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd1b406b330 0x7fd1b406d7f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0079a0 tx=0x7fd1cc008040 comp rx=0 tx=0).stop 2024-01-22T10:13:37.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.655+0000 7fd1d851d640 1 -- 172.21.15.88:0/3522368277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1d0149850 msgr2=0x7fd1d01e2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.655+0000 7fd1d851d640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1d0149850 0x7fd1d01e2710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800c780 tx=0x7fd1c800cc40 comp rx=0 tx=0).stop 2024-01-22T10:13:37.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.655+0000 7fd1d851d640 1 -- 172.21.15.88:0/3522368277 shutdown_connections 2024-01-22T10:13:37.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.655+0000 7fd1d851d640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd1b406b330 0x7fd1b406d7f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.655+0000 7fd1d851d640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1d00b6570 0x7fd1d0146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.655+0000 7fd1d851d640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1d0149850 0x7fd1d01e2710 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.655+0000 7fd1d851d640 1 --2- 172.21.15.88:0/3522368277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1d00b6100 0x7fd1d0146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.655+0000 7fd1d851d640 1 -- 172.21.15.88:0/3522368277 >> 172.21.15.88:0/3522368277 conn(0x7fd1d00bb780 msgr2=0x7fd1d00b7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:37.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.655+0000 7fd1d851d640 1 -- 172.21.15.88:0/3522368277 shutdown_connections 2024-01-22T10:13:37.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.656+0000 7fd1d851d640 1 -- 172.21.15.88:0/3522368277 wait complete. 2024-01-22T10:13:37.648 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-22T10:13:37.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.765+0000 7f92de2a6640 1 Processor -- start 2024-01-22T10:13:37.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.766+0000 7f92de2a6640 1 -- start start 2024-01-22T10:13:37.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.766+0000 7f92de2a6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d80b5310 0x7f92d806d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.766+0000 7f92de2a6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f92d806bc20 0x7f92d8156040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.766+0000 7f92de2a6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d814c590 con 0x7f92d806b800 2024-01-22T10:13:37.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.766+0000 7f92de2a6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d806d080 con 0x7f92d806bc20 2024-01-22T10:13:37.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.766+0000 7f92de2a6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d814b7d0 con 0x7f92d80b5310 2024-01-22T10:13:37.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.766+0000 7f92dc843640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f92d806bc20 0x7f92d8156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.766+0000 7f92d77fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f92d806b800 0x7f92d80b4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33460/0 (socket says 172.21.15.88:33460) 2024-01-22T10:13:37.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.766+0000 7f92dc843640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f92d806bc20 0x7f92d8156040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47604/0 (socket says 172.21.15.88:47604) 2024-01-22T10:13:37.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.766+0000 7f92d77fe640 1 -- 172.21.15.88:0/2135533621 learned_addr learned my addr 172.21.15.88:0/2135533621 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:37.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.767+0000 7f92dc843640 1 -- 172.21.15.88:0/2135533621 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d80b5310 msgr2=0x7f92d806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:37.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.767+0000 7f92d7fff640 1 --2- 172.21.15.88:0/2135533621 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d80b5310 0x7f92d806d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.767+0000 7f92d6ffd640 1 -- 172.21.15.88:0/2135533621 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089797403 0 0) 0x7f92d814c590 con 0x7f92d806b800 2024-01-22T10:13:37.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.767+0000 7f92dc843640 1 --2- 172.21.15.88:0/2135533621 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d80b5310 0x7f92d806d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.767+0000 7f92dc843640 1 -- 172.21.15.88:0/2135533621 >> v1:172.21.15.88:6789/0 conn(0x7f92d806b800 legacy=0x7f92d80b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.767+0000 7f92dc843640 1 -- 172.21.15.88:0/2135533621 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d814bab0 con 0x7f92d806bc20 2024-01-22T10:13:37.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.767+0000 7f92dc843640 1 --2- 172.21.15.88:0/2135533621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d806bc20 0x7f92d8156040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009d90 tx=0x7f92d002bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ccaf457ede9806 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:37.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.767+0000 7f92d6ffd640 1 -- 172.21.15.88:0/2135533621 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d002cce0 con 0x7f92d806bc20 2024-01-22T10:13:37.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.767+0000 7f92d6ffd640 1 -- 172.21.15.88:0/2135533621 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d002ce40 con 0x7f92d806bc20 2024-01-22T10:13:37.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.768+0000 7f92d6ffd640 1 -- 172.21.15.88:0/2135533621 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0034660 con 0x7f92d806bc20 2024-01-22T10:13:37.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.768+0000 7f92de2a6640 1 -- 172.21.15.88:0/2135533621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d806bc20 msgr2=0x7f92d8156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.768+0000 7f92de2a6640 1 --2- 172.21.15.88:0/2135533621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d806bc20 0x7f92d8156040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009d90 tx=0x7f92d002bf30 comp rx=0 tx=0).stop 2024-01-22T10:13:37.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.768+0000 7f92de2a6640 1 -- 172.21.15.88:0/2135533621 shutdown_connections 2024-01-22T10:13:37.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.768+0000 7f92de2a6640 1 --2- 172.21.15.88:0/2135533621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d806bc20 0x7f92d8156040 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.768+0000 7f92de2a6640 1 --2- 172.21.15.88:0/2135533621 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d80b5310 0x7f92d806d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.768+0000 7f92de2a6640 1 -- 172.21.15.88:0/2135533621 >> 172.21.15.88:0/2135533621 conn(0x7f92d80bec50 msgr2=0x7f92d80bf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:37.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.768+0000 7f92de2a6640 1 -- 172.21.15.88:0/2135533621 shutdown_connections 2024-01-22T10:13:37.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.768+0000 7f92de2a6640 1 -- 172.21.15.88:0/2135533621 wait complete. 2024-01-22T10:13:37.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.769+0000 7f92de2a6640 1 Processor -- start 2024-01-22T10:13:37.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.769+0000 7f92de2a6640 1 -- start start 2024-01-22T10:13:37.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92de2a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92d806b800 0x7f92d8140560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92de2a6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d806bc20 0x7f92d814f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92de2a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d80b5310 0x7f92d81e48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92de2a6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8140aa0 con 0x7f92d80b5310 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92de2a6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d814f730 con 0x7f92d806b800 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92de2a6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80b7e70 con 0x7f92d806bc20 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92dc843640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d80b5310 0x7f92d81e48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92dc843640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d80b5310 0x7f92d81e48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47608/0 (socket says 172.21.15.88:47608) 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92dc843640 1 -- 172.21.15.88:0/998136920 learned_addr learned my addr 172.21.15.88:0/998136920 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92d7fff640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92d806b800 0x7f92d8140560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92d77fe640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d806bc20 0x7f92d814f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92dc843640 1 -- 172.21.15.88:0/998136920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d806bc20 msgr2=0x7f92d814f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92dc843640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d806bc20 0x7f92d814f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92dc843640 1 -- 172.21.15.88:0/998136920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92d806b800 msgr2=0x7f92d8140560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92dc843640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92d806b800 0x7f92d8140560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92dc843640 1 -- 172.21.15.88:0/998136920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d0009a70 con 0x7f92d80b5310 2024-01-22T10:13:37.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92d77fe640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d806bc20 0x7f92d814f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:37.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92dc843640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d80b5310 0x7f92d81e48e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009eb0 tx=0x7f92d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:37.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.770+0000 7f92d4ff9640 1 -- 172.21.15.88:0/998136920 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d003e670 con 0x7f92d80b5310 2024-01-22T10:13:37.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.771+0000 7f92d4ff9640 1 -- 172.21.15.88:0/998136920 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d003e7f0 con 0x7f92d80b5310 2024-01-22T10:13:37.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.771+0000 7f92d4ff9640 1 -- 172.21.15.88:0/998136920 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d003eba0 con 0x7f92d80b5310 2024-01-22T10:13:37.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.771+0000 7f92de2a6640 1 -- 172.21.15.88:0/998136920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d814f930 con 0x7f92d80b5310 2024-01-22T10:13:37.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.771+0000 7f92de2a6640 1 -- 172.21.15.88:0/998136920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d80b7b00 con 0x7f92d80b5310 2024-01-22T10:13:37.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.772+0000 7f92de2a6640 1 -- 172.21.15.88:0/998136920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d80b8020 con 0x7f92d80b5310 2024-01-22T10:13:37.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.772+0000 7f92d4ff9640 1 -- 172.21.15.88:0/998136920 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f92d003b040 con 0x7f92d80b5310 2024-01-22T10:13:37.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.772+0000 7f92d4ff9640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f92b806b330 0x7f92b806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:37.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.773+0000 7f92d7fff640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f92b806b330 0x7f92b806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:37.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.773+0000 7f92d4ff9640 1 -- 172.21.15.88:0/998136920 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f92d00ac380 con 0x7f92d80b5310 2024-01-22T10:13:37.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.773+0000 7f92d7fff640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f92b806b330 0x7f92b806d7f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f92c000aa20 tx=0x7f92c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:37.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:37.777+0000 7f92d4ff9640 1 -- 172.21.15.88:0/998136920 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f92d80b8020 con 0x7f92d80b5310 2024-01-22T10:13:37.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.006+0000 7f92de2a6640 1 -- 172.21.15.88:0/998136920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f92d80b8020 con 0x7f92d80b5310 2024-01-22T10:13:37.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.008+0000 7f92d4ff9640 1 -- 172.21.15.88:0/998136920 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f92d80b8020 con 0x7f92d80b5310 2024-01-22T10:13:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.011+0000 7f92de2a6640 1 -- 172.21.15.88:0/998136920 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f92b806b330 msgr2=0x7f92b806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.011+0000 7f92de2a6640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f92b806b330 0x7f92b806d7f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f92c000aa20 tx=0x7f92c0008040 comp rx=0 tx=0).stop 2024-01-22T10:13:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.011+0000 7f92de2a6640 1 -- 172.21.15.88:0/998136920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d80b5310 msgr2=0x7f92d81e48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.011+0000 7f92de2a6640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d80b5310 0x7f92d81e48e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009eb0 tx=0x7f92d0004a40 comp rx=0 tx=0).stop 2024-01-22T10:13:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.011+0000 7f92de2a6640 1 -- 172.21.15.88:0/998136920 shutdown_connections 2024-01-22T10:13:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.011+0000 7f92de2a6640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f92b806b330 0x7f92b806d7f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.011+0000 7f92de2a6640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92d806bc20 0x7f92d814f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.011+0000 7f92de2a6640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d80b5310 0x7f92d81e48e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.011+0000 7f92de2a6640 1 --2- 172.21.15.88:0/998136920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92d806b800 0x7f92d8140560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.011+0000 7f92de2a6640 1 -- 172.21.15.88:0/998136920 >> 172.21.15.88:0/998136920 conn(0x7f92d80bec50 msgr2=0x7f92d80bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.011+0000 7f92de2a6640 1 -- 172.21.15.88:0/998136920 shutdown_connections 2024-01-22T10:13:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.011+0000 7f92de2a6640 1 -- 172.21.15.88:0/998136920 wait complete. 2024-01-22T10:13:38.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-22T10:13:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.121+0000 7f0e2f8da640 1 Processor -- start 2024-01-22T10:13:38.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.121+0000 7f0e2f8da640 1 -- start start 2024-01-22T10:13:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2f8da640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0e2806df70 0x7f0e280b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2f8da640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e2814a170 0x7f0e280b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2f8da640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e280b5440 0x7f0e2814ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2f8da640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e28143bf0 con 0x7f0e2814a170 2024-01-22T10:13:38.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2f8da640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e281494b0 con 0x7f0e2806df70 2024-01-22T10:13:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2f8da640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2806f000 con 0x7f0e280b5440 2024-01-22T10:13:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2ce75640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e2814a170 0x7f0e280b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2ce75640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e2814a170 0x7f0e280b4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47610/0 (socket says 172.21.15.88:47610) 2024-01-22T10:13:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2ce75640 1 -- 172.21.15.88:0/1204073437 learned_addr learned my addr 172.21.15.88:0/1204073437 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2d676640 1 --2- 172.21.15.88:0/1204073437 >> v2:172.21.15.119:3300/0 conn(0x7f0e2806df70 0x7f0e280b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2de77640 1 --2- 172.21.15.88:0/1204073437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e280b5440 0x7f0e2814ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2ce75640 1 -- 172.21.15.88:0/1204073437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e280b5440 msgr2=0x7f0e2814ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2ce75640 1 --2- 172.21.15.88:0/1204073437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e280b5440 0x7f0e2814ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2ce75640 1 -- 172.21.15.88:0/1204073437 >> v2:172.21.15.119:3300/0 conn(0x7f0e2806df70 msgr2=0x7f0e280b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2ce75640 1 --2- 172.21.15.88:0/1204073437 >> v2:172.21.15.119:3300/0 conn(0x7f0e2806df70 0x7f0e280b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.122+0000 7f0e2ce75640 1 -- 172.21.15.88:0/1204073437 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e28149ce0 con 0x7f0e2814a170 2024-01-22T10:13:38.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.123+0000 7f0e2d676640 1 --2- 172.21.15.88:0/1204073437 >> v2:172.21.15.119:3300/0 conn(0x7f0e2806df70 0x7f0e280b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.123+0000 7f0e2ce75640 1 --2- 172.21.15.88:0/1204073437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2814a170 0x7f0e280b4f00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0e2806fff0 tx=0x7f0e1802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65782589d02d66 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.123+0000 7f0e1ffff640 1 -- 172.21.15.88:0/1204073437 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18031870 con 0x7f0e2814a170 2024-01-22T10:13:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.123+0000 7f0e1ffff640 1 -- 172.21.15.88:0/1204073437 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e180319d0 con 0x7f0e2814a170 2024-01-22T10:13:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.123+0000 7f0e1ffff640 1 -- 172.21.15.88:0/1204073437 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18031d60 con 0x7f0e2814a170 2024-01-22T10:13:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.124+0000 7f0e2f8da640 1 -- 172.21.15.88:0/1204073437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2814a170 msgr2=0x7f0e280b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.124+0000 7f0e2f8da640 1 --2- 172.21.15.88:0/1204073437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2814a170 0x7f0e280b4f00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0e2806fff0 tx=0x7f0e1802b910 comp rx=0 tx=0).stop 2024-01-22T10:13:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.124+0000 7f0e2f8da640 1 -- 172.21.15.88:0/1204073437 shutdown_connections 2024-01-22T10:13:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.124+0000 7f0e2f8da640 1 --2- 172.21.15.88:0/1204073437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2814a170 0x7f0e280b4f00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.124+0000 7f0e2f8da640 1 --2- 172.21.15.88:0/1204073437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e280b5440 0x7f0e2814ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.124+0000 7f0e2f8da640 1 --2- 172.21.15.88:0/1204073437 >> v2:172.21.15.119:3300/0 conn(0x7f0e2806df70 0x7f0e280b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.124+0000 7f0e2f8da640 1 -- 172.21.15.88:0/1204073437 >> 172.21.15.88:0/1204073437 conn(0x7f0e280bec50 msgr2=0x7f0e280bf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.124+0000 7f0e2f8da640 1 -- 172.21.15.88:0/1204073437 shutdown_connections 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.124+0000 7f0e2f8da640 1 -- 172.21.15.88:0/1204073437 wait complete. 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.125+0000 7f0e2f8da640 1 Processor -- start 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.125+0000 7f0e2f8da640 1 -- start start 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2f8da640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e2806df70 0x7f0e281e1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2f8da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2814a170 0x7f0e281d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2f8da640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e281d1fa0 0x7f0e281420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2f8da640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280a4d90 con 0x7f0e2814a170 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2f8da640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281cf930 con 0x7f0e2806df70 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2f8da640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281d2440 con 0x7f0e281d1fa0 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2ce75640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2814a170 0x7f0e281d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2ce75640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2814a170 0x7f0e281d2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47618/0 (socket says 172.21.15.88:47618) 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2ce75640 1 -- 172.21.15.88:0/3768431846 learned_addr learned my addr 172.21.15.88:0/3768431846 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:38.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2d676640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e2806df70 0x7f0e281e1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2de77640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e281d1fa0 0x7f0e281420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2ce75640 1 -- 172.21.15.88:0/3768431846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e281d1fa0 msgr2=0x7f0e281420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2ce75640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e281d1fa0 0x7f0e281420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2ce75640 1 -- 172.21.15.88:0/3768431846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e2806df70 msgr2=0x7f0e281e1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2ce75640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e2806df70 0x7f0e281e1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2ce75640 1 -- 172.21.15.88:0/3768431846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180094d0 con 0x7f0e2814a170 2024-01-22T10:13:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2de77640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e281d1fa0 0x7f0e281420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2ce75640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2814a170 0x7f0e281d2bb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0e1802b950 tx=0x7f0e180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e1dffb640 1 -- 172.21.15.88:0/3768431846 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1803ad30 con 0x7f0e2814a170 2024-01-22T10:13:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e1dffb640 1 -- 172.21.15.88:0/3768431846 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e180443f0 con 0x7f0e2814a170 2024-01-22T10:13:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e1dffb640 1 -- 172.21.15.88:0/3768431846 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e180447a0 con 0x7f0e2814a170 2024-01-22T10:13:38.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.126+0000 7f0e2f8da640 1 -- 172.21.15.88:0/3768431846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e281cf5c0 con 0x7f0e2814a170 2024-01-22T10:13:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.127+0000 7f0e2f8da640 1 -- 172.21.15.88:0/3768431846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e28146db0 con 0x7f0e2814a170 2024-01-22T10:13:38.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.127+0000 7f0e2f8da640 1 -- 172.21.15.88:0/3768431846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e280a4fe0 con 0x7f0e2814a170 2024-01-22T10:13:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.128+0000 7f0e1dffb640 1 -- 172.21.15.88:0/3768431846 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f0e1804d450 con 0x7f0e2814a170 2024-01-22T10:13:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.128+0000 7f0e1dffb640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0e0c06b330 0x7f0e0c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.128+0000 7f0e1dffb640 1 -- 172.21.15.88:0/3768431846 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0e1802d040 con 0x7f0e2814a170 2024-01-22T10:13:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.128+0000 7f0e2d676640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0e0c06b330 0x7f0e0c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.129+0000 7f0e2d676640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0e0c06b330 0x7f0e0c06d7f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0e24007130 tx=0x7f0e240079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:38.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.132+0000 7f0e1dffb640 1 -- 172.21.15.88:0/3768431846 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0e18076fb0 con 0x7f0e2814a170 2024-01-22T10:13:38.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.365+0000 7f0e2f8da640 1 -- 172.21.15.88:0/3768431846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f0e280b9be0 con 0x7f0e2814a170 2024-01-22T10:13:38.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.366+0000 7f0e1dffb640 1 -- 172.21.15.88:0/3768431846 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0e1807a5d0 con 0x7f0e2814a170 2024-01-22T10:13:38.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.369+0000 7f0e2f8da640 1 -- 172.21.15.88:0/3768431846 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0e0c06b330 msgr2=0x7f0e0c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.369+0000 7f0e2f8da640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0e0c06b330 0x7f0e0c06d7f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0e24007130 tx=0x7f0e240079c0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.369+0000 7f0e2f8da640 1 -- 172.21.15.88:0/3768431846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2814a170 msgr2=0x7f0e281d2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.369+0000 7f0e2f8da640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2814a170 0x7f0e281d2bb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0e1802b950 tx=0x7f0e180046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.369+0000 7f0e2f8da640 1 -- 172.21.15.88:0/3768431846 shutdown_connections 2024-01-22T10:13:38.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.369+0000 7f0e2f8da640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0e0c06b330 0x7f0e0c06d7f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.369+0000 7f0e2f8da640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e281d1fa0 0x7f0e281420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.369+0000 7f0e2f8da640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2814a170 0x7f0e281d2bb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.369+0000 7f0e2f8da640 1 --2- 172.21.15.88:0/3768431846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e2806df70 0x7f0e281e1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.369+0000 7f0e2f8da640 1 -- 172.21.15.88:0/3768431846 >> 172.21.15.88:0/3768431846 conn(0x7f0e280bec50 msgr2=0x7f0e280b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:38.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.369+0000 7f0e2f8da640 1 -- 172.21.15.88:0/3768431846 shutdown_connections 2024-01-22T10:13:38.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.369+0000 7f0e2f8da640 1 -- 172.21.15.88:0/3768431846 wait complete. 2024-01-22T10:13:38.362 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-22T10:13:38.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.479+0000 7f43f566e640 1 Processor -- start 2024-01-22T10:13:38.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.479+0000 7f43f566e640 1 -- start start 2024-01-22T10:13:38.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.480+0000 7f43f566e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f43f006aea0 0x7f43f006bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.480+0000 7f43f566e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43f00bd520 0x7f43f014c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.480+0000 7f43f566e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f014b8e0 con 0x7f43f00bec90 2024-01-22T10:13:38.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.480+0000 7f43f566e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f006be20 con 0x7f43f006aea0 2024-01-22T10:13:38.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.480+0000 7f43f566e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f006c650 con 0x7f43f00bd520 2024-01-22T10:13:38.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.480+0000 7f43ef7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f43f00bec90 0x7f43f014ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33468/0 (socket says 172.21.15.88:33468) 2024-01-22T10:13:38.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.480+0000 7f43ef7fe640 1 -- 172.21.15.88:0/1746476401 learned_addr learned my addr 172.21.15.88:0/1746476401 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.480+0000 7f43eeffd640 1 --2- 172.21.15.88:0/1746476401 >> v2:172.21.15.119:3300/0 conn(0x7f43f006aea0 0x7f43f006bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.480+0000 7f43ee7fc640 1 --2- 172.21.15.88:0/1746476401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43f00bd520 0x7f43f014c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.480+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207554818 0 0) 0x7f43f014b8e0 con 0x7f43f00bec90 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d8003520 con 0x7f43f00bec90 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3810745514 0 0) 0x7f43d8003520 con 0x7f43f00bec90 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43f00bd520 msgr2=0x7f43f014c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 --2- 172.21.15.88:0/1746476401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43f00bd520 0x7f43f014c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 >> v2:172.21.15.119:3300/0 conn(0x7f43f006aea0 msgr2=0x7f43f006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 --2- 172.21.15.88:0/1746476401 >> v2:172.21.15.119:3300/0 conn(0x7f43f006aea0 0x7f43f006bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f00b45c0 con 0x7f43f00bec90 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f43e8001670 con 0x7f43f00bec90 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 >> v1:172.21.15.88:6789/0 conn(0x7f43f00bec90 legacy=0x7f43f014ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 --2- 172.21.15.88:0/1746476401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43d8003a50 0x7f43d8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 --2- 172.21.15.88:0/1746476401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43d80047c0 0x7f43d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 --2- 172.21.15.88:0/1746476401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d8005180 0x7f43d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f006c650 con 0x7f43d8005180 2024-01-22T10:13:38.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d800bf20 con 0x7f43d80047c0 2024-01-22T10:13:38.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d800c0e0 con 0x7f43d8003a50 2024-01-22T10:13:38.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43ef7fe640 1 --2- 172.21.15.88:0/1746476401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d8005180 0x7f43d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43eeffd640 1 --2- 172.21.15.88:0/1746476401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43d8003a50 0x7f43d8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43ee7fc640 1 --2- 172.21.15.88:0/1746476401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43d80047c0 0x7f43d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43ef7fe640 1 -- 172.21.15.88:0/1746476401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43d8003a50 msgr2=0x7f43d8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:38.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43ef7fe640 1 --2- 172.21.15.88:0/1746476401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43d8003a50 0x7f43d8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43ef7fe640 1 -- 172.21.15.88:0/1746476401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43d80047c0 msgr2=0x7f43d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:38.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43ef7fe640 1 --2- 172.21.15.88:0/1746476401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43d80047c0 0x7f43d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.481+0000 7f43ef7fe640 1 -- 172.21.15.88:0/1746476401 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d8003520 con 0x7f43d8005180 2024-01-22T10:13:38.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.482+0000 7f43ef7fe640 1 --2- 172.21.15.88:0/1746476401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d8005180 0x7f43d800b980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f43f00c0700 tx=0x7f43d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17452d0e200d8991 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:38.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.483+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8005ad0 con 0x7f43d8005180 2024-01-22T10:13:38.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.483+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e8005c30 con 0x7f43d8005180 2024-01-22T10:13:38.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.483+0000 7f43edffb640 1 -- 172.21.15.88:0/1746476401 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e802c790 con 0x7f43d8005180 2024-01-22T10:13:38.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.483+0000 7f43f566e640 1 -- 172.21.15.88:0/1746476401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d8005180 msgr2=0x7f43d800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.483+0000 7f43f566e640 1 --2- 172.21.15.88:0/1746476401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d8005180 0x7f43d800b980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f43f00c0700 tx=0x7f43d80057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.483+0000 7f43ef7fe640 1 -- 172.21.15.88:0/1746476401 reap_dead start 2024-01-22T10:13:38.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.483+0000 7f43f566e640 1 -- 172.21.15.88:0/1746476401 shutdown_connections 2024-01-22T10:13:38.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.483+0000 7f43f566e640 1 -- 172.21.15.88:0/1746476401 >> 172.21.15.88:0/1746476401 conn(0x7f43f00c0e90 msgr2=0x7f43f00c1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:38.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.483+0000 7f43f566e640 1 -- 172.21.15.88:0/1746476401 shutdown_connections 2024-01-22T10:13:38.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.483+0000 7f43f566e640 1 -- 172.21.15.88:0/1746476401 wait complete. 2024-01-22T10:13:38.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.485+0000 7f43f566e640 1 Processor -- start 2024-01-22T10:13:38.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.485+0000 7f43f566e640 1 -- start start 2024-01-22T10:13:38.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43f566e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43f009aa00 0x7f43f009ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43f566e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43f00b6db0 0x7f43f009ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43f566e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f009bf80 0x7f43f01479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43f566e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f009a0b0 con 0x7f43f009bf80 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43f566e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f01e12a0 con 0x7f43f009aa00 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43f566e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f009c400 con 0x7f43f00b6db0 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43ef7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f009bf80 0x7f43f01479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43ef7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f009bf80 0x7f43f01479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47634/0 (socket says 172.21.15.88:47634) 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43ef7fe640 1 -- 172.21.15.88:0/2421446373 learned_addr learned my addr 172.21.15.88:0/2421446373 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43eeffd640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43f009aa00 0x7f43f009ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43ee7fc640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43f00b6db0 0x7f43f009ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43ef7fe640 1 -- 172.21.15.88:0/2421446373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43f00b6db0 msgr2=0x7f43f009ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43ef7fe640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43f00b6db0 0x7f43f009ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43ef7fe640 1 -- 172.21.15.88:0/2421446373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43f009aa00 msgr2=0x7f43f009ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43ef7fe640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43f009aa00 0x7f43f009ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43ef7fe640 1 -- 172.21.15.88:0/2421446373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f01e1540 con 0x7f43f009bf80 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43ef7fe640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f009bf80 0x7f43f01479e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f43e802c400 tx=0x7f43f014ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43d77fe640 1 -- 172.21.15.88:0/2421446373 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8001ba0 con 0x7f43f009bf80 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43d77fe640 1 -- 172.21.15.88:0/2421446373 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e802c790 con 0x7f43f009bf80 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43d77fe640 1 -- 172.21.15.88:0/2421446373 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e802cb40 con 0x7f43f009bf80 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43f566e640 1 -- 172.21.15.88:0/2421446373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f009a300 con 0x7f43f009bf80 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.486+0000 7f43f566e640 1 -- 172.21.15.88:0/2421446373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f01e1c40 con 0x7f43f009bf80 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.487+0000 7f43f566e640 1 -- 172.21.15.88:0/2421446373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f004ea30 con 0x7f43f009bf80 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.488+0000 7f43d77fe640 1 -- 172.21.15.88:0/2421446373 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f43e8032070 con 0x7f43f009bf80 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.488+0000 7f43d77fe640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f43dc06b330 0x7f43dc06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.488+0000 7f43eeffd640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f43dc06b330 0x7f43dc06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.488+0000 7f43d77fe640 1 -- 172.21.15.88:0/2421446373 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f43e803c070 con 0x7f43f009bf80 2024-01-22T10:13:38.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.489+0000 7f43eeffd640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f43dc06b330 0x7f43dc06d7f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43e0014450 tx=0x7f43e000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:38.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.493+0000 7f43d77fe640 1 -- 172.21.15.88:0/2421446373 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f43e8075410 con 0x7f43f009bf80 2024-01-22T10:13:38.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.725+0000 7f43f566e640 1 -- 172.21.15.88:0/2421446373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f43f01e1c40 con 0x7f43f009bf80 2024-01-22T10:13:38.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.726+0000 7f43d77fe640 1 -- 172.21.15.88:0/2421446373 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f43f01e1c40 con 0x7f43f009bf80 2024-01-22T10:13:38.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.728+0000 7f43f566e640 1 -- 172.21.15.88:0/2421446373 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f43dc06b330 msgr2=0x7f43dc06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.728+0000 7f43f566e640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f43dc06b330 0x7f43dc06d7f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43e0014450 tx=0x7f43e000b040 comp rx=0 tx=0).stop 2024-01-22T10:13:38.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.728+0000 7f43f566e640 1 -- 172.21.15.88:0/2421446373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f009bf80 msgr2=0x7f43f01479e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.728+0000 7f43f566e640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f009bf80 0x7f43f01479e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f43e802c400 tx=0x7f43f014ba90 comp rx=0 tx=0).stop 2024-01-22T10:13:38.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.728+0000 7f43f566e640 1 -- 172.21.15.88:0/2421446373 shutdown_connections 2024-01-22T10:13:38.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.728+0000 7f43f566e640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f43dc06b330 0x7f43dc06d7f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.728+0000 7f43f566e640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43f00b6db0 0x7f43f009ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.728+0000 7f43f566e640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f009bf80 0x7f43f01479e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.728+0000 7f43f566e640 1 --2- 172.21.15.88:0/2421446373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43f009aa00 0x7f43f009ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.728+0000 7f43f566e640 1 -- 172.21.15.88:0/2421446373 >> 172.21.15.88:0/2421446373 conn(0x7f43f00c0e90 msgr2=0x7f43f00a1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:38.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.728+0000 7f43f566e640 1 -- 172.21.15.88:0/2421446373 shutdown_connections 2024-01-22T10:13:38.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.728+0000 7f43f566e640 1 -- 172.21.15.88:0/2421446373 wait complete. 2024-01-22T10:13:38.721 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-22T10:13:38.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.839+0000 7f66f87ce640 1 Processor -- start 2024-01-22T10:13:38.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.839+0000 7f66f87ce640 1 -- start start 2024-01-22T10:13:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.840+0000 7f66f87ce640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f66f00b2660 0x7f66f0148930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.840+0000 7f66f87ce640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f006d870 con 0x7f66f006d390 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.840+0000 7f66f87ce640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f006f860 con 0x7f66f014f070 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.840+0000 7f66f87ce640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f006c1b0 con 0x7f66f00b2660 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.840+0000 7f66f6d6b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f66f006d390 0x7f66f0156130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33470/0 (socket says 172.21.15.88:33470) 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.840+0000 7f66f6d6b640 1 -- 172.21.15.88:0/28503855 learned_addr learned my addr 172.21.15.88:0/28503855 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344316258 0 0) 0x7f66e8001490 con 0x7f66f006d390 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66dc003520 con 0x7f66f006d390 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5d69640 1 --2- 172.21.15.88:0/28503855 >> v2:172.21.15.119:3300/0 conn(0x7f66f00b2660 0x7f66f0148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2438511090 0 0) 0x7f66dc003520 con 0x7f66f006d390 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 >> v2:172.21.15.119:3300/0 conn(0x7f66f00b2660 msgr2=0x7f66f0148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 --2- 172.21.15.88:0/28503855 >> v2:172.21.15.119:3300/0 conn(0x7f66f00b2660 0x7f66f0148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 >> v1:172.21.15.119:6789/0 conn(0x7f66f014f070 legacy=0x7f66f014f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f006bcd0 con 0x7f66f006d390 2024-01-22T10:13:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f66e8001b80 con 0x7f66f006d390 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 >> v1:172.21.15.88:6789/0 conn(0x7f66f006d390 legacy=0x7f66f0156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 --2- 172.21.15.88:0/28503855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66dc003a50 0x7f66dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 --2- 172.21.15.88:0/28503855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc0047c0 0x7f66dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 --2- 172.21.15.88:0/28503855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66dc0051d0 0x7f66dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f006c1b0 con 0x7f66dc0051d0 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc00c100 con 0x7f66dc0047c0 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc00c2c0 con 0x7f66dc003a50 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f6d6b640 1 --2- 172.21.15.88:0/28503855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66dc0051d0 0x7f66dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f5d69640 1 --2- 172.21.15.88:0/28503855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc0047c0 0x7f66dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f656a640 1 --2- 172.21.15.88:0/28503855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66dc003a50 0x7f66dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f6d6b640 1 -- 172.21.15.88:0/28503855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66dc003a50 msgr2=0x7f66dc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f6d6b640 1 --2- 172.21.15.88:0/28503855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66dc003a50 0x7f66dc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f6d6b640 1 -- 172.21.15.88:0/28503855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc0047c0 msgr2=0x7f66dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f6d6b640 1 --2- 172.21.15.88:0/28503855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc0047c0 0x7f66dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f6d6b640 1 -- 172.21.15.88:0/28503855 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc003520 con 0x7f66dc0051d0 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.841+0000 7f66f656a640 1 --2- 172.21.15.88:0/28503855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66dc003a50 0x7f66dc003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.842+0000 7f66f6d6b640 1 -- 172.21.15.88:0/28503855 reap_dead start 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.842+0000 7f66f6d6b640 1 --2- 172.21.15.88:0/28503855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66dc0051d0 0x7f66dc00b980 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f66f006d7a0 tx=0x7f66dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fef7215e2c5d15 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.842+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8034630 con 0x7f66dc0051d0 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.842+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e802f070 con 0x7f66dc0051d0 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.842+0000 7f66f5568640 1 -- 172.21.15.88:0/28503855 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80349f0 con 0x7f66dc0051d0 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.843+0000 7f66f87ce640 1 -- 172.21.15.88:0/28503855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66dc0051d0 msgr2=0x7f66dc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.843+0000 7f66f87ce640 1 --2- 172.21.15.88:0/28503855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66dc0051d0 0x7f66dc00b980 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f66f006d7a0 tx=0x7f66dc0057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.843+0000 7f66f87ce640 1 -- 172.21.15.88:0/28503855 shutdown_connections 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.843+0000 7f66f87ce640 1 --2- 172.21.15.88:0/28503855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66dc0051d0 0x7f66dc00b980 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.843+0000 7f66f87ce640 1 -- 172.21.15.88:0/28503855 >> 172.21.15.88:0/28503855 conn(0x7f66f00bb780 msgr2=0x7f66f00bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.843+0000 7f66f87ce640 1 -- 172.21.15.88:0/28503855 shutdown_connections 2024-01-22T10:13:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.843+0000 7f66f87ce640 1 -- 172.21.15.88:0/28503855 wait complete. 2024-01-22T10:13:38.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.844+0000 7f66f87ce640 1 Processor -- start 2024-01-22T10:13:38.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.844+0000 7f66f87ce640 1 -- start start 2024-01-22T10:13:38.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.844+0000 7f66f87ce640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66dc0051d0 0x7f66f014e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.844+0000 7f66f87ce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66f01459c0 0x7f66f01e1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.844+0000 7f66f87ce640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f01e16b0 0x7f66f00b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.844+0000 7f66f87ce640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f014e650 con 0x7f66f01e16b0 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.844+0000 7f66f87ce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f0145ea0 con 0x7f66f01459c0 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.844+0000 7f66f87ce640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f0143960 con 0x7f66dc0051d0 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.844+0000 7f66f6d6b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f01e16b0 0x7f66f00b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.844+0000 7f66f6d6b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f01e16b0 0x7f66f00b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47650/0 (socket says 172.21.15.88:47650) 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66f6d6b640 1 -- 172.21.15.88:0/1064522281 learned_addr learned my addr 172.21.15.88:0/1064522281 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66f656a640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66dc0051d0 0x7f66f014e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66f5d69640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66f01459c0 0x7f66f01e1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66f6d6b640 1 -- 172.21.15.88:0/1064522281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66dc0051d0 msgr2=0x7f66f014e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66f6d6b640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66dc0051d0 0x7f66f014e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66f6d6b640 1 -- 172.21.15.88:0/1064522281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66f01459c0 msgr2=0x7f66f01e1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66f6d6b640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66f01459c0 0x7f66f01e1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66f6d6b640 1 -- 172.21.15.88:0/1064522281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f00b8cb0 con 0x7f66f01e16b0 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66f6d6b640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f01e16b0 0x7f66f00b0450 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f66e8000f80 tx=0x7f66f006be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66e2ffd640 1 -- 172.21.15.88:0/1064522281 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8001b50 con 0x7f66f01e16b0 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66e2ffd640 1 -- 172.21.15.88:0/1064522281 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8034430 con 0x7f66f01e16b0 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66f87ce640 1 -- 172.21.15.88:0/1064522281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f0143310 con 0x7f66f01e16b0 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66e2ffd640 1 -- 172.21.15.88:0/1064522281 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80347c0 con 0x7f66f01e16b0 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.845+0000 7f66f87ce640 1 -- 172.21.15.88:0/1064522281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f0143df0 con 0x7f66f01e16b0 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.846+0000 7f66f87ce640 1 -- 172.21.15.88:0/1064522281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f00b9c90 con 0x7f66f01e16b0 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.846+0000 7f66e2ffd640 1 -- 172.21.15.88:0/1064522281 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f66e8031030 con 0x7f66f01e16b0 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.847+0000 7f66e2ffd640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f66d406b360 0x7f66d406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.847+0000 7f66e2ffd640 1 -- 172.21.15.88:0/1064522281 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f66e80ab200 con 0x7f66f01e16b0 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.847+0000 7f66f656a640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f66d406b360 0x7f66d406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.847+0000 7f66f656a640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f66d406b360 0x7f66d406d820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f66ec000c00 tx=0x7f66ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:38.851+0000 7f66e2ffd640 1 -- 172.21.15.88:0/1064522281 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f66e8076270 con 0x7f66f01e16b0 2024-01-22T10:13:39.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.085+0000 7f66f87ce640 1 -- 172.21.15.88:0/1064522281 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f66f00b9c90 con 0x7f66f01e16b0 2024-01-22T10:13:39.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.087+0000 7f66e2ffd640 1 -- 172.21.15.88:0/1064522281 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f66e8079890 con 0x7f66f01e16b0 2024-01-22T10:13:39.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.089+0000 7f66f87ce640 1 -- 172.21.15.88:0/1064522281 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f66d406b360 msgr2=0x7f66d406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.089+0000 7f66f87ce640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f66d406b360 0x7f66d406d820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f66ec000c00 tx=0x7f66ec009040 comp rx=0 tx=0).stop 2024-01-22T10:13:39.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.089+0000 7f66f87ce640 1 -- 172.21.15.88:0/1064522281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f01e16b0 msgr2=0x7f66f00b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.089+0000 7f66f87ce640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f01e16b0 0x7f66f00b0450 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f66e8000f80 tx=0x7f66f006be60 comp rx=0 tx=0).stop 2024-01-22T10:13:39.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.089+0000 7f66f87ce640 1 -- 172.21.15.88:0/1064522281 shutdown_connections 2024-01-22T10:13:39.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.089+0000 7f66f87ce640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f66d406b360 0x7f66d406d820 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.089+0000 7f66f87ce640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f01e16b0 0x7f66f00b0450 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.089+0000 7f66f87ce640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66f01459c0 0x7f66f01e1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.089+0000 7f66f87ce640 1 --2- 172.21.15.88:0/1064522281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66dc0051d0 0x7f66f014e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.089+0000 7f66f87ce640 1 -- 172.21.15.88:0/1064522281 >> 172.21.15.88:0/1064522281 conn(0x7f66f00bb780 msgr2=0x7f66f00b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:39.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.089+0000 7f66f87ce640 1 -- 172.21.15.88:0/1064522281 shutdown_connections 2024-01-22T10:13:39.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.089+0000 7f66f87ce640 1 -- 172.21.15.88:0/1064522281 wait complete. 2024-01-22T10:13:39.082 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:39.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.199+0000 7fd311590640 1 Processor -- start 2024-01-22T10:13:39.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.199+0000 7fd311590640 1 -- start start 2024-01-22T10:13:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd311590640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd30c0bbb00 0x7fd30c14ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd311590640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0bdde0 0x7fd30c156010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd311590640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30c0bd1c0 con 0x7fd30c0b45a0 2024-01-22T10:13:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd311590640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30c0bc560 con 0x7fd30c0bbb00 2024-01-22T10:13:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd311590640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0c0820 con 0x7fd30c0bdde0 2024-01-22T10:13:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd30a7fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd30c0b45a0 0x7fd30c14b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33472/0 (socket says 172.21.15.88:33472) 2024-01-22T10:13:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd30a7fc640 1 -- 172.21.15.88:0/1173550855 learned_addr learned my addr 172.21.15.88:0/1173550855 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310587582 0 0) 0x7fd30c0bd1c0 con 0x7fd30c0b45a0 2024-01-22T10:13:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd30b7fe640 1 --2- 172.21.15.88:0/1173550855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0bdde0 0x7fd30c156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2f4003520 con 0x7fd30c0b45a0 2024-01-22T10:13:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd30affd640 1 --2- 172.21.15.88:0/1173550855 >> v2:172.21.15.119:3300/0 conn(0x7fd30c0bbb00 0x7fd30c14ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1655046944 0 0) 0x7fd2f4003520 con 0x7fd30c0b45a0 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0bdde0 msgr2=0x7fd30c156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 --2- 172.21.15.88:0/1173550855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0bdde0 0x7fd30c156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 >> v2:172.21.15.119:3300/0 conn(0x7fd30c0bbb00 msgr2=0x7fd30c14ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 --2- 172.21.15.88:0/1173550855 >> v2:172.21.15.119:3300/0 conn(0x7fd30c0bbb00 0x7fd30c14ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c0c0b00 con 0x7fd30c0b45a0 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fd300001670 con 0x7fd30c0b45a0 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 >> v1:172.21.15.88:6789/0 conn(0x7fd30c0b45a0 legacy=0x7fd30c14b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 --2- 172.21.15.88:0/1173550855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2f4003a50 0x7fd2f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 --2- 172.21.15.88:0/1173550855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0bdde0 0x7fd2f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 --2- 172.21.15.88:0/1173550855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2f4004d00 0x7fd2f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0c0820 con 0x7fd2f4004d00 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f400b980 con 0x7fd2f4003a50 2024-01-22T10:13:39.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.200+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f400baf0 con 0x7fd30c0bdde0 2024-01-22T10:13:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.201+0000 7fd30b7fe640 1 --2- 172.21.15.88:0/1173550855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2f4004d00 0x7fd2f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.201+0000 7fd30affd640 1 --2- 172.21.15.88:0/1173550855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2f4003a50 0x7fd2f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.201+0000 7fd30a7fc640 1 --2- 172.21.15.88:0/1173550855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0bdde0 0x7fd2f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.201+0000 7fd30b7fe640 1 -- 172.21.15.88:0/1173550855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0bdde0 msgr2=0x7fd2f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.201+0000 7fd30b7fe640 1 --2- 172.21.15.88:0/1173550855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0bdde0 0x7fd2f40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.201+0000 7fd30b7fe640 1 -- 172.21.15.88:0/1173550855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2f4003a50 msgr2=0x7fd2f4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.201+0000 7fd30b7fe640 1 --2- 172.21.15.88:0/1173550855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2f4003a50 0x7fd2f4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.201+0000 7fd30b7fe640 1 -- 172.21.15.88:0/1173550855 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4003520 con 0x7fd2f4004d00 2024-01-22T10:13:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.201+0000 7fd30b7fe640 1 --2- 172.21.15.88:0/1173550855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2f4004d00 0x7fd2f4005180 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd304009fc0 tx=0x7fd2f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8153382977cd870c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.202+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30402cc20 con 0x7fd2f4004d00 2024-01-22T10:13:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.202+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30400f040 con 0x7fd2f4004d00 2024-01-22T10:13:39.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.202+0000 7fd309ffb640 1 -- 172.21.15.88:0/1173550855 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd304034440 con 0x7fd2f4004d00 2024-01-22T10:13:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.202+0000 7fd311590640 1 -- 172.21.15.88:0/1173550855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2f4004d00 msgr2=0x7fd2f4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.202+0000 7fd311590640 1 --2- 172.21.15.88:0/1173550855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2f4004d00 0x7fd2f4005180 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd304009fc0 tx=0x7fd2f40057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.202+0000 7fd30b7fe640 1 -- 172.21.15.88:0/1173550855 reap_dead start 2024-01-22T10:13:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.202+0000 7fd311590640 1 -- 172.21.15.88:0/1173550855 shutdown_connections 2024-01-22T10:13:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.202+0000 7fd311590640 1 -- 172.21.15.88:0/1173550855 >> 172.21.15.88:0/1173550855 conn(0x7fd30c0a2c20 msgr2=0x7fd30c0a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.202+0000 7fd311590640 1 -- 172.21.15.88:0/1173550855 shutdown_connections 2024-01-22T10:13:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.202+0000 7fd311590640 1 -- 172.21.15.88:0/1173550855 wait complete. 2024-01-22T10:13:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.203+0000 7fd311590640 1 Processor -- start 2024-01-22T10:13:39.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.203+0000 7fd311590640 1 -- start start 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd311590640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0b77d0 0x7fd30c0b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd311590640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30c0b6ae0 0x7fd30c1e4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd311590640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd30c1e4d40 0x7fd30c0b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd311590640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0bab70 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd311590640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c1e51a0 con 0x7fd30c1e4d40 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd311590640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0b3ff0 con 0x7fd30c0b77d0 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd30a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30c0b6ae0 0x7fd30c1e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd30a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30c0b6ae0 0x7fd30c1e4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47662/0 (socket says 172.21.15.88:47662) 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd30a7fc640 1 -- 172.21.15.88:0/175368958 learned_addr learned my addr 172.21.15.88:0/175368958 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd30affd640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0b77d0 0x7fd30c0b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd30b7fe640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd30c1e4d40 0x7fd30c0b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd30a7fc640 1 -- 172.21.15.88:0/175368958 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0b77d0 msgr2=0x7fd30c0b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd30a7fc640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0b77d0 0x7fd30c0b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd30a7fc640 1 -- 172.21.15.88:0/175368958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd30c1e4d40 msgr2=0x7fd30c0b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd30a7fc640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd30c1e4d40 0x7fd30c0b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd30a7fc640 1 -- 172.21.15.88:0/175368958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c0badb0 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd30b7fe640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd30c1e4d40 0x7fd30c0b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.204+0000 7fd30a7fc640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30c0b6ae0 0x7fd30c1e4800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd3000072c0 tx=0x7fd300007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.205+0000 7fd2f37fe640 1 -- 172.21.15.88:0/175368958 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000f9c0 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.205+0000 7fd2f37fe640 1 -- 172.21.15.88:0/175368958 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30000fb20 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.205+0000 7fd311590640 1 -- 172.21.15.88:0/175368958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30c0bb090 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.205+0000 7fd2f37fe640 1 -- 172.21.15.88:0/175368958 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000fed0 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.205+0000 7fd311590640 1 -- 172.21.15.88:0/175368958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30c0b4bd0 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.206+0000 7fd311590640 1 -- 172.21.15.88:0/175368958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30c04ea30 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.206+0000 7fd2f37fe640 1 -- 172.21.15.88:0/175368958 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fd30001d460 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.206+0000 7fd2f37fe640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd2f806b330 0x7fd2f806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.207+0000 7fd30affd640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd2f806b330 0x7fd2f806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.207+0000 7fd2f37fe640 1 -- 172.21.15.88:0/175368958 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd300089aa0 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.207+0000 7fd30affd640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd2f806b330 0x7fd2f806d7f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009b00 tx=0x7fd2fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:39.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.211+0000 7fd2f37fe640 1 -- 172.21.15.88:0/175368958 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd300054b10 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.378+0000 7fd311590640 1 -- 172.21.15.88:0/175368958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd30c148540 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.379+0000 7fd2f37fe640 1 -- 172.21.15.88:0/175368958 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+12834 (secure 0 0 0) 0x7fd300058130 con 0x7fd30c0b6ae0 2024-01-22T10:13:39.361 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:39.361 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:36.570805+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:39.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.381+0000 7fd311590640 1 -- 172.21.15.88:0/175368958 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd2f806b330 msgr2=0x7fd2f806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.381+0000 7fd311590640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd2f806b330 0x7fd2f806d7f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009b00 tx=0x7fd2fc008040 comp rx=0 tx=0).stop 2024-01-22T10:13:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.381+0000 7fd311590640 1 -- 172.21.15.88:0/175368958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30c0b6ae0 msgr2=0x7fd30c1e4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.381+0000 7fd311590640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30c0b6ae0 0x7fd30c1e4800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd3000072c0 tx=0x7fd300007780 comp rx=0 tx=0).stop 2024-01-22T10:13:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.381+0000 7fd311590640 1 -- 172.21.15.88:0/175368958 shutdown_connections 2024-01-22T10:13:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.381+0000 7fd311590640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd2f806b330 0x7fd2f806d7f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.381+0000 7fd311590640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd30c1e4d40 0x7fd30c0b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.381+0000 7fd311590640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd30c0b6ae0 0x7fd30c1e4800 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.381+0000 7fd311590640 1 --2- 172.21.15.88:0/175368958 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd30c0b77d0 0x7fd30c0b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.381+0000 7fd311590640 1 -- 172.21.15.88:0/175368958 >> 172.21.15.88:0/175368958 conn(0x7fd30c0a2c20 msgr2=0x7fd30c0a1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.381+0000 7fd311590640 1 -- 172.21.15.88:0/175368958 shutdown_connections 2024-01-22T10:13:39.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.381+0000 7fd311590640 1 -- 172.21.15.88:0/175368958 wait complete. 2024-01-22T10:13:39.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:13:39.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:13:39.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.494+0000 7f669b807640 1 Processor -- start 2024-01-22T10:13:39.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.494+0000 7f669b807640 1 -- start start 2024-01-22T10:13:39.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f669b807640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f66940bab40 0x7f6694070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f669b807640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f669414c690 0x7f6694152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f669b807640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66940ba410 con 0x7f6694070dd0 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f669b807640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669414ba80 con 0x7f66940bab40 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f669b807640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6694071950 con 0x7f669414c690 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f66995a3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f66940bab40 0x7f6694070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f6698da2640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6694070dd0 0x7f669414bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33488/0 (socket says 172.21.15.88:33488) 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f66995a3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f66940bab40 0x7f6694070830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47668/0 (socket says 172.21.15.88:47668) 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f6698da2640 1 -- 172.21.15.88:0/1991575873 learned_addr learned my addr 172.21.15.88:0/1991575873 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f6699da4640 1 --2- 172.21.15.88:0/1991575873 >> v2:172.21.15.119:3300/0 conn(0x7f669414c690 0x7f6694152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f66995a3640 1 -- 172.21.15.88:0/1991575873 >> v2:172.21.15.119:3300/0 conn(0x7f669414c690 msgr2=0x7f6694152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f66995a3640 1 --2- 172.21.15.88:0/1991575873 >> v2:172.21.15.119:3300/0 conn(0x7f669414c690 0x7f6694152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f66995a3640 1 -- 172.21.15.88:0/1991575873 >> v1:172.21.15.88:6789/0 conn(0x7f6694070dd0 legacy=0x7f669414bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f668bfff640 1 -- 172.21.15.88:0/1991575873 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793286150 0 0) 0x7f66940ba410 con 0x7f6694070dd0 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.495+0000 7f66995a3640 1 -- 172.21.15.88:0/1991575873 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694071c30 con 0x7f66940bab40 2024-01-22T10:13:39.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.496+0000 7f66995a3640 1 --2- 172.21.15.88:0/1991575873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66940bab40 0x7f6694070830 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f66941494e0 tx=0x7f669002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f04c6a9c90bc2cb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:39.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.496+0000 7f668bfff640 1 -- 172.21.15.88:0/1991575873 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690030610 con 0x7f66940bab40 2024-01-22T10:13:39.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.496+0000 7f668bfff640 1 -- 172.21.15.88:0/1991575873 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690030770 con 0x7f66940bab40 2024-01-22T10:13:39.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.496+0000 7f668bfff640 1 -- 172.21.15.88:0/1991575873 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690030b00 con 0x7f66940bab40 2024-01-22T10:13:39.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.497+0000 7f669b807640 1 -- 172.21.15.88:0/1991575873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66940bab40 msgr2=0x7f6694070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.497+0000 7f669b807640 1 --2- 172.21.15.88:0/1991575873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66940bab40 0x7f6694070830 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f66941494e0 tx=0x7f669002b960 comp rx=0 tx=0).stop 2024-01-22T10:13:39.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.497+0000 7f669b807640 1 -- 172.21.15.88:0/1991575873 shutdown_connections 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.497+0000 7f669b807640 1 --2- 172.21.15.88:0/1991575873 >> v2:172.21.15.119:3300/0 conn(0x7f669414c690 0x7f6694152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.497+0000 7f669b807640 1 --2- 172.21.15.88:0/1991575873 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66940bab40 0x7f6694070830 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.497+0000 7f669b807640 1 -- 172.21.15.88:0/1991575873 >> 172.21.15.88:0/1991575873 conn(0x7f669406bc20 msgr2=0x7f669406c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.497+0000 7f669b807640 1 -- 172.21.15.88:0/1991575873 shutdown_connections 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.497+0000 7f669b807640 1 -- 172.21.15.88:0/1991575873 wait complete. 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.498+0000 7f669b807640 1 Processor -- start 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.498+0000 7f669b807640 1 -- start start 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.498+0000 7f669b807640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6694070dd0 0x7f66941d5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.498+0000 7f669b807640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66940bab40 0x7f6694149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.498+0000 7f669b807640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f669414c690 0x7f669413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.498+0000 7f669b807640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66941d6460 con 0x7f66940bab40 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.498+0000 7f669b807640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669414af50 con 0x7f669414c690 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.498+0000 7f669b807640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669414b1f0 con 0x7f6694070dd0 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.498+0000 7f6698da2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66940bab40 0x7f6694149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f6698da2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66940bab40 0x7f6694149650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47682/0 (socket says 172.21.15.88:47682) 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f6698da2640 1 -- 172.21.15.88:0/698034121 learned_addr learned my addr 172.21.15.88:0/698034121 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f66995a3640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6694070dd0 0x7f66941d5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f6698da2640 1 -- 172.21.15.88:0/698034121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6694070dd0 msgr2=0x7f66941d5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f6699da4640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f669414c690 0x7f669413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f6698da2640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6694070dd0 0x7f66941d5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f6698da2640 1 -- 172.21.15.88:0/698034121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f669414c690 msgr2=0x7f669413bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f6698da2640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f669414c690 0x7f669413bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f6698da2640 1 -- 172.21.15.88:0/698034121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6690009400 con 0x7f66940bab40 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f66995a3640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6694070dd0 0x7f66941d5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f6698da2640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66940bab40 0x7f6694149650 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f668400c4d0 tx=0x7f668400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f6689ffb640 1 -- 172.21.15.88:0/698034121 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66840074e0 con 0x7f66940bab40 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f6689ffb640 1 -- 172.21.15.88:0/698034121 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6684007660 con 0x7f66940bab40 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f669b807640 1 -- 172.21.15.88:0/698034121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6694148970 con 0x7f66940bab40 2024-01-22T10:13:39.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f6689ffb640 1 -- 172.21.15.88:0/698034121 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684004a20 con 0x7f66940bab40 2024-01-22T10:13:39.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.499+0000 7f669b807640 1 -- 172.21.15.88:0/698034121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6694147650 con 0x7f66940bab40 2024-01-22T10:13:39.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.500+0000 7f669b807640 1 -- 172.21.15.88:0/698034121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669404ea30 con 0x7f66940bab40 2024-01-22T10:13:39.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.500+0000 7f6689ffb640 1 -- 172.21.15.88:0/698034121 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f6684004b80 con 0x7f66940bab40 2024-01-22T10:13:39.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.501+0000 7f6689ffb640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f667806b330 0x7f667806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.501+0000 7f6689ffb640 1 -- 172.21.15.88:0/698034121 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6684088e00 con 0x7f66940bab40 2024-01-22T10:13:39.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.501+0000 7f66995a3640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f667806b330 0x7f667806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.501+0000 7f66995a3640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f667806b330 0x7f667806d7f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6690036000 tx=0x7f669003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:39.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.505+0000 7f6689ffb640 1 -- 172.21.15.88:0/698034121 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6684053de0 con 0x7f66940bab40 2024-01-22T10:13:39.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.673+0000 7f669b807640 1 -- 172.21.15.88:0/698034121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f669414b330 con 0x7f66940bab40 2024-01-22T10:13:39.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.673+0000 7f6689ffb640 1 -- 172.21.15.88:0/698034121 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6684018020 con 0x7f66940bab40 2024-01-22T10:13:39.656 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:13:39.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.675+0000 7f669b807640 1 -- 172.21.15.88:0/698034121 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f667806b330 msgr2=0x7f667806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.675+0000 7f669b807640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f667806b330 0x7f667806d7f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6690036000 tx=0x7f669003b040 comp rx=0 tx=0).stop 2024-01-22T10:13:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.675+0000 7f669b807640 1 -- 172.21.15.88:0/698034121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66940bab40 msgr2=0x7f6694149650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.675+0000 7f669b807640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66940bab40 0x7f6694149650 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f668400c4d0 tx=0x7f668400c990 comp rx=0 tx=0).stop 2024-01-22T10:13:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.676+0000 7f669b807640 1 -- 172.21.15.88:0/698034121 shutdown_connections 2024-01-22T10:13:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.676+0000 7f669b807640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f667806b330 0x7f667806d7f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.676+0000 7f669b807640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f669414c690 0x7f669413bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.676+0000 7f669b807640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66940bab40 0x7f6694149650 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.676+0000 7f669b807640 1 --2- 172.21.15.88:0/698034121 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6694070dd0 0x7f66941d5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.676+0000 7f669b807640 1 -- 172.21.15.88:0/698034121 >> 172.21.15.88:0/698034121 conn(0x7f669406bc20 msgr2=0x7f669413f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.676+0000 7f669b807640 1 -- 172.21.15.88:0/698034121 shutdown_connections 2024-01-22T10:13:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.676+0000 7f669b807640 1 -- 172.21.15.88:0/698034121 wait complete. 2024-01-22T10:13:39.669 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-22T10:13:39.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.785+0000 7f4f9b815640 1 Processor -- start 2024-01-22T10:13:39.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.786+0000 7f4f9b815640 1 -- start start 2024-01-22T10:13:39.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.786+0000 7f4f9b815640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4f940b5830 0x7f4f940b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.786+0000 7f4f9b815640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940b8850 con 0x7f4f940bb8b0 2024-01-22T10:13:39.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.786+0000 7f4f9b815640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940b9060 con 0x7f4f94149760 2024-01-22T10:13:39.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.786+0000 7f4f9b815640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f940bab60 con 0x7f4f940b5830 2024-01-22T10:13:39.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.786+0000 7f4f995b1640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4f940bb8b0 0x7f4f94143240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33502/0 (socket says 172.21.15.88:33502) 2024-01-22T10:13:39.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.786+0000 7f4f995b1640 1 -- 172.21.15.88:0/1860277893 learned_addr learned my addr 172.21.15.88:0/1860277893 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:39.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543673121 0 0) 0x7f4f940b8850 con 0x7f4f940bb8b0 2024-01-22T10:13:39.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f80003520 con 0x7f4f940bb8b0 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f98db0640 1 --2- 172.21.15.88:0/1860277893 >> v2:172.21.15.119:3300/0 conn(0x7f4f940b5830 0x7f4f940b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 387421904 0 0) 0x7f4f80003520 con 0x7f4f940bb8b0 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 >> v2:172.21.15.119:3300/0 conn(0x7f4f940b5830 msgr2=0x7f4f940b95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 --2- 172.21.15.88:0/1860277893 >> v2:172.21.15.119:3300/0 conn(0x7f4f940b5830 0x7f4f940b95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 >> v1:172.21.15.119:6789/0 conn(0x7f4f94149760 legacy=0x7f4f94149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f940b8aa0 con 0x7f4f940bb8b0 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f4f90001670 con 0x7f4f940bb8b0 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f98db0640 1 --2- 172.21.15.88:0/1860277893 >> v2:172.21.15.119:3300/0 conn(0x7f4f940b5830 0x7f4f940b95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 >> v1:172.21.15.88:6789/0 conn(0x7f4f940bb8b0 legacy=0x7f4f94143240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 --2- 172.21.15.88:0/1860277893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f80003a50 0x7f4f80003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 --2- 172.21.15.88:0/1860277893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f800047c0 0x7f4f80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 --2- 172.21.15.88:0/1860277893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f800052a0 0x7f4f8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940bab60 con 0x7f4f80003a50 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8000c190 con 0x7f4f800047c0 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8000c350 con 0x7f4f800052a0 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f995b1640 1 --2- 172.21.15.88:0/1860277893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f80003a50 0x7f4f80003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f98db0640 1 --2- 172.21.15.88:0/1860277893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f800047c0 0x7f4f80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f99db2640 1 --2- 172.21.15.88:0/1860277893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f800052a0 0x7f4f8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f995b1640 1 -- 172.21.15.88:0/1860277893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f800052a0 msgr2=0x7f4f8000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f995b1640 1 --2- 172.21.15.88:0/1860277893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f800052a0 0x7f4f8000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f995b1640 1 -- 172.21.15.88:0/1860277893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f800047c0 msgr2=0x7f4f80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f995b1640 1 --2- 172.21.15.88:0/1860277893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f800047c0 0x7f4f80004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f995b1640 1 -- 172.21.15.88:0/1860277893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80003520 con 0x7f4f80003a50 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.787+0000 7f4f99db2640 1 -- 172.21.15.88:0/1860277893 reap_dead start 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.788+0000 7f4f995b1640 1 --2- 172.21.15.88:0/1860277893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f80003a50 0x7f4f80003e70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c190 tx=0x7f4f800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07f744fbd5f0fb6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.788+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90005ad0 con 0x7f4f80003a50 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.788+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f90005c30 con 0x7f4f80003a50 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.788+0000 7f4f87fff640 1 -- 172.21.15.88:0/1860277893 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9002cae0 con 0x7f4f80003a50 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.789+0000 7f4f9b815640 1 -- 172.21.15.88:0/1860277893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f80003a50 msgr2=0x7f4f80003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.789+0000 7f4f9b815640 1 --2- 172.21.15.88:0/1860277893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f80003a50 0x7f4f80003e70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c190 tx=0x7f4f800057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.789+0000 7f4f9b815640 1 -- 172.21.15.88:0/1860277893 shutdown_connections 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.789+0000 7f4f9b815640 1 --2- 172.21.15.88:0/1860277893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f80003a50 0x7f4f80003e70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.789+0000 7f4f9b815640 1 -- 172.21.15.88:0/1860277893 >> 172.21.15.88:0/1860277893 conn(0x7f4f94066380 msgr2=0x7f4f94066760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.789+0000 7f4f9b815640 1 -- 172.21.15.88:0/1860277893 shutdown_connections 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.789+0000 7f4f9b815640 1 -- 172.21.15.88:0/1860277893 wait complete. 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.790+0000 7f4f9b815640 1 Processor -- start 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.790+0000 7f4f9b815640 1 -- start start 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.790+0000 7f4f9b815640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f80003a50 0x7f4f9414cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.790+0000 7f4f9b815640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f941d3d90 0x7f4f94144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.790+0000 7f4f9b815640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f9414c200 0x7f4f9413f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.790+0000 7f4f9b815640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9414d2d0 con 0x7f4f9414c200 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.790+0000 7f4f9b815640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94144a70 con 0x7f4f941d3d90 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.790+0000 7f4f9b815640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f941491c0 con 0x7f4f80003a50 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.790+0000 7f4f99db2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f9414c200 0x7f4f9413f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.790+0000 7f4f99db2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f9414c200 0x7f4f9413f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47696/0 (socket says 172.21.15.88:47696) 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.790+0000 7f4f99db2640 1 -- 172.21.15.88:0/3056567796 learned_addr learned my addr 172.21.15.88:0/3056567796 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f98db0640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f941d3d90 0x7f4f94144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f995b1640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f80003a50 0x7f4f9414cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f99db2640 1 -- 172.21.15.88:0/3056567796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f80003a50 msgr2=0x7f4f9414cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f99db2640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f80003a50 0x7f4f9414cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f99db2640 1 -- 172.21.15.88:0/3056567796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f941d3d90 msgr2=0x7f4f94144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f99db2640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f941d3d90 0x7f4f94144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f99db2640 1 -- 172.21.15.88:0/3056567796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9414b720 con 0x7f4f9414c200 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f99db2640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f9414c200 0x7f4f9413f290 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c007fd0 tx=0x7f4f8c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f85ffb640 1 -- 172.21.15.88:0/3056567796 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c003970 con 0x7f4f9414c200 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f85ffb640 1 -- 172.21.15.88:0/3056567796 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c003af0 con 0x7f4f9414c200 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f85ffb640 1 -- 172.21.15.88:0/3056567796 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c003ea0 con 0x7f4f9414c200 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f9b815640 1 -- 172.21.15.88:0/3056567796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9414ba00 con 0x7f4f9414c200 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.791+0000 7f4f9b815640 1 -- 172.21.15.88:0/3056567796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f94144cb0 con 0x7f4f9414c200 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.792+0000 7f4f9b815640 1 -- 172.21.15.88:0/3056567796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f940ba370 con 0x7f4f9414c200 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.792+0000 7f4f85ffb640 1 -- 172.21.15.88:0/3056567796 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f4f8c0050d0 con 0x7f4f9414c200 2024-01-22T10:13:39.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.793+0000 7f4f85ffb640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f4f7806b330 0x7f4f7806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:39.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.793+0000 7f4f85ffb640 1 -- 172.21.15.88:0/3056567796 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4f8c089640 con 0x7f4f9414c200 2024-01-22T10:13:39.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.793+0000 7f4f995b1640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f4f7806b330 0x7f4f7806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:39.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.793+0000 7f4f995b1640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f4f7806b330 0x7f4f7806d7f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4f90034000 tx=0x7f4f90009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:39.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.797+0000 7f4f85ffb640 1 -- 172.21.15.88:0/3056567796 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4f8c054620 con 0x7f4f9414c200 2024-01-22T10:13:39.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.967+0000 7f4f9b815640 1 -- 172.21.15.88:0/3056567796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4f9414bf20 con 0x7f4f9414c200 2024-01-22T10:13:39.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.967+0000 7f4f85ffb640 1 -- 172.21.15.88:0/3056567796 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v26) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4f9414bf20 con 0x7f4f9414c200 2024-01-22T10:13:39.950 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:39.950 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2024-01-22T10:13:39.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-01-22T10:13:39.950 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2024-01-22T10:13:39.951 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2024-01-22T10:13:39.951 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-01-22T10:13:39.951 INFO:teuthology.orchestra.run.smithi088.stdout:] 2024-01-22T10:13:39.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.969+0000 7f4f9b815640 1 -- 172.21.15.88:0/3056567796 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f4f7806b330 msgr2=0x7f4f7806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.969+0000 7f4f9b815640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f4f7806b330 0x7f4f7806d7f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4f90034000 tx=0x7f4f90009030 comp rx=0 tx=0).stop 2024-01-22T10:13:39.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.969+0000 7f4f9b815640 1 -- 172.21.15.88:0/3056567796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f9414c200 msgr2=0x7f4f9413f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:39.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.969+0000 7f4f9b815640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f9414c200 0x7f4f9413f290 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c007fd0 tx=0x7f4f8c00eb90 comp rx=0 tx=0).stop 2024-01-22T10:13:39.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.969+0000 7f4f9b815640 1 -- 172.21.15.88:0/3056567796 shutdown_connections 2024-01-22T10:13:39.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.969+0000 7f4f9b815640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f4f7806b330 0x7f4f7806d7f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.969+0000 7f4f9b815640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f9414c200 0x7f4f9413f290 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.969+0000 7f4f9b815640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f941d3d90 0x7f4f94144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.969+0000 7f4f9b815640 1 --2- 172.21.15.88:0/3056567796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f80003a50 0x7f4f9414cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.969+0000 7f4f9b815640 1 -- 172.21.15.88:0/3056567796 >> 172.21.15.88:0/3056567796 conn(0x7f4f94066380 msgr2=0x7f4f94140cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.969+0000 7f4f9b815640 1 -- 172.21.15.88:0/3056567796 shutdown_connections 2024-01-22T10:13:39.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:39.969+0000 7f4f9b815640 1 -- 172.21.15.88:0/3056567796 wait complete. 2024-01-22T10:13:39.962 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-22T10:13:39.962 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-22T10:13:40.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.084+0000 7f3f6edb6640 1 Processor -- start 2024-01-22T10:13:40.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.084+0000 7f3f6edb6640 1 -- start start 2024-01-22T10:13:40.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.084+0000 7f3f6edb6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3f680727d0 0x7f3f680b9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.084+0000 7f3f6edb6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3f680ba1e0 0x7f3f680b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.084+0000 7f3f6edb6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3f680b8de0 0x7f3f68143300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.084+0000 7f3f6edb6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680ba020 con 0x7f3f680b8de0 2024-01-22T10:13:40.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.084+0000 7f3f6edb6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680b98c0 con 0x7f3f680ba1e0 2024-01-22T10:13:40.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.084+0000 7f3f6edb6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680b5100 con 0x7f3f680727d0 2024-01-22T10:13:40.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.084+0000 7f3f6d353640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3f680b8de0 0x7f3f68143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.084+0000 7f3f6d353640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3f680b8de0 0x7f3f68143300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47710/0 (socket says 172.21.15.88:47710) 2024-01-22T10:13:40.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.084+0000 7f3f6d353640 1 -- 172.21.15.88:0/3729003408 learned_addr learned my addr 172.21.15.88:0/3729003408 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:40.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.085+0000 7f3f6cb52640 1 --2- 172.21.15.88:0/3729003408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3f680727d0 0x7f3f680b9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.085+0000 7f3f67fff640 1 --2- 172.21.15.88:0/3729003408 >> v2:172.21.15.119:3300/0 conn(0x7f3f680ba1e0 0x7f3f680b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.085+0000 7f3f6d353640 1 -- 172.21.15.88:0/3729003408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3f680727d0 msgr2=0x7f3f680b9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.085+0000 7f3f6d353640 1 --2- 172.21.15.88:0/3729003408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3f680727d0 0x7f3f680b9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.085+0000 7f3f6d353640 1 -- 172.21.15.88:0/3729003408 >> v2:172.21.15.119:3300/0 conn(0x7f3f680ba1e0 msgr2=0x7f3f680b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.085+0000 7f3f6d353640 1 --2- 172.21.15.88:0/3729003408 >> v2:172.21.15.119:3300/0 conn(0x7f3f680ba1e0 0x7f3f680b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.085+0000 7f3f6d353640 1 -- 172.21.15.88:0/3729003408 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680b53e0 con 0x7f3f680b8de0 2024-01-22T10:13:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.085+0000 7f3f6d353640 1 --2- 172.21.15.88:0/3729003408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680b8de0 0x7f3f68143300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3f6806b750 tx=0x7f3f6002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8852ee76d801e921 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.085+0000 7f3f677fe640 1 -- 172.21.15.88:0/3729003408 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6002cb00 con 0x7f3f680b8de0 2024-01-22T10:13:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.086+0000 7f3f677fe640 1 -- 172.21.15.88:0/3729003408 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6002cc60 con 0x7f3f680b8de0 2024-01-22T10:13:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.086+0000 7f3f677fe640 1 -- 172.21.15.88:0/3729003408 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f600343f0 con 0x7f3f680b8de0 2024-01-22T10:13:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.086+0000 7f3f6edb6640 1 -- 172.21.15.88:0/3729003408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680b8de0 msgr2=0x7f3f68143300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.086+0000 7f3f6edb6640 1 --2- 172.21.15.88:0/3729003408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680b8de0 0x7f3f68143300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3f6806b750 tx=0x7f3f6002bf60 comp rx=0 tx=0).stop 2024-01-22T10:13:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.086+0000 7f3f6edb6640 1 -- 172.21.15.88:0/3729003408 shutdown_connections 2024-01-22T10:13:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.086+0000 7f3f6edb6640 1 --2- 172.21.15.88:0/3729003408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680b8de0 0x7f3f68143300 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.086+0000 7f3f6edb6640 1 --2- 172.21.15.88:0/3729003408 >> v2:172.21.15.119:3300/0 conn(0x7f3f680ba1e0 0x7f3f680b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.086+0000 7f3f6edb6640 1 --2- 172.21.15.88:0/3729003408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3f680727d0 0x7f3f680b9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.086+0000 7f3f6edb6640 1 -- 172.21.15.88:0/3729003408 >> 172.21.15.88:0/3729003408 conn(0x7f3f680bdbe0 msgr2=0x7f3f680bdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.086+0000 7f3f6edb6640 1 -- 172.21.15.88:0/3729003408 shutdown_connections 2024-01-22T10:13:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.086+0000 7f3f6edb6640 1 -- 172.21.15.88:0/3729003408 wait complete. 2024-01-22T10:13:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.087+0000 7f3f6edb6640 1 Processor -- start 2024-01-22T10:13:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.087+0000 7f3f6edb6640 1 -- start start 2024-01-22T10:13:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6edb6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680727d0 0x7f3f681e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6edb6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3f680b8de0 0x7f3f68139060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6edb6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f680ba1e0 0x7f3f6814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6edb6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6814ac90 con 0x7f3f680727d0 2024-01-22T10:13:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6edb6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6813aa30 con 0x7f3f680ba1e0 2024-01-22T10:13:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6edb6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6813a1c0 con 0x7f3f680b8de0 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6cb52640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680727d0 0x7f3f681e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6cb52640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680727d0 0x7f3f681e1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47714/0 (socket says 172.21.15.88:47714) 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6cb52640 1 -- 172.21.15.88:0/2746587983 learned_addr learned my addr 172.21.15.88:0/2746587983 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6d353640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f680ba1e0 0x7f3f6814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f67fff640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3f680b8de0 0x7f3f68139060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6cb52640 1 -- 172.21.15.88:0/2746587983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3f680b8de0 msgr2=0x7f3f68139060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6cb52640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3f680b8de0 0x7f3f68139060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6cb52640 1 -- 172.21.15.88:0/2746587983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f680ba1e0 msgr2=0x7f3f6814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6cb52640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f680ba1e0 0x7f3f6814b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6cb52640 1 -- 172.21.15.88:0/2746587983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f60009b30 con 0x7f3f680727d0 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6d353640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f680ba1e0 0x7f3f6814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.088+0000 7f3f6cb52640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680727d0 0x7f3f681e1e80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00c7f0 tx=0x7f3f5c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.089+0000 7f3f657fa640 1 -- 172.21.15.88:0/2746587983 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c004220 con 0x7f3f680727d0 2024-01-22T10:13:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.089+0000 7f3f657fa640 1 -- 172.21.15.88:0/2746587983 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c004380 con 0x7f3f680727d0 2024-01-22T10:13:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.089+0000 7f3f6edb6640 1 -- 172.21.15.88:0/2746587983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6814d480 con 0x7f3f680727d0 2024-01-22T10:13:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.089+0000 7f3f657fa640 1 -- 172.21.15.88:0/2746587983 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c007860 con 0x7f3f680727d0 2024-01-22T10:13:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.089+0000 7f3f6edb6640 1 -- 172.21.15.88:0/2746587983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f68140680 con 0x7f3f680727d0 2024-01-22T10:13:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.089+0000 7f3f6edb6640 1 -- 172.21.15.88:0/2746587983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6814d2e0 con 0x7f3f680727d0 2024-01-22T10:13:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.090+0000 7f3f657fa640 1 -- 172.21.15.88:0/2746587983 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f3f5c007bd0 con 0x7f3f680727d0 2024-01-22T10:13:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.090+0000 7f3f657fa640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f3f4c06b330 0x7f3f4c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.090+0000 7f3f657fa640 1 -- 172.21.15.88:0/2746587983 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3f5c0897a0 con 0x7f3f680727d0 2024-01-22T10:13:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.090+0000 7f3f67fff640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f3f4c06b330 0x7f3f4c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.091+0000 7f3f67fff640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f3f4c06b330 0x7f3f4c06d7f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3f68139de0 tx=0x7f3f54008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:40.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.095+0000 7f3f657fa640 1 -- 172.21.15.88:0/2746587983 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3f6814d2e0 con 0x7f3f680727d0 2024-01-22T10:13:40.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.264+0000 7f3f6edb6640 1 -- 172.21.15.88:0/2746587983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3f6814d2e0 con 0x7f3f680727d0 2024-01-22T10:13:40.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.577+0000 7f3f657fa640 1 -- 172.21.15.88:0/2746587983 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3f6814d2e0 con 0x7f3f680727d0 2024-01-22T10:13:40.559 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2024-01-22T10:13:40.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.579+0000 7f3f6edb6640 1 -- 172.21.15.88:0/2746587983 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f3f4c06b330 msgr2=0x7f3f4c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:40.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.579+0000 7f3f6edb6640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f3f4c06b330 0x7f3f4c06d7f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3f68139de0 tx=0x7f3f54008040 comp rx=0 tx=0).stop 2024-01-22T10:13:40.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.579+0000 7f3f6edb6640 1 -- 172.21.15.88:0/2746587983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680727d0 msgr2=0x7f3f681e1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:40.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.579+0000 7f3f6edb6640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680727d0 0x7f3f681e1e80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00c7f0 tx=0x7f3f5c00ccb0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.579+0000 7f3f6edb6640 1 -- 172.21.15.88:0/2746587983 shutdown_connections 2024-01-22T10:13:40.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.579+0000 7f3f6edb6640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f3f4c06b330 0x7f3f4c06d7f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.579+0000 7f3f6edb6640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3f680b8de0 0x7f3f68139060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.579+0000 7f3f6edb6640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3f680ba1e0 0x7f3f6814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.579+0000 7f3f6edb6640 1 --2- 172.21.15.88:0/2746587983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f680727d0 0x7f3f681e1e80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.579+0000 7f3f6edb6640 1 -- 172.21.15.88:0/2746587983 >> 172.21.15.88:0/2746587983 conn(0x7f3f680bdbe0 msgr2=0x7f3f680b7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.579+0000 7f3f6edb6640 1 -- 172.21.15.88:0/2746587983 shutdown_connections 2024-01-22T10:13:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.579+0000 7f3f6edb6640 1 -- 172.21.15.88:0/2746587983 wait complete. 2024-01-22T10:13:40.576 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-22T10:13:40.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.700+0000 7f827275a640 1 Processor -- start 2024-01-22T10:13:40.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.700+0000 7f827275a640 1 -- start start 2024-01-22T10:13:40.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.701+0000 7f827275a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826c06a960 0x7f826c071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.701+0000 7f827275a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f826c14f760 0x7f826c155f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.701+0000 7f827275a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826c14eeb0 con 0x7f826c14f340 2024-01-22T10:13:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.701+0000 7f827275a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826c070c60 con 0x7f826c14f760 2024-01-22T10:13:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.701+0000 7f827275a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c14eb80 con 0x7f826c06a960 2024-01-22T10:13:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.701+0000 7f826bfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826c06a960 0x7f826c071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.701+0000 7f826b7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f826c14f340 0x7f826c14bd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.88:47066/0 (socket says 172.21.15.88:47066) 2024-01-22T10:13:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.701+0000 7f8270cf7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f826c14f760 0x7f826c155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.701+0000 7f826b7fe640 1 -- 172.21.15.88:0/3112392156 learned_addr learned my addr 172.21.15.88:0/3112392156 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.702+0000 7f826bfff640 1 -- 172.21.15.88:0/3112392156 >> v2:172.21.15.119:3300/0 conn(0x7f826c14f760 msgr2=0x7f826c155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.702+0000 7f826bfff640 1 --2- 172.21.15.88:0/3112392156 >> v2:172.21.15.119:3300/0 conn(0x7f826c14f760 0x7f826c155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.702+0000 7f826bfff640 1 -- 172.21.15.88:0/3112392156 >> v1:172.21.15.119:6789/0 conn(0x7f826c14f340 legacy=0x7f826c14bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.702+0000 7f826bfff640 1 -- 172.21.15.88:0/3112392156 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c0703c0 con 0x7f826c06a960 2024-01-22T10:13:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.702+0000 7f8270cf7640 1 --2- 172.21.15.88:0/3112392156 >> v2:172.21.15.119:3300/0 conn(0x7f826c14f760 0x7f826c155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.702+0000 7f826bfff640 1 --2- 172.21.15.88:0/3112392156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826c06a960 0x7f826c071fc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f825c0097d0 tx=0x7f825c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc6664a2db1c5527 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.703+0000 7f826affd640 1 -- 172.21.15.88:0/3112392156 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c031800 con 0x7f826c06a960 2024-01-22T10:13:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.703+0000 7f826affd640 1 -- 172.21.15.88:0/3112392156 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c031960 con 0x7f826c06a960 2024-01-22T10:13:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.703+0000 7f826affd640 1 -- 172.21.15.88:0/3112392156 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c031cf0 con 0x7f826c06a960 2024-01-22T10:13:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.703+0000 7f827275a640 1 -- 172.21.15.88:0/3112392156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826c06a960 msgr2=0x7f826c071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.703+0000 7f827275a640 1 --2- 172.21.15.88:0/3112392156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826c06a960 0x7f826c071fc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f825c0097d0 tx=0x7f825c02b8a0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.703+0000 7f827275a640 1 -- 172.21.15.88:0/3112392156 shutdown_connections 2024-01-22T10:13:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.703+0000 7f827275a640 1 --2- 172.21.15.88:0/3112392156 >> v2:172.21.15.119:3300/0 conn(0x7f826c14f760 0x7f826c155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.703+0000 7f827275a640 1 --2- 172.21.15.88:0/3112392156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826c06a960 0x7f826c071fc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.703+0000 7f827275a640 1 -- 172.21.15.88:0/3112392156 >> 172.21.15.88:0/3112392156 conn(0x7f826c06e9b0 msgr2=0x7f826c06b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.703+0000 7f827275a640 1 -- 172.21.15.88:0/3112392156 shutdown_connections 2024-01-22T10:13:40.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.703+0000 7f827275a640 1 -- 172.21.15.88:0/3112392156 wait complete. 2024-01-22T10:13:40.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.704+0000 7f827275a640 1 Processor -- start 2024-01-22T10:13:40.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.704+0000 7f827275a640 1 -- start start 2024-01-22T10:13:40.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f827275a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826c06a960 0x7f826c1404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f827275a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f826c14f340 0x7f826c141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f827275a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c14f760 0x7f826c148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f827275a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c1423d0 con 0x7f826c14f760 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f827275a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c148da0 con 0x7f826c14f340 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f827275a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0bcc50 con 0x7f826c06a960 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f8270cf7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c14f760 0x7f826c148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f8270cf7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c14f760 0x7f826c148860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47716/0 (socket says 172.21.15.88:47716) 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f8270cf7640 1 -- 172.21.15.88:0/1116724955 learned_addr learned my addr 172.21.15.88:0/1116724955 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f826bfff640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826c06a960 0x7f826c1404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f826b7fe640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f826c14f340 0x7f826c141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f8270cf7640 1 -- 172.21.15.88:0/1116724955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826c06a960 msgr2=0x7f826c1404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f8270cf7640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826c06a960 0x7f826c1404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f8270cf7640 1 -- 172.21.15.88:0/1116724955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f826c14f340 msgr2=0x7f826c141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f8270cf7640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f826c14f340 0x7f826c141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.705+0000 7f8270cf7640 1 -- 172.21.15.88:0/1116724955 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8264009a70 con 0x7f826c14f760 2024-01-22T10:13:40.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.706+0000 7f8270cf7640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c14f760 0x7f826c148860 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f826400ef90 tx=0x7f826400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.706+0000 7f8268ff9640 1 -- 172.21.15.88:0/1116724955 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8264009cd0 con 0x7f826c14f760 2024-01-22T10:13:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.706+0000 7f8268ff9640 1 -- 172.21.15.88:0/1116724955 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826400f040 con 0x7f826c14f760 2024-01-22T10:13:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.706+0000 7f827275a640 1 -- 172.21.15.88:0/1116724955 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c009400 con 0x7f826c14f760 2024-01-22T10:13:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.706+0000 7f8268ff9640 1 -- 172.21.15.88:0/1116724955 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82640146a0 con 0x7f826c14f760 2024-01-22T10:13:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.706+0000 7f827275a640 1 -- 172.21.15.88:0/1116724955 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c0bdee0 con 0x7f826c14f760 2024-01-22T10:13:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.707+0000 7f827275a640 1 -- 172.21.15.88:0/1116724955 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826c04ea30 con 0x7f826c14f760 2024-01-22T10:13:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.707+0000 7f8268ff9640 1 -- 172.21.15.88:0/1116724955 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f8264014800 con 0x7f826c14f760 2024-01-22T10:13:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.708+0000 7f8268ff9640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f825806b360 0x7f825806d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.708+0000 7f8268ff9640 1 -- 172.21.15.88:0/1116724955 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f826408a7f0 con 0x7f826c14f760 2024-01-22T10:13:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.708+0000 7f826bfff640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f825806b360 0x7f825806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.708+0000 7f826bfff640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f825806b360 0x7f825806d820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f825c036000 tx=0x7f825c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:40.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.712+0000 7f8268ff9640 1 -- 172.21.15.88:0/1116724955 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8264055710 con 0x7f826c14f760 2024-01-22T10:13:40.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:40.882+0000 7f827275a640 1 -- 172.21.15.88:0/1116724955 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f826c148fb0 con 0x7f826c14f760 2024-01-22T10:13:41.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.579+0000 7f8268ff9640 1 -- 172.21.15.88:0/1116724955 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v28) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8264018020 con 0x7f826c14f760 2024-01-22T10:13:41.562 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2024-01-22T10:13:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.582+0000 7f827275a640 1 -- 172.21.15.88:0/1116724955 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f825806b360 msgr2=0x7f825806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.582+0000 7f827275a640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f825806b360 0x7f825806d820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f825c036000 tx=0x7f825c03c040 comp rx=0 tx=0).stop 2024-01-22T10:13:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.582+0000 7f827275a640 1 -- 172.21.15.88:0/1116724955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c14f760 msgr2=0x7f826c148860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.582+0000 7f827275a640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c14f760 0x7f826c148860 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f826400ef90 tx=0x7f826400c490 comp rx=0 tx=0).stop 2024-01-22T10:13:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.583+0000 7f827275a640 1 -- 172.21.15.88:0/1116724955 shutdown_connections 2024-01-22T10:13:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.583+0000 7f827275a640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f825806b360 0x7f825806d820 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.583+0000 7f827275a640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f826c14f760 0x7f826c148860 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.583+0000 7f827275a640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f826c14f340 0x7f826c141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.583+0000 7f827275a640 1 --2- 172.21.15.88:0/1116724955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826c06a960 0x7f826c1404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.583+0000 7f827275a640 1 -- 172.21.15.88:0/1116724955 >> 172.21.15.88:0/1116724955 conn(0x7f826c06e9b0 msgr2=0x7f826c14d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:41.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.583+0000 7f827275a640 1 -- 172.21.15.88:0/1116724955 shutdown_connections 2024-01-22T10:13:41.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.583+0000 7f827275a640 1 -- 172.21.15.88:0/1116724955 wait complete. 2024-01-22T10:13:41.591 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-22T10:13:41.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.715+0000 7fdccc407640 1 Processor -- start 2024-01-22T10:13:41.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.715+0000 7fdccc407640 1 -- start start 2024-01-22T10:13:41.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdccc407640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdcc4071790 0x7fdcc4071f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:41.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdccc407640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc40b96d0 con 0x7fdcc40bad80 2024-01-22T10:13:41.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdccc407640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc4070ff0 con 0x7fdcc40b9220 2024-01-22T10:13:41.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdccc407640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc40b7630 con 0x7fdcc4071790 2024-01-22T10:13:41.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcca1a3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdcc40bad80 0x7fdcc4143320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33506/0 (socket says 172.21.15.88:33506) 2024-01-22T10:13:41.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcca1a3640 1 -- 172.21.15.88:0/742789867 learned_addr learned my addr 172.21.15.88:0/742789867 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002449643 0 0) 0x7fdcc40b96d0 con 0x7fdcc40bad80 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb0003520 con 0x7fdcc40bad80 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc99a2640 1 --2- 172.21.15.88:0/742789867 >> v2:172.21.15.119:3300/0 conn(0x7fdcc4071790 0x7fdcc4071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2845738987 0 0) 0x7fdcb0003520 con 0x7fdcc40bad80 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 >> v2:172.21.15.119:3300/0 conn(0x7fdcc4071790 msgr2=0x7fdcc4071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 --2- 172.21.15.88:0/742789867 >> v2:172.21.15.119:3300/0 conn(0x7fdcc4071790 0x7fdcc4071f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 >> v1:172.21.15.119:6789/0 conn(0x7fdcc40b9220 legacy=0x7fdcc4153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40b7910 con 0x7fdcc40bad80 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fdcc0001670 con 0x7fdcc40bad80 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 >> v1:172.21.15.88:6789/0 conn(0x7fdcc40bad80 legacy=0x7fdcc4143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 --2- 172.21.15.88:0/742789867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 0x7fdcb0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 --2- 172.21.15.88:0/742789867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00047c0 0x7fdcb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 --2- 172.21.15.88:0/742789867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00052a0 0x7fdcb000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40b7630 con 0x7fdcb0003a50 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb000c1a0 con 0x7fdcb00047c0 2024-01-22T10:13:41.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb000c360 con 0x7fdcb00052a0 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.716+0000 7fdcca1a3640 1 --2- 172.21.15.88:0/742789867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 0x7fdcb0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.717+0000 7fdcc99a2640 1 --2- 172.21.15.88:0/742789867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00047c0 0x7fdcb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.717+0000 7fdcca9a4640 1 --2- 172.21.15.88:0/742789867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00052a0 0x7fdcb000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.717+0000 7fdcca1a3640 1 -- 172.21.15.88:0/742789867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00052a0 msgr2=0x7fdcb000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.717+0000 7fdcca1a3640 1 --2- 172.21.15.88:0/742789867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00052a0 0x7fdcb000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.717+0000 7fdcca1a3640 1 -- 172.21.15.88:0/742789867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00047c0 msgr2=0x7fdcb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.717+0000 7fdcca1a3640 1 --2- 172.21.15.88:0/742789867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00047c0 0x7fdcb0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.717+0000 7fdcca1a3640 1 -- 172.21.15.88:0/742789867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0003520 con 0x7fdcb0003a50 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.717+0000 7fdcca9a4640 1 --2- 172.21.15.88:0/742789867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00052a0 0x7fdcb000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.717+0000 7fdcca9a4640 1 -- 172.21.15.88:0/742789867 reap_dead start 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.717+0000 7fdcca1a3640 1 --2- 172.21.15.88:0/742789867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 0x7fdcb0003e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000c190 tx=0x7fdcb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d788cc8ece3bbbe9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.718+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0005ad0 con 0x7fdcb0003a50 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.718+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc0005c50 con 0x7fdcb0003a50 2024-01-22T10:13:41.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.718+0000 7fdcc91a1640 1 -- 172.21.15.88:0/742789867 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc002c8a0 con 0x7fdcb0003a50 2024-01-22T10:13:41.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.718+0000 7fdccc407640 1 -- 172.21.15.88:0/742789867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 msgr2=0x7fdcb0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:41.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.718+0000 7fdccc407640 1 --2- 172.21.15.88:0/742789867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 0x7fdcb0003e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000c190 tx=0x7fdcb00057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:41.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.718+0000 7fdccc407640 1 -- 172.21.15.88:0/742789867 shutdown_connections 2024-01-22T10:13:41.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.718+0000 7fdccc407640 1 --2- 172.21.15.88:0/742789867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 0x7fdcb0003e70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:41.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.718+0000 7fdccc407640 1 -- 172.21.15.88:0/742789867 >> 172.21.15.88:0/742789867 conn(0x7fdcc406e9b0 msgr2=0x7fdcc406b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:41.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.718+0000 7fdccc407640 1 -- 172.21.15.88:0/742789867 shutdown_connections 2024-01-22T10:13:41.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.718+0000 7fdccc407640 1 -- 172.21.15.88:0/742789867 wait complete. 2024-01-22T10:13:41.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.719+0000 7fdccc407640 1 Processor -- start 2024-01-22T10:13:41.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.719+0000 7fdccc407640 1 -- start start 2024-01-22T10:13:41.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdccc407640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 0x7fdcc413f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:41.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdccc407640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc41451d0 0x7fdcc41420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:41.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdccc407640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcc4145c80 0x7fdcc413a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdccc407640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4144520 con 0x7fdcb0003a50 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdccc407640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4142900 con 0x7fdcc41451d0 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdccc407640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4144d40 con 0x7fdcc4145c80 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcca1a3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 0x7fdcc413f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcca1a3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 0x7fdcc413f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47742/0 (socket says 172.21.15.88:47742) 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcca1a3640 1 -- 172.21.15.88:0/196860320 learned_addr learned my addr 172.21.15.88:0/196860320 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcc99a2640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc41451d0 0x7fdcc41420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcca9a4640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcc4145c80 0x7fdcc413a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcca1a3640 1 -- 172.21.15.88:0/196860320 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcc4145c80 msgr2=0x7fdcc413a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcca1a3640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcc4145c80 0x7fdcc413a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcca1a3640 1 -- 172.21.15.88:0/196860320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc41451d0 msgr2=0x7fdcc41420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcca1a3640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc41451d0 0x7fdcc41420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:41.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcca1a3640 1 -- 172.21.15.88:0/196860320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc413fd50 con 0x7fdcb0003a50 2024-01-22T10:13:41.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcca1a3640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 0x7fdcc413f810 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000c2b0 tx=0x7fdcc002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:41.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcbaffd640 1 -- 172.21.15.88:0/196860320 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc003c040 con 0x7fdcb0003a50 2024-01-22T10:13:41.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdcbaffd640 1 -- 172.21.15.88:0/196860320 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc002ccb0 con 0x7fdcb0003a50 2024-01-22T10:13:41.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.720+0000 7fdccc407640 1 -- 172.21.15.88:0/196860320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc41465c0 con 0x7fdcb0003a50 2024-01-22T10:13:41.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.721+0000 7fdcbaffd640 1 -- 172.21.15.88:0/196860320 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0007270 con 0x7fdcb0003a50 2024-01-22T10:13:41.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.721+0000 7fdccc407640 1 -- 172.21.15.88:0/196860320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc41449d0 con 0x7fdcb0003a50 2024-01-22T10:13:41.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.721+0000 7fdccc407640 1 -- 172.21.15.88:0/196860320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc404ea30 con 0x7fdcb0003a50 2024-01-22T10:13:41.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.722+0000 7fdcbaffd640 1 -- 172.21.15.88:0/196860320 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fdcc0032070 con 0x7fdcb0003a50 2024-01-22T10:13:41.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.722+0000 7fdcbaffd640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fdca806b360 0x7fdca806d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:41.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.722+0000 7fdcbaffd640 1 -- 172.21.15.88:0/196860320 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fdcc00aad60 con 0x7fdcb0003a50 2024-01-22T10:13:41.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.722+0000 7fdcc99a2640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fdca806b360 0x7fdca806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:41.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.723+0000 7fdcc99a2640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fdca806b360 0x7fdca806d820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdcc413b810 tx=0x7fdcb4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:41.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.727+0000 7fdcbaffd640 1 -- 172.21.15.88:0/196860320 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdcc0075b00 con 0x7fdcb0003a50 2024-01-22T10:13:41.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:41.929+0000 7fdccc407640 1 -- 172.21.15.88:0/196860320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdcc413b880 con 0x7fdcb0003a50 2024-01-22T10:13:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.605+0000 7fdcbaffd640 1 -- 172.21.15.88:0/196860320 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdcc0079120 con 0x7fdcb0003a50 2024-01-22T10:13:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 4 and data pool 5 2024-01-22T10:13:42.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.608+0000 7fdccc407640 1 -- 172.21.15.88:0/196860320 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fdca806b360 msgr2=0x7fdca806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:42.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.608+0000 7fdccc407640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fdca806b360 0x7fdca806d820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdcc413b810 tx=0x7fdcb4008040 comp rx=0 tx=0).stop 2024-01-22T10:13:42.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.608+0000 7fdccc407640 1 -- 172.21.15.88:0/196860320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 msgr2=0x7fdcc413f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:42.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.608+0000 7fdccc407640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 0x7fdcc413f810 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000c2b0 tx=0x7fdcc002e070 comp rx=0 tx=0).stop 2024-01-22T10:13:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.612+0000 7fdccc407640 1 -- 172.21.15.88:0/196860320 shutdown_connections 2024-01-22T10:13:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.612+0000 7fdccc407640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fdca806b360 0x7fdca806d820 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.612+0000 7fdccc407640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcc4145c80 0x7fdcc413a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.612+0000 7fdccc407640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc41451d0 0x7fdcc41420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.612+0000 7fdccc407640 1 --2- 172.21.15.88:0/196860320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb0003a50 0x7fdcc413f810 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.612+0000 7fdccc407640 1 -- 172.21.15.88:0/196860320 >> 172.21.15.88:0/196860320 conn(0x7fdcc406e9b0 msgr2=0x7fdcc40be470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.616+0000 7fdccc407640 1 -- 172.21.15.88:0/196860320 shutdown_connections 2024-01-22T10:13:42.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.616+0000 7fdccc407640 1 -- 172.21.15.88:0/196860320 wait complete. 2024-01-22T10:13:42.625 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:42.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.746+0000 7f46299ea640 1 Processor -- start 2024-01-22T10:13:42.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.746+0000 7f46299ea640 1 -- start start 2024-01-22T10:13:42.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.747+0000 7f46299ea640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f46240ba4a0 0x7f46240b90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:42.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.747+0000 7f46299ea640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4624148690 0x7f4624148b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:42.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.747+0000 7f46299ea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4624149060 con 0x7f46240b72d0 2024-01-22T10:13:42.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.747+0000 7f46299ea640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46240b6f50 con 0x7f46240ba4a0 2024-01-22T10:13:42.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.747+0000 7f46299ea640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46240b9630 con 0x7f4624148690 2024-01-22T10:13:42.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.747+0000 7f461bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f46240b72d0 0x7f46241423d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33518/0 (socket says 172.21.15.88:33518) 2024-01-22T10:13:42.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.747+0000 7f461bfff640 1 -- 172.21.15.88:0/2464120027 learned_addr learned my addr 172.21.15.88:0/2464120027 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:42.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.747+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603456255 0 0) 0x7f4624149060 con 0x7f46240b72d0 2024-01-22T10:13:42.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.747+0000 7f4622ffd640 1 --2- 172.21.15.88:0/2464120027 >> v2:172.21.15.119:3300/0 conn(0x7f46240ba4a0 0x7f46240b90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:42.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.747+0000 7f46237fe640 1 --2- 172.21.15.88:0/2464120027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4624148690 0x7f4624148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:42.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.747+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4610003520 con 0x7f46240b72d0 2024-01-22T10:13:42.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 813688255 0 0) 0x7f4610003520 con 0x7f46240b72d0 2024-01-22T10:13:42.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4624148690 msgr2=0x7f4624148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:42.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 --2- 172.21.15.88:0/2464120027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4624148690 0x7f4624148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 >> v2:172.21.15.119:3300/0 conn(0x7f46240ba4a0 msgr2=0x7f46240b90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 --2- 172.21.15.88:0/2464120027 >> v2:172.21.15.119:3300/0 conn(0x7f46240ba4a0 0x7f46240b90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624071890 con 0x7f46240b72d0 2024-01-22T10:13:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f460c001670 con 0x7f46240b72d0 2024-01-22T10:13:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 >> v1:172.21.15.88:6789/0 conn(0x7f46240b72d0 legacy=0x7f46241423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 --2- 172.21.15.88:0/2464120027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4610003a50 0x7f4610003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 --2- 172.21.15.88:0/2464120027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46100047c0 0x7f4610004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 --2- 172.21.15.88:0/2464120027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4624148690 0x7f4610005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46240b6f50 con 0x7f4610003a50 2024-01-22T10:13:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46240b9630 con 0x7f46100047c0 2024-01-22T10:13:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461000ba90 con 0x7f4624148690 2024-01-22T10:13:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f4622ffd640 1 --2- 172.21.15.88:0/2464120027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4610003a50 0x7f4610003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:42.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f461bfff640 1 --2- 172.21.15.88:0/2464120027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46100047c0 0x7f4610004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f46237fe640 1 --2- 172.21.15.88:0/2464120027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4624148690 0x7f4610005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f4622ffd640 1 -- 172.21.15.88:0/2464120027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4624148690 msgr2=0x7f4610005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f4622ffd640 1 --2- 172.21.15.88:0/2464120027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4624148690 0x7f4610005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f4622ffd640 1 -- 172.21.15.88:0/2464120027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46100047c0 msgr2=0x7f4610004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f4622ffd640 1 --2- 172.21.15.88:0/2464120027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46100047c0 0x7f4610004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.748+0000 7f4622ffd640 1 -- 172.21.15.88:0/2464120027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4610003520 con 0x7f4610003a50 2024-01-22T10:13:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.749+0000 7f4622ffd640 1 --2- 172.21.15.88:0/2464120027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4610003a50 0x7f4610003e70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4614009ac0 tx=0x7f46100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a63bcc1aa6e3ffd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.749+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461402c710 con 0x7f4610003a50 2024-01-22T10:13:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.749+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461402c870 con 0x7f4610003a50 2024-01-22T10:13:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.749+0000 7f46227fc640 1 -- 172.21.15.88:0/2464120027 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461402cc00 con 0x7f4610003a50 2024-01-22T10:13:42.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.750+0000 7f46299ea640 1 -- 172.21.15.88:0/2464120027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4610003a50 msgr2=0x7f4610003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.750+0000 7f46299ea640 1 --2- 172.21.15.88:0/2464120027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4610003a50 0x7f4610003e70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4614009ac0 tx=0x7f46100057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.750+0000 7f46237fe640 1 -- 172.21.15.88:0/2464120027 reap_dead start 2024-01-22T10:13:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.750+0000 7f46299ea640 1 -- 172.21.15.88:0/2464120027 shutdown_connections 2024-01-22T10:13:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.750+0000 7f46299ea640 1 -- 172.21.15.88:0/2464120027 >> 172.21.15.88:0/2464120027 conn(0x7f462406ab10 msgr2=0x7f462406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.750+0000 7f46299ea640 1 -- 172.21.15.88:0/2464120027 shutdown_connections 2024-01-22T10:13:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.750+0000 7f46299ea640 1 -- 172.21.15.88:0/2464120027 wait complete. 2024-01-22T10:13:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.751+0000 7f46299ea640 1 Processor -- start 2024-01-22T10:13:42.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.751+0000 7f46299ea640 1 -- start start 2024-01-22T10:13:42.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.751+0000 7f46299ea640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4610003a50 0x7f46241dd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:42.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.751+0000 7f46299ea640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46241e1940 0x7f4624142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:42.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.751+0000 7f46299ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4624143290 0x7f46240b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:42.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.751+0000 7f46299ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4624141730 con 0x7f4624143290 2024-01-22T10:13:42.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.751+0000 7f46299ea640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4624145690 con 0x7f4610003a50 2024-01-22T10:13:42.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.751+0000 7f46299ea640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46241e11e0 con 0x7f46241e1940 2024-01-22T10:13:42.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.751+0000 7f46237fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4624143290 0x7f46240b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:42.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.751+0000 7f46237fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4624143290 0x7f46240b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47766/0 (socket says 172.21.15.88:47766) 2024-01-22T10:13:42.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.751+0000 7f46237fe640 1 -- 172.21.15.88:0/2947455147 learned_addr learned my addr 172.21.15.88:0/2947455147 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:42.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f461bfff640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46241e1940 0x7f4624142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f4622ffd640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4610003a50 0x7f46241dd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f46237fe640 1 -- 172.21.15.88:0/2947455147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46241e1940 msgr2=0x7f4624142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f46237fe640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46241e1940 0x7f4624142d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f46237fe640 1 -- 172.21.15.88:0/2947455147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4610003a50 msgr2=0x7f46241dd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f46237fe640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4610003a50 0x7f46241dd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f46237fe640 1 -- 172.21.15.88:0/2947455147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46241ddcc0 con 0x7f4624143290 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f46237fe640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4624143290 0x7f46240b3640 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f46240726a0 tx=0x7f461c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f4620ff9640 1 -- 172.21.15.88:0/2947455147 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c00e040 con 0x7f4624143290 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f4620ff9640 1 -- 172.21.15.88:0/2947455147 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c00f040 con 0x7f4624143290 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f46299ea640 1 -- 172.21.15.88:0/2947455147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4624145bd0 con 0x7f4624143290 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f4620ff9640 1 -- 172.21.15.88:0/2947455147 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c015670 con 0x7f4624143290 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.752+0000 7f46299ea640 1 -- 172.21.15.88:0/2947455147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46241e1420 con 0x7f4624143290 2024-01-22T10:13:42.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.753+0000 7f46299ea640 1 -- 172.21.15.88:0/2947455147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46241e1640 con 0x7f4624143290 2024-01-22T10:13:42.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.753+0000 7f4620ff9640 1 -- 172.21.15.88:0/2947455147 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f461c0157d0 con 0x7f4624143290 2024-01-22T10:13:42.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.754+0000 7f4620ff9640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f460406b360 0x7f460406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:42.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.754+0000 7f4620ff9640 1 -- 172.21.15.88:0/2947455147 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f461c08a640 con 0x7f4624143290 2024-01-22T10:13:42.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.754+0000 7f4622ffd640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f460406b360 0x7f460406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:42.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.754+0000 7f4622ffd640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f460406b360 0x7f460406d820 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4614036000 tx=0x7f4614030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:42.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.758+0000 7f4620ff9640 1 -- 172.21.15.88:0/2947455147 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f461c055360 con 0x7f4624143290 2024-01-22T10:13:42.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.927+0000 7f46299ea640 1 -- 172.21.15.88:0/2947455147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f462404ea30 con 0x7f4624143290 2024-01-22T10:13:42.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.928+0000 7f4620ff9640 1 -- 172.21.15.88:0/2947455147 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16559 (secure 0 0 0) 0x7f461c058980 con 0x7f4624143290 2024-01-22T10:13:42.911 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:42.911 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:41.931182+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:40.282454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:40.901002+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:42.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.930+0000 7f46299ea640 1 -- 172.21.15.88:0/2947455147 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f460406b360 msgr2=0x7f460406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:42.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.930+0000 7f46299ea640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f460406b360 0x7f460406d820 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4614036000 tx=0x7f4614030000 comp rx=0 tx=0).stop 2024-01-22T10:13:42.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.930+0000 7f46299ea640 1 -- 172.21.15.88:0/2947455147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4624143290 msgr2=0x7f46240b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:42.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.930+0000 7f46299ea640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4624143290 0x7f46240b3640 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f46240726a0 tx=0x7f461c00f580 comp rx=0 tx=0).stop 2024-01-22T10:13:42.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.930+0000 7f46299ea640 1 -- 172.21.15.88:0/2947455147 shutdown_connections 2024-01-22T10:13:42.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.930+0000 7f46299ea640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f460406b360 0x7f460406d820 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.930+0000 7f46299ea640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46241e1940 0x7f4624142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.930+0000 7f46299ea640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4624143290 0x7f46240b3640 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.930+0000 7f46299ea640 1 --2- 172.21.15.88:0/2947455147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4610003a50 0x7f46241dd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:42.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.930+0000 7f46299ea640 1 -- 172.21.15.88:0/2947455147 >> 172.21.15.88:0/2947455147 conn(0x7f462406ab10 msgr2=0x7f46240b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:42.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.930+0000 7f46299ea640 1 -- 172.21.15.88:0/2947455147 shutdown_connections 2024-01-22T10:13:42.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:42.930+0000 7f46299ea640 1 -- 172.21.15.88:0/2947455147 wait complete. 2024-01-22T10:13:42.924 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:43.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.040+0000 7fd3aaffc640 1 Processor -- start 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.040+0000 7fd3aaffc640 1 -- start start 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3aaffc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3a40bdd90 0x7fd3a4070030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3aaffc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd3a413fc00 0x7fd3a4140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3aaffc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a414cb00 con 0x7fd3a4149580 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3aaffc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a4070940 con 0x7fd3a413fc00 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3aaffc640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a414d680 con 0x7fd3a40bdd90 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a9599640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd3a4149580 0x7fd3a4149980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33528/0 (socket says 172.21.15.88:33528) 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a9599640 1 -- 172.21.15.88:0/1408581962 learned_addr learned my addr 172.21.15.88:0/1408581962 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a8d98640 1 --2- 172.21.15.88:0/1408581962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3a40bdd90 0x7fd3a4070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a3fff640 1 --2- 172.21.15.88:0/1408581962 >> v2:172.21.15.119:3300/0 conn(0x7fd3a413fc00 0x7fd3a4140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865017089 0 0) 0x7fd3a414cb00 con 0x7fd3a4149580 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd394003520 con 0x7fd3a4149580 2024-01-22T10:13:43.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4111202874 0 0) 0x7fd394003520 con 0x7fd3a4149580 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3a40bdd90 msgr2=0x7fd3a4070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 --2- 172.21.15.88:0/1408581962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3a40bdd90 0x7fd3a4070030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 >> v2:172.21.15.119:3300/0 conn(0x7fd3a413fc00 msgr2=0x7fd3a4140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 --2- 172.21.15.88:0/1408581962 >> v2:172.21.15.119:3300/0 conn(0x7fd3a413fc00 0x7fd3a4140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4071590 con 0x7fd3a4149580 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fd39c0019f0 con 0x7fd3a4149580 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 >> v1:172.21.15.88:6789/0 conn(0x7fd3a4149580 legacy=0x7fd3a4149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 --2- 172.21.15.88:0/1408581962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd394003a50 0x7fd394003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 --2- 172.21.15.88:0/1408581962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3940047c0 0x7fd394004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 --2- 172.21.15.88:0/1408581962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3a40bdd90 0x7fd394005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a4070940 con 0x7fd3940047c0 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a414d680 con 0x7fd394003a50 2024-01-22T10:13:43.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39400b9b0 con 0x7fd3a40bdd90 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a3fff640 1 --2- 172.21.15.88:0/1408581962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3940047c0 0x7fd394004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a8d98640 1 --2- 172.21.15.88:0/1408581962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd394003a50 0x7fd394003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.041+0000 7fd3a9599640 1 --2- 172.21.15.88:0/1408581962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3a40bdd90 0x7fd394005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.042+0000 7fd3a3fff640 1 -- 172.21.15.88:0/1408581962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3a40bdd90 msgr2=0x7fd394005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.042+0000 7fd3a3fff640 1 --2- 172.21.15.88:0/1408581962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3a40bdd90 0x7fd394005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.042+0000 7fd3a3fff640 1 -- 172.21.15.88:0/1408581962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd394003a50 msgr2=0x7fd394003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.042+0000 7fd3a3fff640 1 --2- 172.21.15.88:0/1408581962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd394003a50 0x7fd394003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.042+0000 7fd3a3fff640 1 -- 172.21.15.88:0/1408581962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd394003520 con 0x7fd3940047c0 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.042+0000 7fd3a3fff640 1 --2- 172.21.15.88:0/1408581962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3940047c0 0x7fd394004c40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd390009ac0 tx=0x7fd3940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8421fffe17d54c80 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.042+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39002c710 con 0x7fd3940047c0 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.042+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39002c870 con 0x7fd3940047c0 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.042+0000 7fd3a37fe640 1 -- 172.21.15.88:0/1408581962 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39002cc00 con 0x7fd3940047c0 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.043+0000 7fd3aaffc640 1 -- 172.21.15.88:0/1408581962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3940047c0 msgr2=0x7fd394004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:43.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.043+0000 7fd3aaffc640 1 --2- 172.21.15.88:0/1408581962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3940047c0 0x7fd394004c40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd390009ac0 tx=0x7fd3940057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.043+0000 7fd3a9599640 1 -- 172.21.15.88:0/1408581962 reap_dead start 2024-01-22T10:13:43.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.043+0000 7fd3aaffc640 1 -- 172.21.15.88:0/1408581962 shutdown_connections 2024-01-22T10:13:43.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.043+0000 7fd3aaffc640 1 -- 172.21.15.88:0/1408581962 >> 172.21.15.88:0/1408581962 conn(0x7fd3a406ad20 msgr2=0x7fd3a40bd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:43.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.043+0000 7fd3aaffc640 1 -- 172.21.15.88:0/1408581962 shutdown_connections 2024-01-22T10:13:43.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.043+0000 7fd3aaffc640 1 -- 172.21.15.88:0/1408581962 wait complete. 2024-01-22T10:13:43.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.044+0000 7fd3aaffc640 1 Processor -- start 2024-01-22T10:13:43.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.044+0000 7fd3aaffc640 1 -- start start 2024-01-22T10:13:43.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3aaffc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3940047c0 0x7fd3a4140c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3aaffc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3a41df8f0 0x7fd3a41d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3aaffc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3a41d31c0 0x7fd3a4139190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3aaffc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a4141df0 con 0x7fd3a41d31c0 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3aaffc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a4140110 con 0x7fd3a41df8f0 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3aaffc640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a41411a0 con 0x7fd3940047c0 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a9599640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3a41d31c0 0x7fd3a4139190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a9599640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3a41d31c0 0x7fd3a4139190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47796/0 (socket says 172.21.15.88:47796) 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a9599640 1 -- 172.21.15.88:0/3605772854 learned_addr learned my addr 172.21.15.88:0/3605772854 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a8d98640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3940047c0 0x7fd3a4140c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a3fff640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3a41df8f0 0x7fd3a41d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a9599640 1 -- 172.21.15.88:0/3605772854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3940047c0 msgr2=0x7fd3a4140c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a9599640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3940047c0 0x7fd3a4140c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a9599640 1 -- 172.21.15.88:0/3605772854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3a41df8f0 msgr2=0x7fd3a41d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a9599640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3a41df8f0 0x7fd3a41d2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a9599640 1 -- 172.21.15.88:0/3605772854 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a41d3700 con 0x7fd3a41d31c0 2024-01-22T10:13:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a9599640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3a41d31c0 0x7fd3a4139190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4070b80 tx=0x7fd39c007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a17fa640 1 -- 172.21.15.88:0/3605772854 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c00abc0 con 0x7fd3a41d31c0 2024-01-22T10:13:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.045+0000 7fd3a17fa640 1 -- 172.21.15.88:0/3605772854 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39c00ad20 con 0x7fd3a41d31c0 2024-01-22T10:13:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.046+0000 7fd3aaffc640 1 -- 172.21.15.88:0/3605772854 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a41dee10 con 0x7fd3a41d31c0 2024-01-22T10:13:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.046+0000 7fd3a17fa640 1 -- 172.21.15.88:0/3605772854 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c013630 con 0x7fd3a41d31c0 2024-01-22T10:13:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.046+0000 7fd3aaffc640 1 -- 172.21.15.88:0/3605772854 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a41df3d0 con 0x7fd3a41d31c0 2024-01-22T10:13:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.047+0000 7fd3aaffc640 1 -- 172.21.15.88:0/3605772854 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a404ea30 con 0x7fd3a41d31c0 2024-01-22T10:13:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.047+0000 7fd3a17fa640 1 -- 172.21.15.88:0/3605772854 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fd39c013790 con 0x7fd3a41d31c0 2024-01-22T10:13:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.047+0000 7fd3a17fa640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd38806b330 0x7fd38806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.048+0000 7fd3a17fa640 1 -- 172.21.15.88:0/3605772854 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd39c08a2b0 con 0x7fd3a41d31c0 2024-01-22T10:13:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.048+0000 7fd3a8d98640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd38806b330 0x7fd38806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.048+0000 7fd3a8d98640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd38806b330 0x7fd38806d7f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd398009900 tx=0x7fd398008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:43.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.052+0000 7fd3a17fa640 1 -- 172.21.15.88:0/3605772854 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd39c054fd0 con 0x7fd3a41d31c0 2024-01-22T10:13:43.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.221+0000 7fd3aaffc640 1 -- 172.21.15.88:0/3605772854 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3a40b9880 con 0x7fd3a41d31c0 2024-01-22T10:13:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.222+0000 7fd3a17fa640 1 -- 172.21.15.88:0/3605772854 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16559 (secure 0 0 0) 0x7fd39c0585f0 con 0x7fd3a41d31c0 2024-01-22T10:13:43.205 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:43.205 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:41.931182+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:40.282454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:40.901002+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:43.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.224+0000 7fd3aaffc640 1 -- 172.21.15.88:0/3605772854 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd38806b330 msgr2=0x7fd38806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:43.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.224+0000 7fd3aaffc640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd38806b330 0x7fd38806d7f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd398009900 tx=0x7fd398008040 comp rx=0 tx=0).stop 2024-01-22T10:13:43.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.224+0000 7fd3aaffc640 1 -- 172.21.15.88:0/3605772854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3a41d31c0 msgr2=0x7fd3a4139190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:43.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.224+0000 7fd3aaffc640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3a41d31c0 0x7fd3a4139190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4070b80 tx=0x7fd39c007b00 comp rx=0 tx=0).stop 2024-01-22T10:13:43.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.225+0000 7fd3aaffc640 1 -- 172.21.15.88:0/3605772854 shutdown_connections 2024-01-22T10:13:43.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.225+0000 7fd3aaffc640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd38806b330 0x7fd38806d7f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.225+0000 7fd3aaffc640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3a41d31c0 0x7fd3a4139190 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.225+0000 7fd3aaffc640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3a41df8f0 0x7fd3a41d2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.225+0000 7fd3aaffc640 1 --2- 172.21.15.88:0/3605772854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd3940047c0 0x7fd3a4140c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.225+0000 7fd3aaffc640 1 -- 172.21.15.88:0/3605772854 >> 172.21.15.88:0/3605772854 conn(0x7fd3a406ad20 msgr2=0x7fd3a4072420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:43.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.225+0000 7fd3aaffc640 1 -- 172.21.15.88:0/3605772854 shutdown_connections 2024-01-22T10:13:43.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.225+0000 7fd3aaffc640 1 -- 172.21.15.88:0/3605772854 wait complete. 2024-01-22T10:13:43.218 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-22T10:13:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.337+0000 7f2dcb3be640 1 Processor -- start 2024-01-22T10:13:43.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.337+0000 7f2dcb3be640 1 -- start start 2024-01-22T10:13:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.338+0000 7f2dcb3be640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc406a960 0x7f2dc40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.338+0000 7f2dcb3be640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc40b6d60 con 0x7f2dc40b8fb0 2024-01-22T10:13:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.338+0000 7f2dcb3be640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc406b660 con 0x7f2dc40ba130 2024-01-22T10:13:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.338+0000 7f2dcb3be640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40b7370 con 0x7f2dc406a960 2024-01-22T10:13:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.338+0000 7f2dc8959640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2dc40b8fb0 0x7f2dc41432a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33544/0 (socket says 172.21.15.88:33544) 2024-01-22T10:13:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.338+0000 7f2dc8959640 1 -- 172.21.15.88:0/2937778461 learned_addr learned my addr 172.21.15.88:0/2937778461 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.338+0000 7f2dc915a640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc406a960 0x7f2dc40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010208899 0 0) 0x7f2dc40b6d60 con 0x7f2dc40b8fb0 2024-01-22T10:13:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db0003520 con 0x7f2dc40b8fb0 2024-01-22T10:13:43.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975340241 0 0) 0x7f2dbc001110 con 0x7f2dc40ba130 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc40b6d60 con 0x7f2dc40ba130 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 748371082 0 0) 0x7f2db0003520 con 0x7f2dc40b8fb0 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc406a960 msgr2=0x7f2dc40b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc406a960 0x7f2dc40b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 >> v1:172.21.15.119:6789/0 conn(0x7f2dc40ba130 legacy=0x7f2dc4153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc40b55a0 con 0x7f2dc40b8fb0 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f2db4001670 con 0x7f2dc40b8fb0 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dc915a640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc406a960 0x7f2dc40b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 >> v1:172.21.15.88:6789/0 conn(0x7f2dc40b8fb0 legacy=0x7f2dc41432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2db0003c10 0x7f2db0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db00047c0 0x7f2db0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc406a960 0x7f2db00051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40b7370 con 0x7f2db0003c10 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db000bae0 con 0x7f2db00047c0 2024-01-22T10:13:43.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db000bca0 con 0x7f2dc406a960 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dc915a640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2db0003c10 0x7f2db0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dc8959640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db00047c0 0x7f2db0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dc995b640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc406a960 0x7f2db00051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dc915a640 1 -- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc406a960 msgr2=0x7f2db00051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dc915a640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc406a960 0x7f2db00051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dc915a640 1 -- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db00047c0 msgr2=0x7f2db0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dc915a640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db00047c0 0x7f2db0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dc915a640 1 -- 172.21.15.88:0/2937778461 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0009a70 con 0x7f2db0003c10 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.339+0000 7f2dc8959640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db00047c0 0x7f2db0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.340+0000 7f2dc915a640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2db0003c10 0x7f2db0004010 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000e350 tx=0x7f2db00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb27534dd93d5a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.340+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc002cd70 con 0x7f2db0003c10 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.340+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc000f040 con 0x7f2db0003c10 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.340+0000 7f2dbbfff640 1 -- 172.21.15.88:0/2937778461 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0034640 con 0x7f2db0003c10 2024-01-22T10:13:43.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.341+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2937778461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2db0003c10 msgr2=0x7f2db0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:43.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.341+0000 7f2dcb3be640 1 --2- 172.21.15.88:0/2937778461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2db0003c10 0x7f2db0004010 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000e350 tx=0x7f2db00057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.341+0000 7f2dc995b640 1 -- 172.21.15.88:0/2937778461 reap_dead start 2024-01-22T10:13:43.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.341+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2937778461 shutdown_connections 2024-01-22T10:13:43.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.341+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2937778461 >> 172.21.15.88:0/2937778461 conn(0x7f2dc406b800 msgr2=0x7f2dc406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:43.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.341+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2937778461 shutdown_connections 2024-01-22T10:13:43.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.341+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2937778461 wait complete. 2024-01-22T10:13:43.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.342+0000 7f2dcb3be640 1 Processor -- start 2024-01-22T10:13:43.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.342+0000 7f2dcb3be640 1 -- start start 2024-01-22T10:13:43.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.342+0000 7f2dcb3be640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db0003c10 0x7f2dc41d5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.342+0000 7f2dcb3be640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc41d5e20 0x7f2dc4149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.342+0000 7f2dcb3be640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dc41d4050 0x7f2dc41d44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.342+0000 7f2dcb3be640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc41496c0 con 0x7f2dc41d4050 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.342+0000 7f2dcb3be640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc4146190 con 0x7f2db0003c10 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.342+0000 7f2dcb3be640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc41469a0 con 0x7f2dc41d5e20 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.342+0000 7f2dc995b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dc41d4050 0x7f2dc41d44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.342+0000 7f2dc995b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dc41d4050 0x7f2dc41d44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47822/0 (socket says 172.21.15.88:47822) 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.342+0000 7f2dc995b640 1 -- 172.21.15.88:0/2780385506 learned_addr learned my addr 172.21.15.88:0/2780385506 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2dc915a640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db0003c10 0x7f2dc41d5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2dc8959640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc41d5e20 0x7f2dc4149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2dc995b640 1 -- 172.21.15.88:0/2780385506 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc41d5e20 msgr2=0x7f2dc4149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2dc995b640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc41d5e20 0x7f2dc4149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2dc995b640 1 -- 172.21.15.88:0/2780385506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db0003c10 msgr2=0x7f2dc41d5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2dc995b640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db0003c10 0x7f2dc41d5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2dc995b640 1 -- 172.21.15.88:0/2780385506 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc41d6280 con 0x7f2dc41d4050 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2dc995b640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dc41d4050 0x7f2dc41d44b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc001270 tx=0x7f2dbc00e800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2db9ffb640 1 -- 172.21.15.88:0/2780385506 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc005320 con 0x7f2dc41d4050 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2db9ffb640 1 -- 172.21.15.88:0/2780385506 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc0067d0 con 0x7f2dc41d4050 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2780385506 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc414a230 con 0x7f2dc41d4050 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2db9ffb640 1 -- 172.21.15.88:0/2780385506 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc006b80 con 0x7f2dc41d4050 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.343+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2780385506 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc41466c0 con 0x7f2dc41d4050 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.344+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2780385506 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc404ea30 con 0x7f2dc41d4050 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.344+0000 7f2db9ffb640 1 -- 172.21.15.88:0/2780385506 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f2dbc006ce0 con 0x7f2dc41d4050 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.345+0000 7f2db9ffb640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2da806b330 0x7f2da806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.345+0000 7f2db9ffb640 1 -- 172.21.15.88:0/2780385506 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2dbc088c00 con 0x7f2dc41d4050 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.345+0000 7f2dc915a640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2da806b330 0x7f2da806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:43.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.345+0000 7f2dc915a640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2da806b330 0x7f2da806d7f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0036000 tx=0x7f2dc002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:43.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.349+0000 7f2db9ffb640 1 -- 172.21.15.88:0/2780385506 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2dbc08f080 con 0x7f2dc41d4050 2024-01-22T10:13:43.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:43.555+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2780385506 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2dc406b660 con 0x7f2dc41d4050 2024-01-22T10:13:44.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.490+0000 7f2db9ffb640 1 -- 172.21.15.88:0/2780385506 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2dc406b660 con 0x7f2dc41d4050 2024-01-22T10:13:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.493+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2780385506 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2da806b330 msgr2=0x7f2da806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.493+0000 7f2dcb3be640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2da806b330 0x7f2da806d7f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0036000 tx=0x7f2dc002e000 comp rx=0 tx=0).stop 2024-01-22T10:13:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.493+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2780385506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dc41d4050 msgr2=0x7f2dc41d44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.493+0000 7f2dcb3be640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dc41d4050 0x7f2dc41d44b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc001270 tx=0x7f2dbc00e800 comp rx=0 tx=0).stop 2024-01-22T10:13:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.493+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2780385506 shutdown_connections 2024-01-22T10:13:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.493+0000 7f2dcb3be640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2da806b330 0x7f2da806d7f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.493+0000 7f2dcb3be640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dc41d5e20 0x7f2dc4149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.493+0000 7f2dcb3be640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2dc41d4050 0x7f2dc41d44b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.493+0000 7f2dcb3be640 1 --2- 172.21.15.88:0/2780385506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2db0003c10 0x7f2dc41d5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:44.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.493+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2780385506 >> 172.21.15.88:0/2780385506 conn(0x7f2dc406b800 msgr2=0x7f2dc40bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:44.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.493+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2780385506 shutdown_connections 2024-01-22T10:13:44.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.493+0000 7f2dcb3be640 1 -- 172.21.15.88:0/2780385506 wait complete. 2024-01-22T10:13:44.488 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-22T10:13:44.488 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-22T10:13:44.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.611+0000 7f134567c640 1 Processor -- start 2024-01-22T10:13:44.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.611+0000 7f134567c640 1 -- start start 2024-01-22T10:13:44.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f134567c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13400bbb00 0x7f134014ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:44.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f134567c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13400bdde0 0x7f1340156010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:44.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f134567c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13400bd1c0 con 0x7f13400b45a0 2024-01-22T10:13:44.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f134567c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13400bc560 con 0x7f13400bdde0 2024-01-22T10:13:44.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f134567c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13400c0820 con 0x7f13400bbb00 2024-01-22T10:13:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f133f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13400bdde0 0x7f1340156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f133f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13400bdde0 0x7f1340156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47838/0 (socket says 172.21.15.88:47838) 2024-01-22T10:13:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f1337fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f13400b45a0 0x7f134014b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33558/0 (socket says 172.21.15.88:33558) 2024-01-22T10:13:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f133f7fe640 1 -- 172.21.15.88:0/2090499841 learned_addr learned my addr 172.21.15.88:0/2090499841 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f133effd640 1 --2- 172.21.15.88:0/2090499841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13400bbb00 0x7f134014ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f133f7fe640 1 -- 172.21.15.88:0/2090499841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13400bbb00 msgr2=0x7f134014ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f133f7fe640 1 --2- 172.21.15.88:0/2090499841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13400bbb00 0x7f134014ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f133f7fe640 1 -- 172.21.15.88:0/2090499841 >> v1:172.21.15.88:6789/0 conn(0x7f13400b45a0 legacy=0x7f134014b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f133f7fe640 1 -- 172.21.15.88:0/2090499841 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13400c0b00 con 0x7f13400bdde0 2024-01-22T10:13:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f133e7fc640 1 -- 172.21.15.88:0/2090499841 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200193537 0 0) 0x7f13400bd1c0 con 0x7f13400b45a0 2024-01-22T10:13:44.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.612+0000 7f133effd640 1 --2- 172.21.15.88:0/2090499841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13400bbb00 0x7f134014ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:44.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.613+0000 7f133f7fe640 1 --2- 172.21.15.88:0/2090499841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13400bdde0 0x7f1340156010 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1338009e50 tx=0x7f133802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217aece114c041ae server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:44.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.613+0000 7f133e7fc640 1 -- 172.21.15.88:0/2090499841 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133802cb00 con 0x7f13400bdde0 2024-01-22T10:13:44.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.613+0000 7f133e7fc640 1 -- 172.21.15.88:0/2090499841 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133802cc60 con 0x7f13400bdde0 2024-01-22T10:13:44.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.613+0000 7f133e7fc640 1 -- 172.21.15.88:0/2090499841 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380343f0 con 0x7f13400bdde0 2024-01-22T10:13:44.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.614+0000 7f134567c640 1 -- 172.21.15.88:0/2090499841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13400bdde0 msgr2=0x7f1340156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:44.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.614+0000 7f134567c640 1 --2- 172.21.15.88:0/2090499841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13400bdde0 0x7f1340156010 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1338009e50 tx=0x7f133802bf60 comp rx=0 tx=0).stop 2024-01-22T10:13:44.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.614+0000 7f134567c640 1 -- 172.21.15.88:0/2090499841 shutdown_connections 2024-01-22T10:13:44.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.614+0000 7f134567c640 1 --2- 172.21.15.88:0/2090499841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13400bdde0 0x7f1340156010 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:44.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.614+0000 7f134567c640 1 --2- 172.21.15.88:0/2090499841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13400bbb00 0x7f134014ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:44.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.614+0000 7f134567c640 1 -- 172.21.15.88:0/2090499841 >> 172.21.15.88:0/2090499841 conn(0x7f13400a2c20 msgr2=0x7f13400a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:44.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.614+0000 7f134567c640 1 -- 172.21.15.88:0/2090499841 shutdown_connections 2024-01-22T10:13:44.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.614+0000 7f134567c640 1 -- 172.21.15.88:0/2090499841 wait complete. 2024-01-22T10:13:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f134567c640 1 Processor -- start 2024-01-22T10:13:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f134567c640 1 -- start start 2024-01-22T10:13:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f134567c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13400b45a0 0x7f13400ba650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f134567c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400bbb00 0x7f13400b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f134567c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13400bdde0 0x7f134009b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f134567c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400bab90 con 0x7f13400bdde0 2024-01-22T10:13:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f134567c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400b5cf0 con 0x7f13400bbb00 2024-01-22T10:13:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f134567c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13400a2330 con 0x7f13400b45a0 2024-01-22T10:13:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f133f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13400bdde0 0x7f134009b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f133f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13400bdde0 0x7f134009b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47846/0 (socket says 172.21.15.88:47846) 2024-01-22T10:13:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f133f7fe640 1 -- 172.21.15.88:0/1231347590 learned_addr learned my addr 172.21.15.88:0/1231347590 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:44.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f133effd640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13400b45a0 0x7f13400ba650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.615+0000 7f1337fff640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400bbb00 0x7f13400b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.616+0000 7f133f7fe640 1 -- 172.21.15.88:0/1231347590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13400b45a0 msgr2=0x7f13400ba650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.616+0000 7f133f7fe640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13400b45a0 0x7f13400ba650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.616+0000 7f133f7fe640 1 -- 172.21.15.88:0/1231347590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400bbb00 msgr2=0x7f13400b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.616+0000 7f133f7fe640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400bbb00 0x7f13400b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.616+0000 7f133f7fe640 1 -- 172.21.15.88:0/1231347590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338009b30 con 0x7f13400bdde0 2024-01-22T10:13:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.616+0000 7f133f7fe640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13400bdde0 0x7f134009b080 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1338009e50 tx=0x7f1338004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.616+0000 7f13377fe640 1 -- 172.21.15.88:0/1231347590 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338009510 con 0x7f13400bdde0 2024-01-22T10:13:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.616+0000 7f13377fe640 1 -- 172.21.15.88:0/1231347590 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133803e450 con 0x7f13400bdde0 2024-01-22T10:13:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.616+0000 7f134567c640 1 -- 172.21.15.88:0/1231347590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134009ff30 con 0x7f13400bdde0 2024-01-22T10:13:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.616+0000 7f13377fe640 1 -- 172.21.15.88:0/1231347590 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133803e800 con 0x7f13400bdde0 2024-01-22T10:13:44.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.616+0000 7f134567c640 1 -- 172.21.15.88:0/1231347590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13400b4f80 con 0x7f13400bdde0 2024-01-22T10:13:44.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.617+0000 7f134567c640 1 -- 172.21.15.88:0/1231347590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1340067c40 con 0x7f13400bdde0 2024-01-22T10:13:44.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.617+0000 7f13377fe640 1 -- 172.21.15.88:0/1231347590 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f133803e960 con 0x7f13400bdde0 2024-01-22T10:13:44.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.618+0000 7f13377fe640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f132006b330 0x7f132006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:44.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.618+0000 7f133effd640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f132006b330 0x7f132006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:44.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.618+0000 7f13377fe640 1 -- 172.21.15.88:0/1231347590 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13380ac8f0 con 0x7f13400bdde0 2024-01-22T10:13:44.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.618+0000 7f133effd640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f132006b330 0x7f132006d7f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f133000ab60 tx=0x7f1330008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:44.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.622+0000 7f13377fe640 1 -- 172.21.15.88:0/1231347590 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f13380776c0 con 0x7f13400bdde0 2024-01-22T10:13:44.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:44.830+0000 7f134567c640 1 -- 172.21.15.88:0/1231347590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f13400bd880 con 0x7f13400bdde0 2024-01-22T10:13:45.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.627+0000 7f13377fe640 1 -- 172.21.15.88:0/1231347590 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f133807ace0 con 0x7f13400bdde0 2024-01-22T10:13:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.629+0000 7f134567c640 1 -- 172.21.15.88:0/1231347590 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f132006b330 msgr2=0x7f132006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.629+0000 7f134567c640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f132006b330 0x7f132006d7f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f133000ab60 tx=0x7f1330008040 comp rx=0 tx=0).stop 2024-01-22T10:13:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.629+0000 7f134567c640 1 -- 172.21.15.88:0/1231347590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13400bdde0 msgr2=0x7f134009b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.629+0000 7f134567c640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13400bdde0 0x7f134009b080 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1338009e50 tx=0x7f1338004a40 comp rx=0 tx=0).stop 2024-01-22T10:13:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.629+0000 7f134567c640 1 -- 172.21.15.88:0/1231347590 shutdown_connections 2024-01-22T10:13:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.629+0000 7f134567c640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f132006b330 0x7f132006d7f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.629+0000 7f134567c640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13400bdde0 0x7f134009b080 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.629+0000 7f134567c640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13400bbb00 0x7f13400b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.629+0000 7f134567c640 1 --2- 172.21.15.88:0/1231347590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13400b45a0 0x7f13400ba650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.629+0000 7f134567c640 1 -- 172.21.15.88:0/1231347590 >> 172.21.15.88:0/1231347590 conn(0x7f13400a2c20 msgr2=0x7f13400a1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:45.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.629+0000 7f134567c640 1 -- 172.21.15.88:0/1231347590 shutdown_connections 2024-01-22T10:13:45.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.629+0000 7f134567c640 1 -- 172.21.15.88:0/1231347590 wait complete. 2024-01-22T10:13:45.625 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-22T10:13:45.625 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:13:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.747+0000 7f33253c9640 1 Processor -- start 2024-01-22T10:13:45.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.747+0000 7f33253c9640 1 -- start start 2024-01-22T10:13:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f33253c9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f332006baa0 0x7f332006bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f33253c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332014b700 con 0x7f33200a40c0 2024-01-22T10:13:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f33253c9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332006f340 con 0x7f332006d2b0 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f33253c9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332014c5f0 con 0x7f332006baa0 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f33200a40c0 0x7f3320155f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33568/0 (socket says 172.21.15.88:33568) 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331f7fe640 1 -- 172.21.15.88:0/2445152767 learned_addr learned my addr 172.21.15.88:0/2445152767 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331e7fc640 1 --2- 172.21.15.88:0/2445152767 >> v2:172.21.15.119:3300/0 conn(0x7f332006baa0 0x7f332006bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830381200 0 0) 0x7f332014b700 con 0x7f33200a40c0 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3308003520 con 0x7f33200a40c0 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108284132 0 0) 0x7f332006f340 con 0x7f332006d2b0 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f332014b700 con 0x7f332006d2b0 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 913130870 0 0) 0x7f3308003520 con 0x7f33200a40c0 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 >> v2:172.21.15.119:3300/0 conn(0x7f332006baa0 msgr2=0x7f332006bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331dffb640 1 --2- 172.21.15.88:0/2445152767 >> v2:172.21.15.119:3300/0 conn(0x7f332006baa0 0x7f332006bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 >> v1:172.21.15.119:6789/0 conn(0x7f332006d2b0 legacy=0x7f332014bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332006de90 con 0x7f33200a40c0 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f3318001670 con 0x7f33200a40c0 2024-01-22T10:13:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 >> v1:172.21.15.88:6789/0 conn(0x7f33200a40c0 legacy=0x7f3320155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.748+0000 7f331dffb640 1 --2- 172.21.15.88:0/2445152767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3308003c30 0x7f3308004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331dffb640 1 --2- 172.21.15.88:0/2445152767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33080047c0 0x7f3308004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331dffb640 1 --2- 172.21.15.88:0/2445152767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33080051f0 0x7f330800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332014c5f0 con 0x7f33080047c0 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330800c150 con 0x7f33080051f0 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330800c310 con 0x7f3308003c30 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331e7fc640 1 --2- 172.21.15.88:0/2445152767 >> v2:172.21.15.119:3300/0 conn(0x7f332006baa0 0x7f332006bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331e7fc640 1 --2- 172.21.15.88:0/2445152767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33080047c0 0x7f3308004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331f7fe640 1 --2- 172.21.15.88:0/2445152767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33080051f0 0x7f330800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331effd640 1 --2- 172.21.15.88:0/2445152767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3308003c30 0x7f3308004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331e7fc640 1 -- 172.21.15.88:0/2445152767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3308003c30 msgr2=0x7f3308004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331e7fc640 1 --2- 172.21.15.88:0/2445152767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3308003c30 0x7f3308004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331e7fc640 1 -- 172.21.15.88:0/2445152767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33080051f0 msgr2=0x7f330800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331e7fc640 1 --2- 172.21.15.88:0/2445152767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33080051f0 0x7f330800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331e7fc640 1 -- 172.21.15.88:0/2445152767 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3308003520 con 0x7f33080047c0 2024-01-22T10:13:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331f7fe640 1 -- 172.21.15.88:0/2445152767 reap_dead start 2024-01-22T10:13:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.749+0000 7f331effd640 1 --2- 172.21.15.88:0/2445152767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3308003c30 0x7f3308004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.750+0000 7f331e7fc640 1 --2- 172.21.15.88:0/2445152767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33080047c0 0x7f3308004c40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3314009c70 tx=0x7f33080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597bc435332f7a5a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.750+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314004020 con 0x7f33080047c0 2024-01-22T10:13:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.750+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3314004180 con 0x7f33080047c0 2024-01-22T10:13:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.750+0000 7f331dffb640 1 -- 172.21.15.88:0/2445152767 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331402c8f0 con 0x7f33080047c0 2024-01-22T10:13:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.750+0000 7f33253c9640 1 -- 172.21.15.88:0/2445152767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33080047c0 msgr2=0x7f3308004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.750+0000 7f33253c9640 1 --2- 172.21.15.88:0/2445152767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33080047c0 0x7f3308004c40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3314009c70 tx=0x7f33080057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.750+0000 7f33253c9640 1 -- 172.21.15.88:0/2445152767 shutdown_connections 2024-01-22T10:13:45.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.750+0000 7f33253c9640 1 --2- 172.21.15.88:0/2445152767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33080047c0 0x7f3308004c40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.750+0000 7f33253c9640 1 -- 172.21.15.88:0/2445152767 >> 172.21.15.88:0/2445152767 conn(0x7f33200bb8d0 msgr2=0x7f33200bbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.750+0000 7f33253c9640 1 -- 172.21.15.88:0/2445152767 shutdown_connections 2024-01-22T10:13:45.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.750+0000 7f33253c9640 1 -- 172.21.15.88:0/2445152767 wait complete. 2024-01-22T10:13:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f33253c9640 1 Processor -- start 2024-01-22T10:13:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f33253c9640 1 -- start start 2024-01-22T10:13:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f33253c9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33080047c0 0x7f33201e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f33253c9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f332014f220 0x7f33201e2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f33253c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33201e2ad0 0x7f3320140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f33253c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33201d7560 con 0x7f33201e2ad0 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f33253c9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33201e49f0 con 0x7f33080047c0 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f33253c9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33201d6170 con 0x7f332014f220 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f331f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33201e2ad0 0x7f3320140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f331f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33201e2ad0 0x7f3320140450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47856/0 (socket says 172.21.15.88:47856) 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f331f7fe640 1 -- 172.21.15.88:0/1651541171 learned_addr learned my addr 172.21.15.88:0/1651541171 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f331effd640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33080047c0 0x7f33201e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.752+0000 7f331e7fc640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f332014f220 0x7f33201e2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.753+0000 7f331f7fe640 1 -- 172.21.15.88:0/1651541171 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f332014f220 msgr2=0x7f33201e2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.753+0000 7f331f7fe640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f332014f220 0x7f33201e2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.753+0000 7f331f7fe640 1 -- 172.21.15.88:0/1651541171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33080047c0 msgr2=0x7f33201e44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.753+0000 7f331f7fe640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33080047c0 0x7f33201e44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.753+0000 7f331f7fe640 1 -- 172.21.15.88:0/1651541171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33201e2f50 con 0x7f33201e2ad0 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.753+0000 7f331f7fe640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33201e2ad0 0x7f3320140450 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f332014fcc0 tx=0x7f3318007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.753+0000 7f33077fe640 1 -- 172.21.15.88:0/1651541171 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318007770 con 0x7f33201e2ad0 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.753+0000 7f33077fe640 1 -- 172.21.15.88:0/1651541171 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331800f620 con 0x7f33201e2ad0 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.753+0000 7f33077fe640 1 -- 172.21.15.88:0/1651541171 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331800f9b0 con 0x7f33201e2ad0 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.753+0000 7f33253c9640 1 -- 172.21.15.88:0/1651541171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33201d5bb0 con 0x7f33201e2ad0 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.753+0000 7f33253c9640 1 -- 172.21.15.88:0/1651541171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33201d67f0 con 0x7f33201e2ad0 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.754+0000 7f33253c9640 1 -- 172.21.15.88:0/1651541171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3320067c40 con 0x7f33201e2ad0 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.754+0000 7f33077fe640 1 -- 172.21.15.88:0/1651541171 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f331800fb10 con 0x7f33201e2ad0 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.755+0000 7f33077fe640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f330c06b360 0x7f330c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.755+0000 7f33077fe640 1 -- 172.21.15.88:0/1651541171 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3318089930 con 0x7f33201e2ad0 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.755+0000 7f331effd640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f330c06b360 0x7f330c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.755+0000 7f331effd640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f330c06b360 0x7f330c06d820 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3310007fd0 tx=0x7f3310009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:45.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.759+0000 7f33077fe640 1 -- 172.21.15.88:0/1651541171 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f33180545c0 con 0x7f33201e2ad0 2024-01-22T10:13:45.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.964+0000 7f33253c9640 1 -- 172.21.15.88:0/1651541171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f332004ea30 con 0x7f33201e2ad0 2024-01-22T10:13:45.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.965+0000 7f33077fe640 1 -- 172.21.15.88:0/1651541171 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4150 (secure 0 0 0) 0x7f3318057be0 con 0x7f33201e2ad0 2024-01-22T10:13:45.947 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:45.947 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1165513551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1165513551},{"type":"v1","addr":"172.21.15.88:6837","nonce":1165513551}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2442028121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2442028121},{"type":"v1","addr":"172.21.15.119:6833","nonce":2442028121}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T10:13:41.931499+0000","modified":"2024-01-22T10:13:44.831394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4983},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4983":{"gid":4983,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6836/2577795457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2577795457},{"type":"v1","addr":"172.21.15.88:6836","nonce":2577795457}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-22T10:13:45.947 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2024-01-22T10:13:45.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.967+0000 7f33253c9640 1 -- 172.21.15.88:0/1651541171 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f330c06b360 msgr2=0x7f330c06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:45.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.967+0000 7f33253c9640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f330c06b360 0x7f330c06d820 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3310007fd0 tx=0x7f3310009040 comp rx=0 tx=0).stop 2024-01-22T10:13:45.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.967+0000 7f33253c9640 1 -- 172.21.15.88:0/1651541171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33201e2ad0 msgr2=0x7f3320140450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:45.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.967+0000 7f33253c9640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33201e2ad0 0x7f3320140450 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f332014fcc0 tx=0x7f3318007430 comp rx=0 tx=0).stop 2024-01-22T10:13:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.967+0000 7f33253c9640 1 -- 172.21.15.88:0/1651541171 shutdown_connections 2024-01-22T10:13:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.967+0000 7f33253c9640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f330c06b360 0x7f330c06d820 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.967+0000 7f33253c9640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f332014f220 0x7f33201e2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.967+0000 7f33253c9640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33201e2ad0 0x7f3320140450 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.967+0000 7f33253c9640 1 --2- 172.21.15.88:0/1651541171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33080047c0 0x7f33201e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.967+0000 7f33253c9640 1 -- 172.21.15.88:0/1651541171 >> 172.21.15.88:0/1651541171 conn(0x7f33200bb8d0 msgr2=0x7f3320144000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.967+0000 7f33253c9640 1 -- 172.21.15.88:0/1651541171 shutdown_connections 2024-01-22T10:13:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:45.967+0000 7f33253c9640 1 -- 172.21.15.88:0/1651541171 wait complete. 2024-01-22T10:13:45.960 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:46.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.077+0000 7fc1b3407640 1 Processor -- start 2024-01-22T10:13:46.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.077+0000 7fc1b3407640 1 -- start start 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.077+0000 7fc1b3407640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc1ac0b3630 0x7fc1ac0bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.077+0000 7fc1b3407640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1ac14c070 0x7fc1ac152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.077+0000 7fc1b3407640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac0b4e80 con 0x7fc1ac0b49c0 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.077+0000 7fc1b3407640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac0b5370 con 0x7fc1ac14c070 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.077+0000 7fc1b3407640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac0b5fd0 con 0x7fc1ac0b3630 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.078+0000 7fc1b19a4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1ac14c070 0x7fc1ac152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.078+0000 7fc1b19a4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1ac14c070 0x7fc1ac152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47872/0 (socket says 172.21.15.88:47872) 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.078+0000 7fc1b19a4640 1 -- 172.21.15.88:0/2973185601 learned_addr learned my addr 172.21.15.88:0/2973185601 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.078+0000 7fc1b11a3640 1 --2- 172.21.15.88:0/2973185601 >> v2:172.21.15.119:3300/0 conn(0x7fc1ac0b3630 0x7fc1ac0bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.078+0000 7fc1b19a4640 1 -- 172.21.15.88:0/2973185601 >> v2:172.21.15.119:3300/0 conn(0x7fc1ac0b3630 msgr2=0x7fc1ac0bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.078+0000 7fc1b19a4640 1 --2- 172.21.15.88:0/2973185601 >> v2:172.21.15.119:3300/0 conn(0x7fc1ac0b3630 0x7fc1ac0bd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.078+0000 7fc1b19a4640 1 -- 172.21.15.88:0/2973185601 >> v1:172.21.15.119:6789/0 conn(0x7fc1ac0b49c0 legacy=0x7fc1ac14b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:46.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.078+0000 7fc1b19a4640 1 -- 172.21.15.88:0/2973185601 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0b6590 con 0x7fc1ac14c070 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.078+0000 7fc1b11a3640 1 --2- 172.21.15.88:0/2973185601 >> v2:172.21.15.119:3300/0 conn(0x7fc1ac0b3630 0x7fc1ac0bd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.079+0000 7fc1b19a4640 1 --2- 172.21.15.88:0/2973185601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1ac14c070 0x7fc1ac152cf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0b3dc0 tx=0x7fc1a402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd32b8e0455f8eb server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.079+0000 7fc1a3fff640 1 -- 172.21.15.88:0/2973185601 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a402ea90 con 0x7fc1ac14c070 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.079+0000 7fc1a3fff640 1 -- 172.21.15.88:0/2973185601 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a402ebf0 con 0x7fc1ac14c070 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.079+0000 7fc1a3fff640 1 -- 172.21.15.88:0/2973185601 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4009600 con 0x7fc1ac14c070 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.079+0000 7fc1b3407640 1 -- 172.21.15.88:0/2973185601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1ac14c070 msgr2=0x7fc1ac152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.079+0000 7fc1b3407640 1 --2- 172.21.15.88:0/2973185601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1ac14c070 0x7fc1ac152cf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0b3dc0 tx=0x7fc1a402e0f0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.079+0000 7fc1b3407640 1 -- 172.21.15.88:0/2973185601 shutdown_connections 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.079+0000 7fc1b3407640 1 --2- 172.21.15.88:0/2973185601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1ac14c070 0x7fc1ac152cf0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.079+0000 7fc1b3407640 1 --2- 172.21.15.88:0/2973185601 >> v2:172.21.15.119:3300/0 conn(0x7fc1ac0b3630 0x7fc1ac0bd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.079+0000 7fc1b3407640 1 -- 172.21.15.88:0/2973185601 >> 172.21.15.88:0/2973185601 conn(0x7fc1ac06acf0 msgr2=0x7fc1ac0bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.079+0000 7fc1b3407640 1 -- 172.21.15.88:0/2973185601 shutdown_connections 2024-01-22T10:13:46.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.079+0000 7fc1b3407640 1 -- 172.21.15.88:0/2973185601 wait complete. 2024-01-22T10:13:46.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.080+0000 7fc1b3407640 1 Processor -- start 2024-01-22T10:13:46.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.080+0000 7fc1b3407640 1 -- start start 2024-01-22T10:13:46.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b3407640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1ac0b3630 0x7fc1ac141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b3407640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1ac0b49c0 0x7fc1ac13c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b3407640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1ac13dea0 0x7fc1ac13e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b3407640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac13fb10 con 0x7fc1ac0b3630 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b3407640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac141ad0 con 0x7fc1ac13dea0 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b3407640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac13e890 con 0x7fc1ac0b49c0 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b11a3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1ac0b3630 0x7fc1ac141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b11a3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1ac0b3630 0x7fc1ac141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47882/0 (socket says 172.21.15.88:47882) 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b11a3640 1 -- 172.21.15.88:0/3029592614 learned_addr learned my addr 172.21.15.88:0/3029592614 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b19a4640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1ac13dea0 0x7fc1ac13e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b09a2640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1ac0b49c0 0x7fc1ac13c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b11a3640 1 -- 172.21.15.88:0/3029592614 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1ac0b49c0 msgr2=0x7fc1ac13c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b11a3640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1ac0b49c0 0x7fc1ac13c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b11a3640 1 -- 172.21.15.88:0/3029592614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1ac13dea0 msgr2=0x7fc1ac13e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b11a3640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1ac13dea0 0x7fc1ac13e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b11a3640 1 -- 172.21.15.88:0/3029592614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a400bd40 con 0x7fc1ac0b3630 2024-01-22T10:13:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.081+0000 7fc1b11a3640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1ac0b3630 0x7fc1ac141590 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800c7f0 tx=0x7fc1a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.082+0000 7fc1a1ffb640 1 -- 172.21.15.88:0/3029592614 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8007a30 con 0x7fc1ac0b3630 2024-01-22T10:13:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.082+0000 7fc1a1ffb640 1 -- 172.21.15.88:0/3029592614 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a8007b90 con 0x7fc1ac0b3630 2024-01-22T10:13:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.082+0000 7fc1b3407640 1 -- 172.21.15.88:0/3029592614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac13ccc0 con 0x7fc1ac0b3630 2024-01-22T10:13:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.082+0000 7fc1a1ffb640 1 -- 172.21.15.88:0/3029592614 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a800ce40 con 0x7fc1ac0b3630 2024-01-22T10:13:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.082+0000 7fc1b3407640 1 -- 172.21.15.88:0/3029592614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac13f450 con 0x7fc1ac0b3630 2024-01-22T10:13:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.083+0000 7fc1b3407640 1 -- 172.21.15.88:0/3029592614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac13fc50 con 0x7fc1ac0b3630 2024-01-22T10:13:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.083+0000 7fc1a1ffb640 1 -- 172.21.15.88:0/3029592614 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fc1a80113f0 con 0x7fc1ac0b3630 2024-01-22T10:13:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.083+0000 7fc1a1ffb640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc19006b330 0x7fc19006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.084+0000 7fc1a1ffb640 1 -- 172.21.15.88:0/3029592614 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1a8089cb0 con 0x7fc1ac0b3630 2024-01-22T10:13:46.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.084+0000 7fc1b09a2640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc19006b330 0x7fc19006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.084+0000 7fc1b09a2640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc19006b330 0x7fc19006d7f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac071e90 tx=0x7fc19c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:46.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.088+0000 7fc1a1ffb640 1 -- 172.21.15.88:0/3029592614 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc1ac13fc50 con 0x7fc1ac0b3630 2024-01-22T10:13:46.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.257+0000 7fc1b3407640 1 -- 172.21.15.88:0/3029592614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1ac13fc50 con 0x7fc1ac0b3630 2024-01-22T10:13:46.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.258+0000 7fc1a1ffb640 1 -- 172.21.15.88:0/3029592614 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16546 (secure 0 0 0) 0x7fc1ac13fc50 con 0x7fc1ac0b3630 2024-01-22T10:13:46.241 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:46.241 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":30,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:43.614634+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:40.282454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:40.901002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.261+0000 7fc1b3407640 1 -- 172.21.15.88:0/3029592614 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc19006b330 msgr2=0x7fc19006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.261+0000 7fc1b3407640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc19006b330 0x7fc19006d7f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac071e90 tx=0x7fc19c009040 comp rx=0 tx=0).stop 2024-01-22T10:13:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.261+0000 7fc1b3407640 1 -- 172.21.15.88:0/3029592614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1ac0b3630 msgr2=0x7fc1ac141590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.261+0000 7fc1b3407640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1ac0b3630 0x7fc1ac141590 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800c7f0 tx=0x7fc1a800cbf0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.261+0000 7fc1b3407640 1 -- 172.21.15.88:0/3029592614 shutdown_connections 2024-01-22T10:13:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.261+0000 7fc1b3407640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc19006b330 0x7fc19006d7f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.261+0000 7fc1b3407640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1ac0b49c0 0x7fc1ac13c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.261+0000 7fc1b3407640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1ac13dea0 0x7fc1ac13e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.261+0000 7fc1b3407640 1 --2- 172.21.15.88:0/3029592614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1ac0b3630 0x7fc1ac141590 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.261+0000 7fc1b3407640 1 -- 172.21.15.88:0/3029592614 >> 172.21.15.88:0/3029592614 conn(0x7fc1ac06acf0 msgr2=0x7fc1ac14b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:46.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.261+0000 7fc1b3407640 1 -- 172.21.15.88:0/3029592614 shutdown_connections 2024-01-22T10:13:46.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.261+0000 7fc1b3407640 1 -- 172.21.15.88:0/3029592614 wait complete. 2024-01-22T10:13:46.254 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-22T10:13:46.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T10:13:46.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.370+0000 7f471ed3e640 1 Processor -- start 2024-01-22T10:13:46.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.370+0000 7f471ed3e640 1 -- start start 2024-01-22T10:13:46.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.371+0000 7f471ed3e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47180ba260 0x7f4718070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.371+0000 7f471ed3e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4718070db0 0x7f4718155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.371+0000 7f471ed3e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47180b9e40 con 0x7f47180ba9d0 2024-01-22T10:13:46.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.371+0000 7f471ed3e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47180b91f0 con 0x7f47180ba260 2024-01-22T10:13:46.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.371+0000 7f471ed3e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4718071920 con 0x7f4718070db0 2024-01-22T10:13:46.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.371+0000 7f4717fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47180ba260 0x7f4718070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.371+0000 7f4717fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47180ba260 0x7f4718070870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47894/0 (socket says 172.21.15.88:47894) 2024-01-22T10:13:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.371+0000 7f4717fff640 1 -- 172.21.15.88:0/1333586888 learned_addr learned my addr 172.21.15.88:0/1333586888 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.372+0000 7f4717fff640 1 -- 172.21.15.88:0/1333586888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4718070db0 msgr2=0x7f4718155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.372+0000 7f471d2db640 1 --2- 172.21.15.88:0/1333586888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4718070db0 0x7f4718155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.372+0000 7f4717fff640 1 --2- 172.21.15.88:0/1333586888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4718070db0 0x7f4718155fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.372+0000 7f4717fff640 1 -- 172.21.15.88:0/1333586888 >> v1:172.21.15.119:6789/0 conn(0x7f47180ba9d0 legacy=0x7f4718145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:46.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.372+0000 7f4717fff640 1 -- 172.21.15.88:0/1333586888 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718071b30 con 0x7f47180ba260 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.372+0000 7f4717fff640 1 --2- 172.21.15.88:0/1333586888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47180ba260 0x7f4718070870 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4704009870 tx=0x7f470402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e681911eeedd2d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.372+0000 7f47177fe640 1 -- 172.21.15.88:0/1333586888 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704031640 con 0x7f47180ba260 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.372+0000 7f47177fe640 1 -- 172.21.15.88:0/1333586888 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47040317a0 con 0x7f47180ba260 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.372+0000 7f47177fe640 1 -- 172.21.15.88:0/1333586888 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704031b30 con 0x7f47180ba260 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.373+0000 7f471ed3e640 1 -- 172.21.15.88:0/1333586888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47180ba260 msgr2=0x7f4718070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.373+0000 7f471ed3e640 1 --2- 172.21.15.88:0/1333586888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47180ba260 0x7f4718070870 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4704009870 tx=0x7f470402b8f0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.373+0000 7f471ed3e640 1 -- 172.21.15.88:0/1333586888 shutdown_connections 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.373+0000 7f471ed3e640 1 --2- 172.21.15.88:0/1333586888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4718070db0 0x7f4718155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.373+0000 7f471ed3e640 1 --2- 172.21.15.88:0/1333586888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47180ba260 0x7f4718070870 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.373+0000 7f471ed3e640 1 -- 172.21.15.88:0/1333586888 >> 172.21.15.88:0/1333586888 conn(0x7f471806b800 msgr2=0x7f471806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.373+0000 7f471ed3e640 1 -- 172.21.15.88:0/1333586888 shutdown_connections 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.373+0000 7f471ed3e640 1 -- 172.21.15.88:0/1333586888 wait complete. 2024-01-22T10:13:46.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.374+0000 7f471ed3e640 1 Processor -- start 2024-01-22T10:13:46.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.374+0000 7f471ed3e640 1 -- start start 2024-01-22T10:13:46.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471ed3e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4718070db0 0x7f47181455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471ed3e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47180ba260 0x7f47181e1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471ed3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47180ba9d0 0x7f4718147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471ed3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4718147670 con 0x7f47180ba9d0 2024-01-22T10:13:46.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471ed3e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47181e1570 con 0x7f4718070db0 2024-01-22T10:13:46.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471ed3e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471814c7f0 con 0x7f47180ba260 2024-01-22T10:13:46.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471d2db640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47180ba9d0 0x7f4718147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471d2db640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47180ba9d0 0x7f4718147130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47896/0 (socket says 172.21.15.88:47896) 2024-01-22T10:13:46.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471d2db640 1 -- 172.21.15.88:0/4113495754 learned_addr learned my addr 172.21.15.88:0/4113495754 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f4717fff640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47180ba260 0x7f47181e1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471cada640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4718070db0 0x7f47181455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471d2db640 1 -- 172.21.15.88:0/4113495754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47180ba260 msgr2=0x7f47181e1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471d2db640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47180ba260 0x7f47181e1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471d2db640 1 -- 172.21.15.88:0/4113495754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4718070db0 msgr2=0x7f47181455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471d2db640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4718070db0 0x7f47181455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471d2db640 1 -- 172.21.15.88:0/4113495754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040094d0 con 0x7f47180ba9d0 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f4717fff640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47180ba260 0x7f47181e1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471cada640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4718070db0 0x7f47181455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.375+0000 7f471d2db640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47180ba9d0 0x7f4718147130 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f471000cc30 tx=0x7f471000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.376+0000 7f47157fa640 1 -- 172.21.15.88:0/4113495754 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471000ce40 con 0x7f47180ba9d0 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.376+0000 7f47157fa640 1 -- 172.21.15.88:0/4113495754 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4710003990 con 0x7f47180ba9d0 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.376+0000 7f471ed3e640 1 -- 172.21.15.88:0/4113495754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47180b6830 con 0x7f47180ba9d0 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.376+0000 7f47157fa640 1 -- 172.21.15.88:0/4113495754 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710003d20 con 0x7f47180ba9d0 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.376+0000 7f471ed3e640 1 -- 172.21.15.88:0/4113495754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47181e0f20 con 0x7f47180ba9d0 2024-01-22T10:13:46.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.377+0000 7f471ed3e640 1 -- 172.21.15.88:0/4113495754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471804ea30 con 0x7f47180ba9d0 2024-01-22T10:13:46.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.377+0000 7f47157fa640 1 -- 172.21.15.88:0/4113495754 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f4710003e80 con 0x7f47180ba9d0 2024-01-22T10:13:46.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.377+0000 7f47157fa640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f46fc06b360 0x7f46fc06d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.378+0000 7f47157fa640 1 -- 172.21.15.88:0/4113495754 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4710089ef0 con 0x7f47180ba9d0 2024-01-22T10:13:46.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.378+0000 7f471cada640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f46fc06b360 0x7f46fc06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.378+0000 7f471cada640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f46fc06b360 0x7f46fc06d820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f470c003eb0 tx=0x7f470c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:46.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.382+0000 7f47157fa640 1 -- 172.21.15.88:0/4113495754 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4710054c10 con 0x7f47180ba9d0 2024-01-22T10:13:46.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.545+0000 7f471ed3e640 1 -- 172.21.15.88:0/4113495754 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47180bb680 con 0x7f46fc06b360 2024-01-22T10:13:46.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.552+0000 7f47157fa640 1 -- 172.21.15.88:0/4113495754 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252625 (secure 0 0 0) 0x7f47180bb680 con 0x7f46fc06b360 2024-01-22T10:13:46.537 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:46.539 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-01-22T10:13:46.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.554+0000 7f471ed3e640 1 -- 172.21.15.88:0/4113495754 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f46fc06b360 msgr2=0x7f46fc06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.554+0000 7f471ed3e640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f46fc06b360 0x7f46fc06d820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f470c003eb0 tx=0x7f470c009040 comp rx=0 tx=0).stop 2024-01-22T10:13:46.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.554+0000 7f471ed3e640 1 -- 172.21.15.88:0/4113495754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47180ba9d0 msgr2=0x7f4718147130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.555+0000 7f471ed3e640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47180ba9d0 0x7f4718147130 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f471000cc30 tx=0x7f471000a5c0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.555+0000 7f471ed3e640 1 -- 172.21.15.88:0/4113495754 shutdown_connections 2024-01-22T10:13:46.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.555+0000 7f471ed3e640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f46fc06b360 0x7f46fc06d820 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.555+0000 7f471ed3e640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47180ba260 0x7f47181e1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.555+0000 7f471ed3e640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47180ba9d0 0x7f4718147130 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.555+0000 7f471ed3e640 1 --2- 172.21.15.88:0/4113495754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4718070db0 0x7f47181455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.555+0000 7f471ed3e640 1 -- 172.21.15.88:0/4113495754 >> 172.21.15.88:0/4113495754 conn(0x7f471806b800 msgr2=0x7f47180bd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:46.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.555+0000 7f471ed3e640 1 -- 172.21.15.88:0/4113495754 shutdown_connections 2024-01-22T10:13:46.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.555+0000 7f471ed3e640 1 -- 172.21.15.88:0/4113495754 wait complete. 2024-01-22T10:13:46.545 INFO:tasks.ceph.mds.a.smithi088.stderr:2024-01-22T10:13:46.563+0000 7fdce30c6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-22T10:13:46.548 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-01-22T10:13:44.712977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219604,"kb_used_data":3400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755116,"statfs":{"total":773094113280,"available":772869238784,"internally_reserved":0,"allocated":3481600,"data_stored":2011824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.134455"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.585594+0000","last_change":"2024-01-22T10:13:40.585594+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.585594+0000","last_undegraded":"2024-01-22T10:13:40.585594+0000","last_fullsized":"2024-01-22T10:13:40.585594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.586287+0000","last_change":"2024-01-22T10:13:40.586287+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.586287+0000","last_undegraded":"2024-01-22T10:13:40.586287+0000","last_fullsized":"2024-01-22T10:13:40.586287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.585514+0000","last_change":"2024-01-22T10:13:40.585514+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.585514+0000","last_undegraded":"2024-01-22T10:13:40.585514+0000","last_fullsized":"2024-01-22T10:13:40.585514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.582849+0000","last_change":"2024-01-22T10:13:40.582849+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.582849+0000","last_undegraded":"2024-01-22T10:13:40.582849+0000","last_fullsized":"2024-01-22T10:13:40.582849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.588652+0000","last_change":"2024-01-22T10:13:40.588652+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.588652+0000","last_undegraded":"2024-01-22T10:13:40.588652+0000","last_fullsized":"2024-01-22T10:13:40.588652+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.587714+0000","last_change":"2024-01-22T10:13:40.587714+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.587714+0000","last_undegraded":"2024-01-22T10:13:40.587714+0000","last_fullsized":"2024-01-22T10:13:40.587714+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.585509+0000","last_change":"2024-01-22T10:13:40.585509+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.585509+0000","last_undegraded":"2024-01-22T10:13:40.585509+0000","last_fullsized":"2024-01-22T10:13:40.585509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.587864+0000","last_change":"2024-01-22T10:13:40.587864+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.587864+0000","last_undegraded":"2024-01-22T10:13:40.587864+0000","last_fullsized":"2024-01-22T10:13:40.587864+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.585066+0000","last_change":"2024-01-22T10:13:40.585066+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.585066+0000","last_undegraded":"2024-01-22T10:13:40.585066+0000","last_fullsized":"2024-01-22T10:13:40.585066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.585928+0000","last_change":"2024-01-22T10:13:40.585928+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.585928+0000","last_undegraded":"2024-01-22T10:13:40.585928+0000","last_fullsized":"2024-01-22T10:13:40.585928+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.584740+0000","last_change":"2024-01-22T10:13:40.584740+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.584740+0000","last_undegraded":"2024-01-22T10:13:40.584740+0000","last_fullsized":"2024-01-22T10:13:40.584740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.584964+0000","last_change":"2024-01-22T10:13:40.584964+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.584964+0000","last_undegraded":"2024-01-22T10:13:40.584964+0000","last_fullsized":"2024-01-22T10:13:40.584964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.587758+0000","last_change":"2024-01-22T10:13:40.587758+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.587758+0000","last_undegraded":"2024-01-22T10:13:40.587758+0000","last_fullsized":"2024-01-22T10:13:40.587758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.582091+0000","last_change":"2024-01-22T10:13:40.582091+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.582091+0000","last_undegraded":"2024-01-22T10:13:40.582091+0000","last_fullsized":"2024-01-22T10:13:40.582091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.584933+0000","last_change":"2024-01-22T10:13:40.584933+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.584933+0000","last_undegraded":"2024-01-22T10:13:40.584933+0000","last_fullsized":"2024-01-22T10:13:40.584933+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.584904+0000","last_change":"2024-01-22T10:13:40.584904+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.584904+0000","last_undegraded":"2024-01-22T10:13:40.584904+0000","last_fullsized":"2024-01-22T10:13:40.584904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.581985+0000","last_change":"2024-01-22T10:13:40.581985+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.581985+0000","last_undegraded":"2024-01-22T10:13:40.581985+0000","last_fullsized":"2024-01-22T10:13:40.581985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.587827+0000","last_change":"2024-01-22T10:13:40.587827+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.587827+0000","last_undegraded":"2024-01-22T10:13:40.587827+0000","last_fullsized":"2024-01-22T10:13:40.587827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.588005+0000","last_change":"2024-01-22T10:13:40.588005+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.588005+0000","last_undegraded":"2024-01-22T10:13:40.588005+0000","last_fullsized":"2024-01-22T10:13:40.588005+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.587758+0000","last_change":"2024-01-22T10:13:40.587758+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.587758+0000","last_undegraded":"2024-01-22T10:13:40.587758+0000","last_fullsized":"2024-01-22T10:13:40.587758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.586150+0000","last_change":"2024-01-22T10:13:40.586150+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.586150+0000","last_undegraded":"2024-01-22T10:13:40.586150+0000","last_fullsized":"2024-01-22T10:13:40.586150+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.585254+0000","last_change":"2024-01-22T10:13:40.585254+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.585254+0000","last_undegraded":"2024-01-22T10:13:40.585254+0000","last_fullsized":"2024-01-22T10:13:40.585254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.588662+0000","last_change":"2024-01-22T10:13:40.588662+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.588662+0000","last_undegraded":"2024-01-22T10:13:40.588662+0000","last_fullsized":"2024-01-22T10:13:40.588662+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.584552+0000","last_change":"2024-01-22T10:13:40.584552+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.584552+0000","last_undegraded":"2024-01-22T10:13:40.584552+0000","last_fullsized":"2024-01-22T10:13:40.584552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.581571+0000","last_change":"2024-01-22T10:13:40.581571+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.581571+0000","last_undegraded":"2024-01-22T10:13:40.581571+0000","last_fullsized":"2024-01-22T10:13:40.581571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.585475+0000","last_change":"2024-01-22T10:13:40.585475+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.585475+0000","last_undegraded":"2024-01-22T10:13:40.585475+0000","last_fullsized":"2024-01-22T10:13:40.585475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.581468+0000","last_change":"2024-01-22T10:13:40.581468+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.581468+0000","last_undegraded":"2024-01-22T10:13:40.581468+0000","last_fullsized":"2024-01-22T10:13:40.581468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.585641+0000","last_change":"2024-01-22T10:13:40.585641+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.585641+0000","last_undegraded":"2024-01-22T10:13:40.585641+0000","last_fullsized":"2024-01-22T10:13:40.585641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.581492+0000","last_change":"2024-01-22T10:13:40.581492+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.581492+0000","last_undegraded":"2024-01-22T10:13:40.581492+0000","last_fullsized":"2024-01-22T10:13:40.581492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.587851+0000","last_change":"2024-01-22T10:13:40.587851+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.587851+0000","last_undegraded":"2024-01-22T10:13:40.587851+0000","last_fullsized":"2024-01-22T10:13:40.587851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.584481+0000","last_change":"2024-01-22T10:13:40.584481+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.584481+0000","last_undegraded":"2024-01-22T10:13:40.584481+0000","last_fullsized":"2024-01-22T10:13:40.584481+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-22T10:13:41.578102+0000","last_change":"2024-01-22T10:13:41.578102+0000","last_active":"2024-01-22T10:13:41.578102+0000","last_peered":"2024-01-22T10:13:41.578102+0000","last_clean":"2024-01-22T10:13:41.578102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:41.578102+0000","last_undegraded":"2024-01-22T10:13:41.578102+0000","last_fullsized":"2024-01-22T10:13:41.578102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-01-22T10:13:40.584440+0000","last_change":"2024-01-22T10:13:40.584440+0000","last_active":"2024-01-22T10:13:40.576371+0000","last_peered":"2024-01-22T10:13:40.576371+0000","last_clean":"2024-01-22T10:13:40.576371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-22T10:13:40.584440+0000","last_undegraded":"2024-01-22T10:13:40.584440+0000","last_fullsized":"2024-01-22T10:13:40.584440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-22T10:13:36.580735+0000","last_change":"2024-01-22T10:12:52.033359+0000","last_active":"2024-01-22T10:13:36.580735+0000","last_peered":"2024-01-22T10:13:36.580735+0000","last_clean":"2024-01-22T10:13:36.580735+0000","last_became_active":"2024-01-22T10:12:52.033101+0000","last_became_peered":"2024-01-22T10:12:52.033101+0000","last_unstale":"2024-01-22T10:13:36.580735+0000","last_undegraded":"2024-01-22T10:13:36.580735+0000","last_fullsized":"2024-01-22T10:13:36.580735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_clean_scrub_stamp":"2024-01-22T10:12:51.022957+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:45:37.023233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":694254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":103886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":103886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":103886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":103886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":103886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":103886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":694254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T10:13:46.553 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T10:13:46.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.706+0000 7f201a8bb640 1 Processor -- start 2024-01-22T10:13:46.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.706+0000 7f201a8bb640 1 -- start start 2024-01-22T10:13:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f201a8bb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201406d2b0 0x7f201414bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f201a8bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f201406baa0 0x7f201406bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f201a8bb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201414b700 con 0x7f20140a40c0 2024-01-22T10:13:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f201a8bb640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201406f340 con 0x7f201406baa0 2024-01-22T10:13:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f201a8bb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201406de90 con 0x7f201406d2b0 2024-01-22T10:13:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f20137fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f201406baa0 0x7f201406bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f2018e58640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f20140a40c0 0x7f201414ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33572/0 (socket says 172.21.15.88:33572) 2024-01-22T10:13:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f2018e58640 1 -- 172.21.15.88:0/3895427289 learned_addr learned my addr 172.21.15.88:0/3895427289 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f20137fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f201406baa0 0x7f201406bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47906/0 (socket says 172.21.15.88:47906) 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f2013fff640 1 --2- 172.21.15.88:0/3895427289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201406d2b0 0x7f201414bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f20137fe640 1 -- 172.21.15.88:0/3895427289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201406d2b0 msgr2=0x7f201414bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f20137fe640 1 --2- 172.21.15.88:0/3895427289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201406d2b0 0x7f201414bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f20137fe640 1 -- 172.21.15.88:0/3895427289 >> v1:172.21.15.88:6789/0 conn(0x7f20140a40c0 legacy=0x7f201414ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f20137fe640 1 -- 172.21.15.88:0/3895427289 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201406f5e0 con 0x7f201406baa0 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.707+0000 7f2012ffd640 1 -- 172.21.15.88:0/3895427289 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231086563 0 0) 0x7f201414b700 con 0x7f20140a40c0 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.708+0000 7f20137fe640 1 --2- 172.21.15.88:0/3895427289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f201406baa0 0x7f201406bee0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f20040097a0 tx=0x7f200402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf88b172705447f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.708+0000 7f2012ffd640 1 -- 172.21.15.88:0/3895427289 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004031830 con 0x7f201406baa0 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.708+0000 7f2012ffd640 1 -- 172.21.15.88:0/3895427289 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2004031990 con 0x7f201406baa0 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.708+0000 7f2012ffd640 1 -- 172.21.15.88:0/3895427289 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004031d20 con 0x7f201406baa0 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.708+0000 7f201a8bb640 1 -- 172.21.15.88:0/3895427289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f201406baa0 msgr2=0x7f201406bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.708+0000 7f201a8bb640 1 --2- 172.21.15.88:0/3895427289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f201406baa0 0x7f201406bee0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f20040097a0 tx=0x7f200402b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.708+0000 7f201a8bb640 1 -- 172.21.15.88:0/3895427289 shutdown_connections 2024-01-22T10:13:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.708+0000 7f201a8bb640 1 --2- 172.21.15.88:0/3895427289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f201406baa0 0x7f201406bee0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.708+0000 7f201a8bb640 1 --2- 172.21.15.88:0/3895427289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201406d2b0 0x7f201414bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.708+0000 7f201a8bb640 1 -- 172.21.15.88:0/3895427289 >> 172.21.15.88:0/3895427289 conn(0x7f20140bb8d0 msgr2=0x7f20140bbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:46.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.708+0000 7f201a8bb640 1 -- 172.21.15.88:0/3895427289 shutdown_connections 2024-01-22T10:13:46.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.708+0000 7f201a8bb640 1 -- 172.21.15.88:0/3895427289 wait complete. 2024-01-22T10:13:46.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.709+0000 7f201a8bb640 1 Processor -- start 2024-01-22T10:13:46.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.710+0000 7f201a8bb640 1 -- start start 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.710+0000 7f201a8bb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201406baa0 0x7f20140b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.710+0000 7f201a8bb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201406d2b0 0x7f20141e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.710+0000 7f201a8bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20140a40c0 0x7f2014146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.710+0000 7f201a8bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201413dee0 con 0x7f20140a40c0 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.710+0000 7f201a8bb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20140b5020 con 0x7f201406baa0 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.710+0000 7f201a8bb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2014148a60 con 0x7f201406d2b0 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.710+0000 7f2018e58640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20140a40c0 0x7f2014146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.710+0000 7f2018e58640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20140a40c0 0x7f2014146e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47910/0 (socket says 172.21.15.88:47910) 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.710+0000 7f2018e58640 1 -- 172.21.15.88:0/3227523102 learned_addr learned my addr 172.21.15.88:0/3227523102 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.710+0000 7f2013fff640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201406baa0 0x7f20140b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.710+0000 7f20137fe640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201406d2b0 0x7f20141e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.711+0000 7f2018e58640 1 -- 172.21.15.88:0/3227523102 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201406d2b0 msgr2=0x7f20141e45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.711+0000 7f2018e58640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201406d2b0 0x7f20141e45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.711+0000 7f2018e58640 1 -- 172.21.15.88:0/3227523102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201406baa0 msgr2=0x7f20140b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.711+0000 7f2018e58640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201406baa0 0x7f20140b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.711+0000 7f2018e58640 1 -- 172.21.15.88:0/3227523102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2004009400 con 0x7f20140a40c0 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.711+0000 7f2013fff640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201406baa0 0x7f20140b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.711+0000 7f2018e58640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20140a40c0 0x7f2014146e90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f200c00c700 tx=0x7f200c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.711+0000 7f2010ff9640 1 -- 172.21.15.88:0/3227523102 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00ce10 con 0x7f20140a40c0 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.711+0000 7f2010ff9640 1 -- 172.21.15.88:0/3227523102 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c00a640 con 0x7f20140a40c0 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.711+0000 7f201a8bb640 1 -- 172.21.15.88:0/3227523102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2014148d40 con 0x7f20140a40c0 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.711+0000 7f2010ff9640 1 -- 172.21.15.88:0/3227523102 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00aa70 con 0x7f20140a40c0 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.711+0000 7f201a8bb640 1 -- 172.21.15.88:0/3227523102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20141462a0 con 0x7f20140a40c0 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.712+0000 7f201a8bb640 1 -- 172.21.15.88:0/3227523102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2014067c40 con 0x7f20140a40c0 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.712+0000 7f2010ff9640 1 -- 172.21.15.88:0/3227523102 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f200c00abd0 con 0x7f20140a40c0 2024-01-22T10:13:46.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.713+0000 7f2010ff9640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f200006b360 0x7f200006d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:46.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.713+0000 7f2010ff9640 1 -- 172.21.15.88:0/3227523102 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f200c0892d0 con 0x7f20140a40c0 2024-01-22T10:13:46.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.713+0000 7f2013fff640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f200006b360 0x7f200006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:46.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.713+0000 7f2013fff640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f200006b360 0x7f200006d820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f200800a9d0 tx=0x7f2008008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:46.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.717+0000 7f2010ff9640 1 -- 172.21.15.88:0/3227523102 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f200c053f60 con 0x7f20140a40c0 2024-01-22T10:13:46.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.882+0000 7f201a8bb640 1 -- 172.21.15.88:0/3227523102 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f201406fe80 con 0x7f200006b360 2024-01-22T10:13:46.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.888+0000 7f2010ff9640 1 -- 172.21.15.88:0/3227523102 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264706 (secure 0 0 0) 0x7f200800a750 con 0x7f200006b360 2024-01-22T10:13:46.874 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:46.875 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-01-22T10:13:46.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.891+0000 7f201a8bb640 1 -- 172.21.15.88:0/3227523102 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f200006b360 msgr2=0x7f200006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.891+0000 7f201a8bb640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f200006b360 0x7f200006d820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f200800a9d0 tx=0x7f2008008040 comp rx=0 tx=0).stop 2024-01-22T10:13:46.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.891+0000 7f201a8bb640 1 -- 172.21.15.88:0/3227523102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20140a40c0 msgr2=0x7f2014146e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:46.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.891+0000 7f201a8bb640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20140a40c0 0x7f2014146e90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f200c00c700 tx=0x7f200c00cbc0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.892+0000 7f201a8bb640 1 -- 172.21.15.88:0/3227523102 shutdown_connections 2024-01-22T10:13:46.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.892+0000 7f201a8bb640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f200006b360 0x7f200006d820 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.892+0000 7f201a8bb640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201406d2b0 0x7f20141e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.892+0000 7f201a8bb640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20140a40c0 0x7f2014146e90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.892+0000 7f201a8bb640 1 --2- 172.21.15.88:0/3227523102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201406baa0 0x7f20140b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:46.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.892+0000 7f201a8bb640 1 -- 172.21.15.88:0/3227523102 >> 172.21.15.88:0/3227523102 conn(0x7f20140bb8d0 msgr2=0x7f20140b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:46.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.892+0000 7f201a8bb640 1 -- 172.21.15.88:0/3227523102 shutdown_connections 2024-01-22T10:13:46.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:46.892+0000 7f201a8bb640 1 -- 172.21.15.88:0/3227523102 wait complete. 2024-01-22T10:13:46.885 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-01-22T10:13:46.713336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220048,"kb_used_data":3848,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754672,"statfs":{"total":773094113280,"available":772868784128,"internally_reserved":0,"allocated":3940352,"data_stored":2217916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001013"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986737+0000","last_change":"2024-01-22T10:13:42.628705+0000","last_active":"2024-01-22T10:13:43.986737+0000","last_peered":"2024-01-22T10:13:43.986737+0000","last_clean":"2024-01-22T10:13:43.986737+0000","last_became_active":"2024-01-22T10:13:42.627514+0000","last_became_peered":"2024-01-22T10:13:42.627514+0000","last_unstale":"2024-01-22T10:13:43.986737+0000","last_undegraded":"2024-01-22T10:13:43.986737+0000","last_fullsized":"2024-01-22T10:13:43.986737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624367+0000","last_change":"2024-01-22T10:13:42.623390+0000","last_active":"2024-01-22T10:13:43.624367+0000","last_peered":"2024-01-22T10:13:43.624367+0000","last_clean":"2024-01-22T10:13:43.624367+0000","last_became_active":"2024-01-22T10:13:42.623152+0000","last_became_peered":"2024-01-22T10:13:42.623152+0000","last_unstale":"2024-01-22T10:13:43.624367+0000","last_undegraded":"2024-01-22T10:13:43.624367+0000","last_fullsized":"2024-01-22T10:13:43.624367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:45:45.479717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034543+0000","last_change":"2024-01-22T10:13:42.627502+0000","last_active":"2024-01-22T10:13:44.034543+0000","last_peered":"2024-01-22T10:13:44.034543+0000","last_clean":"2024-01-22T10:13:44.034543+0000","last_became_active":"2024-01-22T10:13:42.627157+0000","last_became_peered":"2024-01-22T10:13:42.627157+0000","last_unstale":"2024-01-22T10:13:44.034543+0000","last_undegraded":"2024-01-22T10:13:44.034543+0000","last_fullsized":"2024-01-22T10:13:44.034543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622679+0000","last_change":"2024-01-22T10:13:42.631690+0000","last_active":"2024-01-22T10:13:43.622679+0000","last_peered":"2024-01-22T10:13:43.622679+0000","last_clean":"2024-01-22T10:13:43.622679+0000","last_became_active":"2024-01-22T10:13:42.630134+0000","last_became_peered":"2024-01-22T10:13:42.630134+0000","last_unstale":"2024-01-22T10:13:43.622679+0000","last_undegraded":"2024-01-22T10:13:43.622679+0000","last_fullsized":"2024-01-22T10:13:43.622679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:00:21.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034028+0000","last_change":"2024-01-22T10:13:42.636628+0000","last_active":"2024-01-22T10:13:44.034028+0000","last_peered":"2024-01-22T10:13:44.034028+0000","last_clean":"2024-01-22T10:13:44.034028+0000","last_became_active":"2024-01-22T10:13:42.636239+0000","last_became_peered":"2024-01-22T10:13:42.636239+0000","last_unstale":"2024-01-22T10:13:44.034028+0000","last_undegraded":"2024-01-22T10:13:44.034028+0000","last_fullsized":"2024-01-22T10:13:44.034028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:44:19.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624118+0000","last_change":"2024-01-22T10:13:42.621975+0000","last_active":"2024-01-22T10:13:43.624118+0000","last_peered":"2024-01-22T10:13:43.624118+0000","last_clean":"2024-01-22T10:13:43.624118+0000","last_became_active":"2024-01-22T10:13:42.621590+0000","last_became_peered":"2024-01-22T10:13:42.621590+0000","last_unstale":"2024-01-22T10:13:43.624118+0000","last_undegraded":"2024-01-22T10:13:43.624118+0000","last_fullsized":"2024-01-22T10:13:43.624118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624659+0000","last_change":"2024-01-22T10:13:42.617901+0000","last_active":"2024-01-22T10:13:43.624659+0000","last_peered":"2024-01-22T10:13:43.624659+0000","last_clean":"2024-01-22T10:13:43.624659+0000","last_became_active":"2024-01-22T10:13:42.617384+0000","last_became_peered":"2024-01-22T10:13:42.617384+0000","last_unstale":"2024-01-22T10:13:43.624659+0000","last_undegraded":"2024-01-22T10:13:43.624659+0000","last_fullsized":"2024-01-22T10:13:43.624659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624647+0000","last_change":"2024-01-22T10:13:42.622490+0000","last_active":"2024-01-22T10:13:43.624647+0000","last_peered":"2024-01-22T10:13:43.624647+0000","last_clean":"2024-01-22T10:13:43.624647+0000","last_became_active":"2024-01-22T10:13:42.622220+0000","last_became_peered":"2024-01-22T10:13:42.622220+0000","last_unstale":"2024-01-22T10:13:43.624647+0000","last_undegraded":"2024-01-22T10:13:43.624647+0000","last_fullsized":"2024-01-22T10:13:43.624647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035496+0000","last_change":"2024-01-22T10:13:42.635502+0000","last_active":"2024-01-22T10:13:44.035496+0000","last_peered":"2024-01-22T10:13:44.035496+0000","last_clean":"2024-01-22T10:13:44.035496+0000","last_became_active":"2024-01-22T10:13:42.635312+0000","last_became_peered":"2024-01-22T10:13:42.635312+0000","last_unstale":"2024-01-22T10:13:44.035496+0000","last_undegraded":"2024-01-22T10:13:44.035496+0000","last_fullsized":"2024-01-22T10:13:44.035496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:19:17.630353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622947+0000","last_change":"2024-01-22T10:13:42.635158+0000","last_active":"2024-01-22T10:13:43.622947+0000","last_peered":"2024-01-22T10:13:43.622947+0000","last_clean":"2024-01-22T10:13:43.622947+0000","last_became_active":"2024-01-22T10:13:42.634191+0000","last_became_peered":"2024-01-22T10:13:42.634191+0000","last_unstale":"2024-01-22T10:13:43.622947+0000","last_undegraded":"2024-01-22T10:13:43.622947+0000","last_fullsized":"2024-01-22T10:13:43.622947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:17.709645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624931+0000","last_change":"2024-01-22T10:13:42.621049+0000","last_active":"2024-01-22T10:13:43.624931+0000","last_peered":"2024-01-22T10:13:43.624931+0000","last_clean":"2024-01-22T10:13:43.624931+0000","last_became_active":"2024-01-22T10:13:42.620763+0000","last_became_peered":"2024-01-22T10:13:42.620763+0000","last_unstale":"2024-01-22T10:13:43.624931+0000","last_undegraded":"2024-01-22T10:13:43.624931+0000","last_fullsized":"2024-01-22T10:13:43.624931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:45:45.479717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034352+0000","last_change":"2024-01-22T10:13:42.634597+0000","last_active":"2024-01-22T10:13:44.034352+0000","last_peered":"2024-01-22T10:13:44.034352+0000","last_clean":"2024-01-22T10:13:44.034352+0000","last_became_active":"2024-01-22T10:13:42.634366+0000","last_became_peered":"2024-01-22T10:13:42.634366+0000","last_unstale":"2024-01-22T10:13:44.034352+0000","last_undegraded":"2024-01-22T10:13:44.034352+0000","last_fullsized":"2024-01-22T10:13:44.034352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034137+0000","last_change":"2024-01-22T10:13:42.624821+0000","last_active":"2024-01-22T10:13:44.034137+0000","last_peered":"2024-01-22T10:13:44.034137+0000","last_clean":"2024-01-22T10:13:44.034137+0000","last_became_active":"2024-01-22T10:13:42.624548+0000","last_became_peered":"2024-01-22T10:13:42.624548+0000","last_unstale":"2024-01-22T10:13:44.034137+0000","last_undegraded":"2024-01-22T10:13:44.034137+0000","last_fullsized":"2024-01-22T10:13:44.034137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:26.195084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624093+0000","last_change":"2024-01-22T10:13:42.625911+0000","last_active":"2024-01-22T10:13:43.624093+0000","last_peered":"2024-01-22T10:13:43.624093+0000","last_clean":"2024-01-22T10:13:43.624093+0000","last_became_active":"2024-01-22T10:13:42.625647+0000","last_became_peered":"2024-01-22T10:13:42.625647+0000","last_unstale":"2024-01-22T10:13:43.624093+0000","last_undegraded":"2024-01-22T10:13:43.624093+0000","last_fullsized":"2024-01-22T10:13:43.624093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034305+0000","last_change":"2024-01-22T10:13:42.621130+0000","last_active":"2024-01-22T10:13:44.034305+0000","last_peered":"2024-01-22T10:13:44.034305+0000","last_clean":"2024-01-22T10:13:44.034305+0000","last_became_active":"2024-01-22T10:13:42.620805+0000","last_became_peered":"2024-01-22T10:13:42.620805+0000","last_unstale":"2024-01-22T10:13:44.034305+0000","last_undegraded":"2024-01-22T10:13:44.034305+0000","last_fullsized":"2024-01-22T10:13:44.034305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:20.447342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624819+0000","last_change":"2024-01-22T10:13:42.624267+0000","last_active":"2024-01-22T10:13:43.624819+0000","last_peered":"2024-01-22T10:13:43.624819+0000","last_clean":"2024-01-22T10:13:43.624819+0000","last_became_active":"2024-01-22T10:13:42.623306+0000","last_became_peered":"2024-01-22T10:13:42.623306+0000","last_unstale":"2024-01-22T10:13:43.624819+0000","last_undegraded":"2024-01-22T10:13:43.624819+0000","last_fullsized":"2024-01-22T10:13:43.624819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:55.572047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.625077+0000","last_change":"2024-01-22T10:13:42.617345+0000","last_active":"2024-01-22T10:13:43.625077+0000","last_peered":"2024-01-22T10:13:43.625077+0000","last_clean":"2024-01-22T10:13:43.625077+0000","last_became_active":"2024-01-22T10:13:42.617072+0000","last_became_peered":"2024-01-22T10:13:42.617072+0000","last_unstale":"2024-01-22T10:13:43.625077+0000","last_undegraded":"2024-01-22T10:13:43.625077+0000","last_fullsized":"2024-01-22T10:13:43.625077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:08:00.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624439+0000","last_change":"2024-01-22T10:13:42.625193+0000","last_active":"2024-01-22T10:13:43.624439+0000","last_peered":"2024-01-22T10:13:43.624439+0000","last_clean":"2024-01-22T10:13:43.624439+0000","last_became_active":"2024-01-22T10:13:42.624862+0000","last_became_peered":"2024-01-22T10:13:42.624862+0000","last_unstale":"2024-01-22T10:13:43.624439+0000","last_undegraded":"2024-01-22T10:13:43.624439+0000","last_fullsized":"2024-01-22T10:13:43.624439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:08:00.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624133+0000","last_change":"2024-01-22T10:13:42.626004+0000","last_active":"2024-01-22T10:13:43.624133+0000","last_peered":"2024-01-22T10:13:43.624133+0000","last_clean":"2024-01-22T10:13:43.624133+0000","last_became_active":"2024-01-22T10:13:42.625078+0000","last_became_peered":"2024-01-22T10:13:42.625078+0000","last_unstale":"2024-01-22T10:13:43.624133+0000","last_undegraded":"2024-01-22T10:13:43.624133+0000","last_fullsized":"2024-01-22T10:13:43.624133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034290+0000","last_change":"2024-01-22T10:13:42.626913+0000","last_active":"2024-01-22T10:13:44.034290+0000","last_peered":"2024-01-22T10:13:44.034290+0000","last_clean":"2024-01-22T10:13:44.034290+0000","last_became_active":"2024-01-22T10:13:42.626641+0000","last_became_peered":"2024-01-22T10:13:42.626641+0000","last_unstale":"2024-01-22T10:13:44.034290+0000","last_undegraded":"2024-01-22T10:13:44.034290+0000","last_fullsized":"2024-01-22T10:13:44.034290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:48.542860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035305+0000","last_change":"2024-01-22T10:13:42.626420+0000","last_active":"2024-01-22T10:13:44.035305+0000","last_peered":"2024-01-22T10:13:44.035305+0000","last_clean":"2024-01-22T10:13:44.035305+0000","last_became_active":"2024-01-22T10:13:42.626133+0000","last_became_peered":"2024-01-22T10:13:42.626133+0000","last_unstale":"2024-01-22T10:13:44.035305+0000","last_undegraded":"2024-01-22T10:13:44.035305+0000","last_fullsized":"2024-01-22T10:13:44.035305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:33:09.287996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035119+0000","last_change":"2024-01-22T10:13:42.637449+0000","last_active":"2024-01-22T10:13:44.035119+0000","last_peered":"2024-01-22T10:13:44.035119+0000","last_clean":"2024-01-22T10:13:44.035119+0000","last_became_active":"2024-01-22T10:13:42.637144+0000","last_became_peered":"2024-01-22T10:13:42.637144+0000","last_unstale":"2024-01-22T10:13:44.035119+0000","last_undegraded":"2024-01-22T10:13:44.035119+0000","last_fullsized":"2024-01-22T10:13:44.035119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:09.341746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033847+0000","last_change":"2024-01-22T10:13:42.623905+0000","last_active":"2024-01-22T10:13:44.033847+0000","last_peered":"2024-01-22T10:13:44.033847+0000","last_clean":"2024-01-22T10:13:44.033847+0000","last_became_active":"2024-01-22T10:13:42.623652+0000","last_became_peered":"2024-01-22T10:13:42.623652+0000","last_unstale":"2024-01-22T10:13:44.033847+0000","last_undegraded":"2024-01-22T10:13:44.033847+0000","last_fullsized":"2024-01-22T10:13:44.033847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034166+0000","last_change":"2024-01-22T10:13:42.626456+0000","last_active":"2024-01-22T10:13:44.034166+0000","last_peered":"2024-01-22T10:13:44.034166+0000","last_clean":"2024-01-22T10:13:44.034166+0000","last_became_active":"2024-01-22T10:13:42.626193+0000","last_became_peered":"2024-01-22T10:13:42.626193+0000","last_unstale":"2024-01-22T10:13:44.034166+0000","last_undegraded":"2024-01-22T10:13:44.034166+0000","last_fullsized":"2024-01-22T10:13:44.034166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:17.709645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622986+0000","last_change":"2024-01-22T10:13:42.619961+0000","last_active":"2024-01-22T10:13:43.622986+0000","last_peered":"2024-01-22T10:13:43.622986+0000","last_clean":"2024-01-22T10:13:43.622986+0000","last_became_active":"2024-01-22T10:13:42.619484+0000","last_became_peered":"2024-01-22T10:13:42.619484+0000","last_unstale":"2024-01-22T10:13:43.622986+0000","last_undegraded":"2024-01-22T10:13:43.622986+0000","last_fullsized":"2024-01-22T10:13:43.622986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624437+0000","last_change":"2024-01-22T10:13:42.621000+0000","last_active":"2024-01-22T10:13:43.624437+0000","last_peered":"2024-01-22T10:13:43.624437+0000","last_clean":"2024-01-22T10:13:43.624437+0000","last_became_active":"2024-01-22T10:13:42.620624+0000","last_became_peered":"2024-01-22T10:13:42.620624+0000","last_unstale":"2024-01-22T10:13:43.624437+0000","last_undegraded":"2024-01-22T10:13:43.624437+0000","last_fullsized":"2024-01-22T10:13:43.624437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:13.693929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622855+0000","last_change":"2024-01-22T10:13:42.631519+0000","last_active":"2024-01-22T10:13:43.622855+0000","last_peered":"2024-01-22T10:13:43.622855+0000","last_clean":"2024-01-22T10:13:43.622855+0000","last_became_active":"2024-01-22T10:13:42.630812+0000","last_became_peered":"2024-01-22T10:13:42.630812+0000","last_unstale":"2024-01-22T10:13:43.622855+0000","last_undegraded":"2024-01-22T10:13:43.622855+0000","last_fullsized":"2024-01-22T10:13:43.622855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:30:17.081991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034519+0000","last_change":"2024-01-22T10:13:42.624797+0000","last_active":"2024-01-22T10:13:44.034519+0000","last_peered":"2024-01-22T10:13:44.034519+0000","last_clean":"2024-01-22T10:13:44.034519+0000","last_became_active":"2024-01-22T10:13:42.624529+0000","last_became_peered":"2024-01-22T10:13:42.624529+0000","last_unstale":"2024-01-22T10:13:44.034519+0000","last_undegraded":"2024-01-22T10:13:44.034519+0000","last_fullsized":"2024-01-22T10:13:44.034519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035160+0000","last_change":"2024-01-22T10:13:42.637426+0000","last_active":"2024-01-22T10:13:44.035160+0000","last_peered":"2024-01-22T10:13:44.035160+0000","last_clean":"2024-01-22T10:13:44.035160+0000","last_became_active":"2024-01-22T10:13:42.637077+0000","last_became_peered":"2024-01-22T10:13:42.637077+0000","last_unstale":"2024-01-22T10:13:44.035160+0000","last_undegraded":"2024-01-22T10:13:44.035160+0000","last_fullsized":"2024-01-22T10:13:44.035160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:21:10.389082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624648+0000","last_change":"2024-01-22T10:13:42.617414+0000","last_active":"2024-01-22T10:13:43.624648+0000","last_peered":"2024-01-22T10:13:43.624648+0000","last_clean":"2024-01-22T10:13:43.624648+0000","last_became_active":"2024-01-22T10:13:42.617110+0000","last_became_peered":"2024-01-22T10:13:42.617110+0000","last_unstale":"2024-01-22T10:13:43.624648+0000","last_undegraded":"2024-01-22T10:13:43.624648+0000","last_fullsized":"2024-01-22T10:13:43.624648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986570+0000","last_change":"2024-01-22T10:13:42.628627+0000","last_active":"2024-01-22T10:13:43.986570+0000","last_peered":"2024-01-22T10:13:43.986570+0000","last_clean":"2024-01-22T10:13:43.986570+0000","last_became_active":"2024-01-22T10:13:42.628259+0000","last_became_peered":"2024-01-22T10:13:42.628259+0000","last_unstale":"2024-01-22T10:13:43.986570+0000","last_undegraded":"2024-01-22T10:13:43.986570+0000","last_fullsized":"2024-01-22T10:13:43.986570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:49.014219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624513+0000","last_change":"2024-01-22T10:13:42.624473+0000","last_active":"2024-01-22T10:13:43.624513+0000","last_peered":"2024-01-22T10:13:43.624513+0000","last_clean":"2024-01-22T10:13:43.624513+0000","last_became_active":"2024-01-22T10:13:42.623675+0000","last_became_peered":"2024-01-22T10:13:42.623675+0000","last_unstale":"2024-01-22T10:13:43.624513+0000","last_undegraded":"2024-01-22T10:13:43.624513+0000","last_fullsized":"2024-01-22T10:13:43.624513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:00:42.245954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034197+0000","last_change":"2024-01-22T10:13:42.623919+0000","last_active":"2024-01-22T10:13:44.034197+0000","last_peered":"2024-01-22T10:13:44.034197+0000","last_clean":"2024-01-22T10:13:44.034197+0000","last_became_active":"2024-01-22T10:13:42.623680+0000","last_became_peered":"2024-01-22T10:13:42.623680+0000","last_unstale":"2024-01-22T10:13:44.034197+0000","last_undegraded":"2024-01-22T10:13:44.034197+0000","last_fullsized":"2024-01-22T10:13:44.034197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:09.341746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.638092+0000","last_change":"2024-01-22T10:13:41.601272+0000","last_active":"2024-01-22T10:13:42.638092+0000","last_peered":"2024-01-22T10:13:42.638092+0000","last_clean":"2024-01-22T10:13:42.638092+0000","last_became_active":"2024-01-22T10:13:41.600823+0000","last_became_peered":"2024-01-22T10:13:41.600823+0000","last_unstale":"2024-01-22T10:13:42.638092+0000","last_undegraded":"2024-01-22T10:13:42.638092+0000","last_fullsized":"2024-01-22T10:13:42.638092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:25.193353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986817+0000","last_change":"2024-01-22T10:13:42.628954+0000","last_active":"2024-01-22T10:13:43.986817+0000","last_peered":"2024-01-22T10:13:43.986817+0000","last_clean":"2024-01-22T10:13:43.986817+0000","last_became_active":"2024-01-22T10:13:42.626926+0000","last_became_peered":"2024-01-22T10:13:42.626926+0000","last_unstale":"2024-01-22T10:13:43.986817+0000","last_undegraded":"2024-01-22T10:13:43.986817+0000","last_fullsized":"2024-01-22T10:13:43.986817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.629143+0000","last_change":"2024-01-22T10:13:41.598256+0000","last_active":"2024-01-22T10:13:42.629143+0000","last_peered":"2024-01-22T10:13:42.629143+0000","last_clean":"2024-01-22T10:13:42.629143+0000","last_became_active":"2024-01-22T10:13:41.597853+0000","last_became_peered":"2024-01-22T10:13:41.597853+0000","last_unstale":"2024-01-22T10:13:42.629143+0000","last_undegraded":"2024-01-22T10:13:42.629143+0000","last_fullsized":"2024-01-22T10:13:42.629143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:49:40.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035276+0000","last_change":"2024-01-22T10:13:42.637399+0000","last_active":"2024-01-22T10:13:44.035276+0000","last_peered":"2024-01-22T10:13:44.035276+0000","last_clean":"2024-01-22T10:13:44.035276+0000","last_became_active":"2024-01-22T10:13:42.637040+0000","last_became_peered":"2024-01-22T10:13:42.637040+0000","last_unstale":"2024-01-22T10:13:44.035276+0000","last_undegraded":"2024-01-22T10:13:44.035276+0000","last_fullsized":"2024-01-22T10:13:44.035276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:24:30.281721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.636032+0000","last_change":"2024-01-22T10:13:41.594947+0000","last_active":"2024-01-22T10:13:42.636032+0000","last_peered":"2024-01-22T10:13:42.636032+0000","last_clean":"2024-01-22T10:13:42.636032+0000","last_became_active":"2024-01-22T10:13:41.594297+0000","last_became_peered":"2024-01-22T10:13:41.594297+0000","last_unstale":"2024-01-22T10:13:42.636032+0000","last_undegraded":"2024-01-22T10:13:42.636032+0000","last_fullsized":"2024-01-22T10:13:42.636032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:08.340015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622980+0000","last_change":"2024-01-22T10:13:42.631105+0000","last_active":"2024-01-22T10:13:43.622980+0000","last_peered":"2024-01-22T10:13:43.622980+0000","last_clean":"2024-01-22T10:13:43.622980+0000","last_became_active":"2024-01-22T10:13:42.630434+0000","last_became_peered":"2024-01-22T10:13:42.630434+0000","last_unstale":"2024-01-22T10:13:43.622980+0000","last_undegraded":"2024-01-22T10:13:43.622980+0000","last_fullsized":"2024-01-22T10:13:43.622980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:20.447342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635390+0000","last_change":"2024-01-22T10:13:41.595358+0000","last_active":"2024-01-22T10:13:42.635390+0000","last_peered":"2024-01-22T10:13:42.635390+0000","last_clean":"2024-01-22T10:13:42.635390+0000","last_became_active":"2024-01-22T10:13:41.595111+0000","last_became_peered":"2024-01-22T10:13:41.595111+0000","last_unstale":"2024-01-22T10:13:42.635390+0000","last_undegraded":"2024-01-22T10:13:42.635390+0000","last_fullsized":"2024-01-22T10:13:42.635390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:42:01.516366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624715+0000","last_change":"2024-01-22T10:13:42.623899+0000","last_active":"2024-01-22T10:13:43.624715+0000","last_peered":"2024-01-22T10:13:43.624715+0000","last_clean":"2024-01-22T10:13:43.624715+0000","last_became_active":"2024-01-22T10:13:42.623634+0000","last_became_peered":"2024-01-22T10:13:42.623634+0000","last_unstale":"2024-01-22T10:13:43.624715+0000","last_undegraded":"2024-01-22T10:13:43.624715+0000","last_fullsized":"2024-01-22T10:13:43.624715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640552+0000","last_change":"2024-01-22T10:13:41.598117+0000","last_active":"2024-01-22T10:13:42.640552+0000","last_peered":"2024-01-22T10:13:42.640552+0000","last_clean":"2024-01-22T10:13:42.640552+0000","last_became_active":"2024-01-22T10:13:41.597046+0000","last_became_peered":"2024-01-22T10:13:41.597046+0000","last_unstale":"2024-01-22T10:13:42.640552+0000","last_undegraded":"2024-01-22T10:13:42.640552+0000","last_fullsized":"2024-01-22T10:13:42.640552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:44.239736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034430+0000","last_change":"2024-01-22T10:13:42.624025+0000","last_active":"2024-01-22T10:13:44.034430+0000","last_peered":"2024-01-22T10:13:44.034430+0000","last_clean":"2024-01-22T10:13:44.034430+0000","last_became_active":"2024-01-22T10:13:42.623760+0000","last_became_peered":"2024-01-22T10:13:42.623760+0000","last_unstale":"2024-01-22T10:13:44.034430+0000","last_undegraded":"2024-01-22T10:13:44.034430+0000","last_fullsized":"2024-01-22T10:13:44.034430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637438+0000","last_change":"2024-01-22T10:13:41.597237+0000","last_active":"2024-01-22T10:13:42.637438+0000","last_peered":"2024-01-22T10:13:42.637438+0000","last_clean":"2024-01-22T10:13:42.637438+0000","last_became_active":"2024-01-22T10:13:41.596938+0000","last_became_peered":"2024-01-22T10:13:41.596938+0000","last_unstale":"2024-01-22T10:13:42.637438+0000","last_undegraded":"2024-01-22T10:13:42.637438+0000","last_fullsized":"2024-01-22T10:13:42.637438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:25.193353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034876+0000","last_change":"2024-01-22T10:13:42.622658+0000","last_active":"2024-01-22T10:13:44.034876+0000","last_peered":"2024-01-22T10:13:44.034876+0000","last_clean":"2024-01-22T10:13:44.034876+0000","last_became_active":"2024-01-22T10:13:42.622398+0000","last_became_peered":"2024-01-22T10:13:42.622398+0000","last_unstale":"2024-01-22T10:13:44.034876+0000","last_undegraded":"2024-01-22T10:13:44.034876+0000","last_fullsized":"2024-01-22T10:13:44.034876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.610874+0000","last_change":"2024-01-22T10:13:41.593515+0000","last_active":"2024-01-22T10:13:42.610874+0000","last_peered":"2024-01-22T10:13:42.610874+0000","last_clean":"2024-01-22T10:13:42.610874+0000","last_became_active":"2024-01-22T10:13:41.593248+0000","last_became_peered":"2024-01-22T10:13:41.593248+0000","last_unstale":"2024-01-22T10:13:42.610874+0000","last_undegraded":"2024-01-22T10:13:42.610874+0000","last_fullsized":"2024-01-22T10:13:42.610874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:48.475424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622556+0000","last_change":"2024-01-22T10:13:42.630318+0000","last_active":"2024-01-22T10:13:43.622556+0000","last_peered":"2024-01-22T10:13:43.622556+0000","last_clean":"2024-01-22T10:13:43.622556+0000","last_became_active":"2024-01-22T10:13:42.623690+0000","last_became_peered":"2024-01-22T10:13:42.623690+0000","last_unstale":"2024-01-22T10:13:43.622556+0000","last_undegraded":"2024-01-22T10:13:43.622556+0000","last_fullsized":"2024-01-22T10:13:43.622556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:33:09.287996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621953+0000","last_change":"2024-01-22T10:13:41.601278+0000","last_active":"2024-01-22T10:13:42.621953+0000","last_peered":"2024-01-22T10:13:42.621953+0000","last_clean":"2024-01-22T10:13:42.621953+0000","last_became_active":"2024-01-22T10:13:41.601016+0000","last_became_peered":"2024-01-22T10:13:41.601016+0000","last_unstale":"2024-01-22T10:13:42.621953+0000","last_undegraded":"2024-01-22T10:13:42.621953+0000","last_fullsized":"2024-01-22T10:13:42.621953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:44:18.938485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034523+0000","last_change":"2024-01-22T10:13:42.633673+0000","last_active":"2024-01-22T10:13:44.034523+0000","last_peered":"2024-01-22T10:13:44.034523+0000","last_clean":"2024-01-22T10:13:44.034523+0000","last_became_active":"2024-01-22T10:13:42.633419+0000","last_became_peered":"2024-01-22T10:13:42.633419+0000","last_unstale":"2024-01-22T10:13:44.034523+0000","last_undegraded":"2024-01-22T10:13:44.034523+0000","last_fullsized":"2024-01-22T10:13:44.034523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.609891+0000","last_change":"2024-01-22T10:13:41.599944+0000","last_active":"2024-01-22T10:13:42.609891+0000","last_peered":"2024-01-22T10:13:42.609891+0000","last_clean":"2024-01-22T10:13:42.609891+0000","last_became_active":"2024-01-22T10:13:41.599658+0000","last_became_peered":"2024-01-22T10:13:41.599658+0000","last_unstale":"2024-01-22T10:13:42.609891+0000","last_undegraded":"2024-01-22T10:13:42.609891+0000","last_fullsized":"2024-01-22T10:13:42.609891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:48.012488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624289+0000","last_change":"2024-01-22T10:13:42.624509+0000","last_active":"2024-01-22T10:13:43.624289+0000","last_peered":"2024-01-22T10:13:43.624289+0000","last_clean":"2024-01-22T10:13:43.624289+0000","last_became_active":"2024-01-22T10:13:42.624258+0000","last_became_peered":"2024-01-22T10:13:42.624258+0000","last_unstale":"2024-01-22T10:13:43.624289+0000","last_undegraded":"2024-01-22T10:13:43.624289+0000","last_fullsized":"2024-01-22T10:13:43.624289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614510+0000","last_change":"2024-01-22T10:13:41.603096+0000","last_active":"2024-01-22T10:13:42.614510+0000","last_peered":"2024-01-22T10:13:42.614510+0000","last_clean":"2024-01-22T10:13:42.614510+0000","last_became_active":"2024-01-22T10:13:41.602525+0000","last_became_peered":"2024-01-22T10:13:41.602525+0000","last_unstale":"2024-01-22T10:13:42.614510+0000","last_undegraded":"2024-01-22T10:13:42.614510+0000","last_fullsized":"2024-01-22T10:13:42.614510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624219+0000","last_change":"2024-01-22T10:13:42.615910+0000","last_active":"2024-01-22T10:13:43.624219+0000","last_peered":"2024-01-22T10:13:43.624219+0000","last_clean":"2024-01-22T10:13:43.624219+0000","last_became_active":"2024-01-22T10:13:42.615658+0000","last_became_peered":"2024-01-22T10:13:42.615658+0000","last_unstale":"2024-01-22T10:13:43.624219+0000","last_undegraded":"2024-01-22T10:13:43.624219+0000","last_fullsized":"2024-01-22T10:13:43.624219+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.632230+0000","last_change":"2024-01-22T10:13:41.599287+0000","last_active":"2024-01-22T10:13:42.632230+0000","last_peered":"2024-01-22T10:13:42.632230+0000","last_clean":"2024-01-22T10:13:42.632230+0000","last_became_active":"2024-01-22T10:13:41.598984+0000","last_became_peered":"2024-01-22T10:13:41.598984+0000","last_unstale":"2024-01-22T10:13:42.632230+0000","last_undegraded":"2024-01-22T10:13:42.632230+0000","last_fullsized":"2024-01-22T10:13:42.632230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:48.012488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034398+0000","last_change":"2024-01-22T10:13:42.627844+0000","last_active":"2024-01-22T10:13:44.034398+0000","last_peered":"2024-01-22T10:13:44.034398+0000","last_clean":"2024-01-22T10:13:44.034398+0000","last_became_active":"2024-01-22T10:13:42.626619+0000","last_became_peered":"2024-01-22T10:13:42.626619+0000","last_unstale":"2024-01-22T10:13:44.034398+0000","last_undegraded":"2024-01-22T10:13:44.034398+0000","last_fullsized":"2024-01-22T10:13:44.034398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:00:42.245954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'6","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.642813+0000","last_change":"2024-01-22T10:13:41.596903+0000","last_active":"2024-01-22T10:13:42.642813+0000","last_peered":"2024-01-22T10:13:42.642813+0000","last_clean":"2024-01-22T10:13:42.642813+0000","last_became_active":"2024-01-22T10:13:41.596658+0000","last_became_peered":"2024-01-22T10:13:41.596658+0000","last_unstale":"2024-01-22T10:13:42.642813+0000","last_undegraded":"2024-01-22T10:13:42.642813+0000","last_fullsized":"2024-01-22T10:13:42.642813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T22:02:40.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622560+0000","last_change":"2024-01-22T10:13:42.627496+0000","last_active":"2024-01-22T10:13:43.622560+0000","last_peered":"2024-01-22T10:13:43.622560+0000","last_clean":"2024-01-22T10:13:43.622560+0000","last_became_active":"2024-01-22T10:13:42.627194+0000","last_became_peered":"2024-01-22T10:13:42.627194+0000","last_unstale":"2024-01-22T10:13:43.622560+0000","last_undegraded":"2024-01-22T10:13:43.622560+0000","last_fullsized":"2024-01-22T10:13:43.622560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:24:30.281721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640785+0000","last_change":"2024-01-22T10:13:41.602468+0000","last_active":"2024-01-22T10:13:42.640785+0000","last_peered":"2024-01-22T10:13:42.640785+0000","last_clean":"2024-01-22T10:13:42.640785+0000","last_became_active":"2024-01-22T10:13:41.602166+0000","last_became_peered":"2024-01-22T10:13:41.602166+0000","last_unstale":"2024-01-22T10:13:42.640785+0000","last_undegraded":"2024-01-22T10:13:42.640785+0000","last_fullsized":"2024-01-22T10:13:42.640785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:47.541129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624319+0000","last_change":"2024-01-22T10:13:42.624284+0000","last_active":"2024-01-22T10:13:43.624319+0000","last_peered":"2024-01-22T10:13:43.624319+0000","last_clean":"2024-01-22T10:13:43.624319+0000","last_became_active":"2024-01-22T10:13:42.623996+0000","last_became_peered":"2024-01-22T10:13:42.623996+0000","last_unstale":"2024-01-22T10:13:43.624319+0000","last_undegraded":"2024-01-22T10:13:43.624319+0000","last_fullsized":"2024-01-22T10:13:43.624319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:55.572047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.611919+0000","last_change":"2024-01-22T10:13:41.596625+0000","last_active":"2024-01-22T10:13:42.611919+0000","last_peered":"2024-01-22T10:13:42.611919+0000","last_clean":"2024-01-22T10:13:42.611919+0000","last_became_active":"2024-01-22T10:13:41.596376+0000","last_became_peered":"2024-01-22T10:13:41.596376+0000","last_unstale":"2024-01-22T10:13:42.611919+0000","last_undegraded":"2024-01-22T10:13:42.611919+0000","last_fullsized":"2024-01-22T10:13:42.611919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:49:40.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624720+0000","last_change":"2024-01-22T10:13:42.624678+0000","last_active":"2024-01-22T10:13:43.624720+0000","last_peered":"2024-01-22T10:13:43.624720+0000","last_clean":"2024-01-22T10:13:43.624720+0000","last_became_active":"2024-01-22T10:13:42.624005+0000","last_became_peered":"2024-01-22T10:13:42.624005+0000","last_unstale":"2024-01-22T10:13:43.624720+0000","last_undegraded":"2024-01-22T10:13:43.624720+0000","last_fullsized":"2024-01-22T10:13:43.624720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.611000+0000","last_change":"2024-01-22T10:13:41.597383+0000","last_active":"2024-01-22T10:13:42.611000+0000","last_peered":"2024-01-22T10:13:42.611000+0000","last_clean":"2024-01-22T10:13:42.611000+0000","last_became_active":"2024-01-22T10:13:41.597155+0000","last_became_peered":"2024-01-22T10:13:41.597155+0000","last_unstale":"2024-01-22T10:13:42.611000+0000","last_undegraded":"2024-01-22T10:13:42.611000+0000","last_fullsized":"2024-01-22T10:13:42.611000+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:32.767529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986697+0000","last_change":"2024-01-22T10:13:42.625547+0000","last_active":"2024-01-22T10:13:43.986697+0000","last_peered":"2024-01-22T10:13:43.986697+0000","last_clean":"2024-01-22T10:13:43.986697+0000","last_became_active":"2024-01-22T10:13:42.625291+0000","last_became_peered":"2024-01-22T10:13:42.625291+0000","last_unstale":"2024-01-22T10:13:43.986697+0000","last_undegraded":"2024-01-22T10:13:43.986697+0000","last_fullsized":"2024-01-22T10:13:43.986697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:23:18.919792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635796+0000","last_change":"2024-01-22T10:13:41.595957+0000","last_active":"2024-01-22T10:13:42.635796+0000","last_peered":"2024-01-22T10:13:42.635796+0000","last_clean":"2024-01-22T10:13:42.635796+0000","last_became_active":"2024-01-22T10:13:41.594410+0000","last_became_peered":"2024-01-22T10:13:41.594410+0000","last_unstale":"2024-01-22T10:13:42.635796+0000","last_undegraded":"2024-01-22T10:13:42.635796+0000","last_fullsized":"2024-01-22T10:13:42.635796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:22:33.851960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035330+0000","last_change":"2024-01-22T10:13:42.633175+0000","last_active":"2024-01-22T10:13:44.035330+0000","last_peered":"2024-01-22T10:13:44.035330+0000","last_clean":"2024-01-22T10:13:44.035330+0000","last_became_active":"2024-01-22T10:13:42.632877+0000","last_became_peered":"2024-01-22T10:13:42.632877+0000","last_unstale":"2024-01-22T10:13:44.035330+0000","last_undegraded":"2024-01-22T10:13:44.035330+0000","last_fullsized":"2024-01-22T10:13:44.035330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:00:21.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637591+0000","last_change":"2024-01-22T10:13:41.595203+0000","last_active":"2024-01-22T10:13:42.637591+0000","last_peered":"2024-01-22T10:13:42.637591+0000","last_clean":"2024-01-22T10:13:42.637591+0000","last_became_active":"2024-01-22T10:13:41.594555+0000","last_became_peered":"2024-01-22T10:13:41.594555+0000","last_unstale":"2024-01-22T10:13:42.637591+0000","last_undegraded":"2024-01-22T10:13:42.637591+0000","last_fullsized":"2024-01-22T10:13:42.637591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034639+0000","last_change":"2024-01-22T10:13:42.630113+0000","last_active":"2024-01-22T10:13:44.034639+0000","last_peered":"2024-01-22T10:13:44.034639+0000","last_clean":"2024-01-22T10:13:44.034639+0000","last_became_active":"2024-01-22T10:13:42.629837+0000","last_became_peered":"2024-01-22T10:13:42.629837+0000","last_unstale":"2024-01-22T10:13:44.034639+0000","last_undegraded":"2024-01-22T10:13:44.034639+0000","last_fullsized":"2024-01-22T10:13:44.034639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635198+0000","last_change":"2024-01-22T10:13:41.602980+0000","last_active":"2024-01-22T10:13:42.635198+0000","last_peered":"2024-01-22T10:13:42.635198+0000","last_clean":"2024-01-22T10:13:42.635198+0000","last_became_active":"2024-01-22T10:13:41.602710+0000","last_became_peered":"2024-01-22T10:13:41.602710+0000","last_unstale":"2024-01-22T10:13:42.635198+0000","last_undegraded":"2024-01-22T10:13:42.635198+0000","last_fullsized":"2024-01-22T10:13:42.635198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622803+0000","last_change":"2024-01-22T10:13:42.629784+0000","last_active":"2024-01-22T10:13:43.622803+0000","last_peered":"2024-01-22T10:13:43.622803+0000","last_clean":"2024-01-22T10:13:43.622803+0000","last_became_active":"2024-01-22T10:13:42.629488+0000","last_became_peered":"2024-01-22T10:13:42.629488+0000","last_unstale":"2024-01-22T10:13:43.622803+0000","last_undegraded":"2024-01-22T10:13:43.622803+0000","last_fullsized":"2024-01-22T10:13:43.622803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:19:17.630353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637429+0000","last_change":"2024-01-22T10:13:41.599558+0000","last_active":"2024-01-22T10:13:42.637429+0000","last_peered":"2024-01-22T10:13:42.637429+0000","last_clean":"2024-01-22T10:13:42.637429+0000","last_became_active":"2024-01-22T10:13:41.599228+0000","last_became_peered":"2024-01-22T10:13:41.599228+0000","last_unstale":"2024-01-22T10:13:42.637429+0000","last_undegraded":"2024-01-22T10:13:42.637429+0000","last_fullsized":"2024-01-22T10:13:42.637429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034332+0000","last_change":"2024-01-22T10:13:42.626089+0000","last_active":"2024-01-22T10:13:44.034332+0000","last_peered":"2024-01-22T10:13:44.034332+0000","last_clean":"2024-01-22T10:13:44.034332+0000","last_became_active":"2024-01-22T10:13:42.625809+0000","last_became_peered":"2024-01-22T10:13:42.625809+0000","last_unstale":"2024-01-22T10:13:44.034332+0000","last_undegraded":"2024-01-22T10:13:44.034332+0000","last_fullsized":"2024-01-22T10:13:44.034332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:55.872670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.622441+0000","last_change":"2024-01-22T10:13:41.597556+0000","last_active":"2024-01-22T10:13:42.622441+0000","last_peered":"2024-01-22T10:13:42.622441+0000","last_clean":"2024-01-22T10:13:42.622441+0000","last_became_active":"2024-01-22T10:13:41.597157+0000","last_became_peered":"2024-01-22T10:13:41.597157+0000","last_unstale":"2024-01-22T10:13:42.622441+0000","last_undegraded":"2024-01-22T10:13:42.622441+0000","last_fullsized":"2024-01-22T10:13:42.622441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:54.870939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034040+0000","last_change":"2024-01-22T10:13:42.630577+0000","last_active":"2024-01-22T10:13:44.034040+0000","last_peered":"2024-01-22T10:13:44.034040+0000","last_clean":"2024-01-22T10:13:44.034040+0000","last_became_active":"2024-01-22T10:13:42.630345+0000","last_became_peered":"2024-01-22T10:13:42.630345+0000","last_unstale":"2024-01-22T10:13:44.034040+0000","last_undegraded":"2024-01-22T10:13:44.034040+0000","last_fullsized":"2024-01-22T10:13:44.034040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:33:00.953623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.633167+0000","last_change":"2024-01-22T10:13:41.603385+0000","last_active":"2024-01-22T10:13:42.633167+0000","last_peered":"2024-01-22T10:13:42.633167+0000","last_clean":"2024-01-22T10:13:42.633167+0000","last_became_active":"2024-01-22T10:13:41.603096+0000","last_became_peered":"2024-01-22T10:13:41.603096+0000","last_unstale":"2024-01-22T10:13:42.633167+0000","last_undegraded":"2024-01-22T10:13:42.633167+0000","last_fullsized":"2024-01-22T10:13:42.633167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:52:13.557327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034134+0000","last_change":"2024-01-22T10:13:42.625780+0000","last_active":"2024-01-22T10:13:44.034134+0000","last_peered":"2024-01-22T10:13:44.034134+0000","last_clean":"2024-01-22T10:13:44.034134+0000","last_became_active":"2024-01-22T10:13:42.625524+0000","last_became_peered":"2024-01-22T10:13:42.625524+0000","last_unstale":"2024-01-22T10:13:44.034134+0000","last_undegraded":"2024-01-22T10:13:44.034134+0000","last_fullsized":"2024-01-22T10:13:44.034134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:45.241467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614787+0000","last_change":"2024-01-22T10:13:41.600994+0000","last_active":"2024-01-22T10:13:42.614787+0000","last_peered":"2024-01-22T10:13:42.614787+0000","last_clean":"2024-01-22T10:13:42.614787+0000","last_became_active":"2024-01-22T10:13:41.600704+0000","last_became_peered":"2024-01-22T10:13:41.600704+0000","last_unstale":"2024-01-22T10:13:42.614787+0000","last_undegraded":"2024-01-22T10:13:42.614787+0000","last_fullsized":"2024-01-22T10:13:42.614787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:54.870939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033907+0000","last_change":"2024-01-22T10:13:42.622896+0000","last_active":"2024-01-22T10:13:44.033907+0000","last_peered":"2024-01-22T10:13:44.033907+0000","last_clean":"2024-01-22T10:13:44.033907+0000","last_became_active":"2024-01-22T10:13:42.622631+0000","last_became_peered":"2024-01-22T10:13:42.622631+0000","last_unstale":"2024-01-22T10:13:44.033907+0000","last_undegraded":"2024-01-22T10:13:44.033907+0000","last_fullsized":"2024-01-22T10:13:44.033907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:43:02.897571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621795+0000","last_change":"2024-01-22T10:13:41.597586+0000","last_active":"2024-01-22T10:13:42.621795+0000","last_peered":"2024-01-22T10:13:42.621795+0000","last_clean":"2024-01-22T10:13:42.621795+0000","last_became_active":"2024-01-22T10:13:41.597324+0000","last_became_peered":"2024-01-22T10:13:41.597324+0000","last_unstale":"2024-01-22T10:13:42.621795+0000","last_undegraded":"2024-01-22T10:13:42.621795+0000","last_fullsized":"2024-01-22T10:13:42.621795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:43:01.895840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624510+0000","last_change":"2024-01-22T10:13:42.617670+0000","last_active":"2024-01-22T10:13:43.624510+0000","last_peered":"2024-01-22T10:13:43.624510+0000","last_clean":"2024-01-22T10:13:43.624510+0000","last_became_active":"2024-01-22T10:13:42.616992+0000","last_became_peered":"2024-01-22T10:13:42.616992+0000","last_unstale":"2024-01-22T10:13:43.624510+0000","last_undegraded":"2024-01-22T10:13:43.624510+0000","last_fullsized":"2024-01-22T10:13:43.624510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614491+0000","last_change":"2024-01-22T10:13:41.599431+0000","last_active":"2024-01-22T10:13:42.614491+0000","last_peered":"2024-01-22T10:13:42.614491+0000","last_clean":"2024-01-22T10:13:42.614491+0000","last_became_active":"2024-01-22T10:13:41.599008+0000","last_became_peered":"2024-01-22T10:13:41.599008+0000","last_unstale":"2024-01-22T10:13:42.614491+0000","last_undegraded":"2024-01-22T10:13:42.614491+0000","last_fullsized":"2024-01-22T10:13:42.614491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T22:02:40.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034455+0000","last_change":"2024-01-22T10:13:42.626317+0000","last_active":"2024-01-22T10:13:44.034455+0000","last_peered":"2024-01-22T10:13:44.034455+0000","last_clean":"2024-01-22T10:13:44.034455+0000","last_became_active":"2024-01-22T10:13:42.626088+0000","last_became_peered":"2024-01-22T10:13:42.626088+0000","last_unstale":"2024-01-22T10:13:44.034455+0000","last_undegraded":"2024-01-22T10:13:44.034455+0000","last_fullsized":"2024-01-22T10:13:44.034455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:39:36.530327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640956+0000","last_change":"2024-01-22T10:13:41.597369+0000","last_active":"2024-01-22T10:13:42.640956+0000","last_peered":"2024-01-22T10:13:42.640956+0000","last_clean":"2024-01-22T10:13:42.640956+0000","last_became_active":"2024-01-22T10:13:41.597126+0000","last_became_peered":"2024-01-22T10:13:41.597126+0000","last_unstale":"2024-01-22T10:13:42.640956+0000","last_undegraded":"2024-01-22T10:13:42.640956+0000","last_fullsized":"2024-01-22T10:13:42.640956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034664+0000","last_change":"2024-01-22T10:13:42.624684+0000","last_active":"2024-01-22T10:13:44.034664+0000","last_peered":"2024-01-22T10:13:44.034664+0000","last_clean":"2024-01-22T10:13:44.034664+0000","last_became_active":"2024-01-22T10:13:42.624431+0000","last_became_peered":"2024-01-22T10:13:42.624431+0000","last_unstale":"2024-01-22T10:13:44.034664+0000","last_undegraded":"2024-01-22T10:13:44.034664+0000","last_fullsized":"2024-01-22T10:13:44.034664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.612790+0000","last_change":"2024-01-22T10:13:41.603337+0000","last_active":"2024-01-22T10:13:43.612790+0000","last_peered":"2024-01-22T10:13:43.612790+0000","last_clean":"2024-01-22T10:13:43.612790+0000","last_became_active":"2024-01-22T10:13:41.602818+0000","last_became_peered":"2024-01-22T10:13:41.602818+0000","last_unstale":"2024-01-22T10:13:43.612790+0000","last_undegraded":"2024-01-22T10:13:43.612790+0000","last_fullsized":"2024-01-22T10:13:43.612790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033982+0000","last_change":"2024-01-22T10:13:42.626012+0000","last_active":"2024-01-22T10:13:44.033982+0000","last_peered":"2024-01-22T10:13:44.033982+0000","last_clean":"2024-01-22T10:13:44.033982+0000","last_became_active":"2024-01-22T10:13:42.625759+0000","last_became_peered":"2024-01-22T10:13:42.625759+0000","last_unstale":"2024-01-22T10:13:44.033982+0000","last_undegraded":"2024-01-22T10:13:44.033982+0000","last_fullsized":"2024-01-22T10:13:44.033982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.613216+0000","last_change":"2024-01-22T10:13:41.593779+0000","last_active":"2024-01-22T10:13:42.613216+0000","last_peered":"2024-01-22T10:13:42.613216+0000","last_clean":"2024-01-22T10:13:42.613216+0000","last_became_active":"2024-01-22T10:13:41.593469+0000","last_became_peered":"2024-01-22T10:13:41.593469+0000","last_unstale":"2024-01-22T10:13:42.613216+0000","last_undegraded":"2024-01-22T10:13:42.613216+0000","last_fullsized":"2024-01-22T10:13:42.613216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:52:13.557327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986594+0000","last_change":"2024-01-22T10:13:42.622705+0000","last_active":"2024-01-22T10:13:43.986594+0000","last_peered":"2024-01-22T10:13:43.986594+0000","last_clean":"2024-01-22T10:13:43.986594+0000","last_became_active":"2024-01-22T10:13:42.622464+0000","last_became_peered":"2024-01-22T10:13:42.622464+0000","last_unstale":"2024-01-22T10:13:43.986594+0000","last_undegraded":"2024-01-22T10:13:43.986594+0000","last_fullsized":"2024-01-22T10:13:43.986594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:22:34.853691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614866+0000","last_change":"2024-01-22T10:13:41.601304+0000","last_active":"2024-01-22T10:13:42.614866+0000","last_peered":"2024-01-22T10:13:42.614866+0000","last_clean":"2024-01-22T10:13:42.614866+0000","last_became_active":"2024-01-22T10:13:41.601010+0000","last_became_peered":"2024-01-22T10:13:41.601010+0000","last_unstale":"2024-01-22T10:13:42.614866+0000","last_undegraded":"2024-01-22T10:13:42.614866+0000","last_fullsized":"2024-01-22T10:13:42.614866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:33:12.832661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034206+0000","last_change":"2024-01-22T10:13:42.623113+0000","last_active":"2024-01-22T10:13:44.034206+0000","last_peered":"2024-01-22T10:13:44.034206+0000","last_clean":"2024-01-22T10:13:44.034206+0000","last_became_active":"2024-01-22T10:13:42.622855+0000","last_became_peered":"2024-01-22T10:13:42.622855+0000","last_unstale":"2024-01-22T10:13:44.034206+0000","last_undegraded":"2024-01-22T10:13:44.034206+0000","last_fullsized":"2024-01-22T10:13:44.034206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:21:10.389082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.612039+0000","last_change":"2024-01-22T10:13:41.597546+0000","last_active":"2024-01-22T10:13:42.612039+0000","last_peered":"2024-01-22T10:13:42.612039+0000","last_clean":"2024-01-22T10:13:42.612039+0000","last_became_active":"2024-01-22T10:13:41.597270+0000","last_became_peered":"2024-01-22T10:13:41.597270+0000","last_unstale":"2024-01-22T10:13:42.612039+0000","last_undegraded":"2024-01-22T10:13:42.612039+0000","last_fullsized":"2024-01-22T10:13:42.612039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:33:12.832661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624046+0000","last_change":"2024-01-22T10:13:42.623605+0000","last_active":"2024-01-22T10:13:43.624046+0000","last_peered":"2024-01-22T10:13:43.624046+0000","last_clean":"2024-01-22T10:13:43.624046+0000","last_became_active":"2024-01-22T10:13:42.623331+0000","last_became_peered":"2024-01-22T10:13:42.623331+0000","last_unstale":"2024-01-22T10:13:43.624046+0000","last_undegraded":"2024-01-22T10:13:43.624046+0000","last_fullsized":"2024-01-22T10:13:43.624046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621970+0000","last_change":"2024-01-22T10:13:41.596973+0000","last_active":"2024-01-22T10:13:42.621970+0000","last_peered":"2024-01-22T10:13:42.621970+0000","last_clean":"2024-01-22T10:13:42.621970+0000","last_became_active":"2024-01-22T10:13:41.596639+0000","last_became_peered":"2024-01-22T10:13:41.596639+0000","last_unstale":"2024-01-22T10:13:42.621970+0000","last_undegraded":"2024-01-22T10:13:42.621970+0000","last_fullsized":"2024-01-22T10:13:42.621970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:32:59.951892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034916+0000","last_change":"2024-01-22T10:13:42.637594+0000","last_active":"2024-01-22T10:13:44.034916+0000","last_peered":"2024-01-22T10:13:44.034916+0000","last_clean":"2024-01-22T10:13:44.034916+0000","last_became_active":"2024-01-22T10:13:42.637152+0000","last_became_peered":"2024-01-22T10:13:42.637152+0000","last_unstale":"2024-01-22T10:13:44.034916+0000","last_undegraded":"2024-01-22T10:13:44.034916+0000","last_fullsized":"2024-01-22T10:13:44.034916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.610626+0000","last_change":"2024-01-22T10:13:41.600670+0000","last_active":"2024-01-22T10:13:42.610626+0000","last_peered":"2024-01-22T10:13:42.610626+0000","last_clean":"2024-01-22T10:13:42.610626+0000","last_became_active":"2024-01-22T10:13:41.600181+0000","last_became_peered":"2024-01-22T10:13:41.600181+0000","last_unstale":"2024-01-22T10:13:42.610626+0000","last_undegraded":"2024-01-22T10:13:42.610626+0000","last_fullsized":"2024-01-22T10:13:42.610626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:23:17.918061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624601+0000","last_change":"2024-01-22T10:13:42.626739+0000","last_active":"2024-01-22T10:13:43.624601+0000","last_peered":"2024-01-22T10:13:43.624601+0000","last_clean":"2024-01-22T10:13:43.624601+0000","last_became_active":"2024-01-22T10:13:42.626445+0000","last_became_peered":"2024-01-22T10:13:42.626445+0000","last_unstale":"2024-01-22T10:13:43.624601+0000","last_undegraded":"2024-01-22T10:13:43.624601+0000","last_fullsized":"2024-01-22T10:13:43.624601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.613827+0000","last_change":"2024-01-22T10:13:41.600294+0000","last_active":"2024-01-22T10:13:42.613827+0000","last_peered":"2024-01-22T10:13:42.613827+0000","last_clean":"2024-01-22T10:13:42.613827+0000","last_became_active":"2024-01-22T10:13:41.599985+0000","last_became_peered":"2024-01-22T10:13:41.599985+0000","last_unstale":"2024-01-22T10:13:42.613827+0000","last_undegraded":"2024-01-22T10:13:42.613827+0000","last_fullsized":"2024-01-22T10:13:42.613827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:47.541129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.609823+0000","last_change":"2024-01-22T10:12:52.033359+0000","last_active":"2024-01-22T10:13:42.609823+0000","last_peered":"2024-01-22T10:13:42.609823+0000","last_clean":"2024-01-22T10:13:42.609823+0000","last_became_active":"2024-01-22T10:12:52.033101+0000","last_became_peered":"2024-01-22T10:12:52.033101+0000","last_unstale":"2024-01-22T10:13:42.609823+0000","last_undegraded":"2024-01-22T10:13:42.609823+0000","last_fullsized":"2024-01-22T10:13:42.609823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_clean_scrub_stamp":"2024-01-22T10:12:51.022957+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:45:37.023233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":719503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":130679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":129115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":130679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":719413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T10:13:46.889 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-22T10:13:46.889 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-22T10:13:47.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.049+0000 7f9d5da87640 1 Processor -- start 2024-01-22T10:13:47.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.049+0000 7f9d5da87640 1 -- start start 2024-01-22T10:13:47.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.049+0000 7f9d5da87640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d580bc0e0 0x7f9d5814cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.049+0000 7f9d5da87640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5806f2e0 con 0x7f9d5814a130 2024-01-22T10:13:47.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.049+0000 7f9d5da87640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5814d460 con 0x7f9d5814cff0 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.049+0000 7f9d5da87640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5806f530 con 0x7f9d580bc0e0 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d57fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9d5814a130 0x7f9d58153de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33588/0 (socket says 172.21.15.88:33588) 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d57fff640 1 -- 172.21.15.88:0/3380027177 learned_addr learned my addr 172.21.15.88:0/3380027177 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d577fe640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d580bc0e0 0x7f9d5814cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565363668 0 0) 0x7f9d5806f2e0 con 0x7f9d5814a130 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d40003520 con 0x7f9d5814a130 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1007471949 0 0) 0x7f9d40003520 con 0x7f9d5814a130 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d580bc0e0 msgr2=0x7f9d5814cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d580bc0e0 0x7f9d5814cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 >> v1:172.21.15.119:6789/0 conn(0x7f9d5814cff0 legacy=0x7f9d58149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5806f810 con 0x7f9d5814a130 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f9d500019f0 con 0x7f9d5814a130 2024-01-22T10:13:47.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 >> v1:172.21.15.88:6789/0 conn(0x7f9d5814a130 legacy=0x7f9d58153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d40003a80 0x7f9d40003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d580bc0e0 0x7f9d400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d40004d00 0x7f9d40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5806f530 con 0x7f9d40003a80 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4000ba60 con 0x7f9d40004d00 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4000bc20 con 0x7f9d580bc0e0 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d577fe640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d40003a80 0x7f9d40003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d57fff640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d40004d00 0x7f9d40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.050+0000 7f9d56ffd640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d580bc0e0 0x7f9d400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.051+0000 7f9d577fe640 1 -- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d580bc0e0 msgr2=0x7f9d400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.051+0000 7f9d577fe640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d580bc0e0 0x7f9d400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.051+0000 7f9d577fe640 1 -- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d40004d00 msgr2=0x7f9d40005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.051+0000 7f9d577fe640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d40004d00 0x7f9d40005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.051+0000 7f9d577fe640 1 -- 172.21.15.88:0/3380027177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d40003520 con 0x7f9d40003a80 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.051+0000 7f9d57fff640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d40004d00 0x7f9d40005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.051+0000 7f9d56ffd640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d580bc0e0 0x7f9d400047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.051+0000 7f9d577fe640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d40003a80 0x7f9d40003e60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009a90 tx=0x7f9d400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462f5b2105538921 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.051+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4802c680 con 0x7f9d40003a80 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.051+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4802c7e0 con 0x7f9d40003a80 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.051+0000 7f9d567fc640 1 -- 172.21.15.88:0/3380027177 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4802cb70 con 0x7f9d40003a80 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.052+0000 7f9d5da87640 1 -- 172.21.15.88:0/3380027177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d40003a80 msgr2=0x7f9d40003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.052+0000 7f9d5da87640 1 --2- 172.21.15.88:0/3380027177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d40003a80 0x7f9d40003e60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009a90 tx=0x7f9d400057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.052+0000 7f9d57fff640 1 -- 172.21.15.88:0/3380027177 reap_dead start 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.052+0000 7f9d5da87640 1 -- 172.21.15.88:0/3380027177 shutdown_connections 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.052+0000 7f9d5da87640 1 -- 172.21.15.88:0/3380027177 >> 172.21.15.88:0/3380027177 conn(0x7f9d580bf560 msgr2=0x7f9d580bb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.052+0000 7f9d5da87640 1 -- 172.21.15.88:0/3380027177 shutdown_connections 2024-01-22T10:13:47.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.052+0000 7f9d5da87640 1 -- 172.21.15.88:0/3380027177 wait complete. 2024-01-22T10:13:47.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.053+0000 7f9d5da87640 1 Processor -- start 2024-01-22T10:13:47.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.053+0000 7f9d5da87640 1 -- start start 2024-01-22T10:13:47.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d5da87640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d40003a80 0x7f9d581375e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d5da87640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d581d5720 0x7f9d580b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d5da87640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d581d5b80 0x7f9d58135b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d5da87640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58147f50 con 0x7f9d40003a80 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d5da87640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d581356d0 con 0x7f9d581d5720 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d5da87640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58137cc0 con 0x7f9d581d5b80 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d577fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d40003a80 0x7f9d581375e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d577fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d40003a80 0x7f9d581375e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47934/0 (socket says 172.21.15.88:47934) 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d577fe640 1 -- 172.21.15.88:0/1868399694 learned_addr learned my addr 172.21.15.88:0/1868399694 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d57fff640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d581d5b80 0x7f9d58135b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d56ffd640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d581d5720 0x7f9d580b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d577fe640 1 -- 172.21.15.88:0/1868399694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d581d5b80 msgr2=0x7f9d58135b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d577fe640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d581d5b80 0x7f9d58135b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d577fe640 1 -- 172.21.15.88:0/1868399694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d581d5720 msgr2=0x7f9d580b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d577fe640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d581d5720 0x7f9d580b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d577fe640 1 -- 172.21.15.88:0/1868399694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d581df2f0 con 0x7f9d40003a80 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d56ffd640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d581d5720 0x7f9d580b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:47.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d577fe640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d40003a80 0x7f9d581375e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9d48000c00 tx=0x7f9d48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:47.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d3ffff640 1 -- 172.21.15.88:0/1868399694 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48003810 con 0x7f9d40003a80 2024-01-22T10:13:47.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d3ffff640 1 -- 172.21.15.88:0/1868399694 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d48003970 con 0x7f9d40003a80 2024-01-22T10:13:47.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d3ffff640 1 -- 172.21.15.88:0/1868399694 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48003d00 con 0x7f9d40003a80 2024-01-22T10:13:47.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d5da87640 1 -- 172.21.15.88:0/1868399694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d581df5d0 con 0x7f9d40003a80 2024-01-22T10:13:47.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.054+0000 7f9d5da87640 1 -- 172.21.15.88:0/1868399694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d581df8b0 con 0x7f9d40003a80 2024-01-22T10:13:47.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.055+0000 7f9d5da87640 1 -- 172.21.15.88:0/1868399694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5804ea30 con 0x7f9d40003a80 2024-01-22T10:13:47.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.056+0000 7f9d3ffff640 1 -- 172.21.15.88:0/1868399694 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f9d48034440 con 0x7f9d40003a80 2024-01-22T10:13:47.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.056+0000 7f9d3ffff640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9d4406b330 0x7f9d4406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.056+0000 7f9d3ffff640 1 -- 172.21.15.88:0/1868399694 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d480abc40 con 0x7f9d40003a80 2024-01-22T10:13:47.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.056+0000 7f9d56ffd640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9d4406b330 0x7f9d4406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.057+0000 7f9d56ffd640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9d4406b330 0x7f9d4406d7f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9d5814cf40 tx=0x7f9d4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:47.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.060+0000 7f9d3ffff640 1 -- 172.21.15.88:0/1868399694 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9d48076b30 con 0x7f9d40003a80 2024-01-22T10:13:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.293+0000 7f9d5da87640 1 -- 172.21.15.88:0/1868399694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9d58149490 con 0x7f9d40003a80 2024-01-22T10:13:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.295+0000 7f9d3ffff640 1 -- 172.21.15.88:0/1868399694 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9d4804c0e0 con 0x7f9d40003a80 2024-01-22T10:13:47.278 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2024-01-22T10:13:47.278 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB2P65lTw4wAhAAHkWEm0pUd5uSTZi+mnQAVQ== 2024-01-22T10:13:47.278 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow" 2024-01-22T10:13:47.278 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow r" 2024-01-22T10:13:47.278 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-22T10:13:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:updated caps for client.0 2024-01-22T10:13:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.297+0000 7f9d5da87640 1 -- 172.21.15.88:0/1868399694 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9d4406b330 msgr2=0x7f9d4406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.297+0000 7f9d5da87640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9d4406b330 0x7f9d4406d7f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9d5814cf40 tx=0x7f9d4c009040 comp rx=0 tx=0).stop 2024-01-22T10:13:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.297+0000 7f9d5da87640 1 -- 172.21.15.88:0/1868399694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d40003a80 msgr2=0x7f9d581375e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.297+0000 7f9d5da87640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d40003a80 0x7f9d581375e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9d48000c00 tx=0x7f9d48004730 comp rx=0 tx=0).stop 2024-01-22T10:13:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.298+0000 7f9d5da87640 1 -- 172.21.15.88:0/1868399694 shutdown_connections 2024-01-22T10:13:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.298+0000 7f9d5da87640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9d4406b330 0x7f9d4406d7f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.298+0000 7f9d5da87640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d581d5b80 0x7f9d58135b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.298+0000 7f9d5da87640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d581d5720 0x7f9d580b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.298+0000 7f9d5da87640 1 --2- 172.21.15.88:0/1868399694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d40003a80 0x7f9d581375e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.298+0000 7f9d5da87640 1 -- 172.21.15.88:0/1868399694 >> 172.21.15.88:0/1868399694 conn(0x7f9d580bf560 msgr2=0x7f9d580b7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.298+0000 7f9d5da87640 1 -- 172.21.15.88:0/1868399694 shutdown_connections 2024-01-22T10:13:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.298+0000 7f9d5da87640 1 -- 172.21.15.88:0/1868399694 wait complete. 2024-01-22T10:13:47.291 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:13:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.406+0000 7f7b5589b640 1 Processor -- start 2024-01-22T10:13:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.407+0000 7f7b5589b640 1 -- start start 2024-01-22T10:13:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.407+0000 7f7b5589b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7b500bbb00 0x7f7b5014ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.407+0000 7f7b5589b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b500b45a0 0x7f7b5014b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.407+0000 7f7b5589b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b500bd1c0 con 0x7f7b500bdde0 2024-01-22T10:13:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.407+0000 7f7b5589b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b500bc560 con 0x7f7b500b45a0 2024-01-22T10:13:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.407+0000 7f7b5589b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b500c0820 con 0x7f7b500bbb00 2024-01-22T10:13:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.407+0000 7f7b4e7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b500b45a0 0x7f7b5014b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.407+0000 7f7b4e7fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b500b45a0 0x7f7b5014b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47948/0 (socket says 172.21.15.88:47948) 2024-01-22T10:13:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.407+0000 7f7b4f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7b500bdde0 0x7f7b5014ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33598/0 (socket says 172.21.15.88:33598) 2024-01-22T10:13:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.407+0000 7f7b4e7fc640 1 -- 172.21.15.88:0/3696970212 learned_addr learned my addr 172.21.15.88:0/3696970212 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.407+0000 7f7b4effd640 1 --2- 172.21.15.88:0/3696970212 >> v2:172.21.15.119:3300/0 conn(0x7f7b500bbb00 0x7f7b5014ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.408+0000 7f7b4e7fc640 1 -- 172.21.15.88:0/3696970212 >> v2:172.21.15.119:3300/0 conn(0x7f7b500bbb00 msgr2=0x7f7b5014ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:47.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.408+0000 7f7b4e7fc640 1 --2- 172.21.15.88:0/3696970212 >> v2:172.21.15.119:3300/0 conn(0x7f7b500bbb00 0x7f7b5014ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.408+0000 7f7b4e7fc640 1 -- 172.21.15.88:0/3696970212 >> v1:172.21.15.88:6789/0 conn(0x7f7b500bdde0 legacy=0x7f7b5014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.408+0000 7f7b4e7fc640 1 -- 172.21.15.88:0/3696970212 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b500c0b00 con 0x7f7b500b45a0 2024-01-22T10:13:47.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.408+0000 7f7b4e7fc640 1 --2- 172.21.15.88:0/3696970212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b500b45a0 0x7f7b5014b3b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7b5006bb80 tx=0x7f7b4402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b520906c056433c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:47.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.408+0000 7f7b4dffb640 1 -- 172.21.15.88:0/3696970212 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4402cb20 con 0x7f7b500b45a0 2024-01-22T10:13:47.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.408+0000 7f7b4dffb640 1 -- 172.21.15.88:0/3696970212 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4402cc80 con 0x7f7b500b45a0 2024-01-22T10:13:47.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.408+0000 7f7b4dffb640 1 -- 172.21.15.88:0/3696970212 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b440343f0 con 0x7f7b500b45a0 2024-01-22T10:13:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.409+0000 7f7b5589b640 1 -- 172.21.15.88:0/3696970212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b500b45a0 msgr2=0x7f7b5014b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.409+0000 7f7b5589b640 1 --2- 172.21.15.88:0/3696970212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b500b45a0 0x7f7b5014b3b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7b5006bb80 tx=0x7f7b4402bf80 comp rx=0 tx=0).stop 2024-01-22T10:13:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.409+0000 7f7b5589b640 1 -- 172.21.15.88:0/3696970212 shutdown_connections 2024-01-22T10:13:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.409+0000 7f7b5589b640 1 --2- 172.21.15.88:0/3696970212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b500b45a0 0x7f7b5014b3b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.409+0000 7f7b5589b640 1 --2- 172.21.15.88:0/3696970212 >> v2:172.21.15.119:3300/0 conn(0x7f7b500bbb00 0x7f7b5014ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.409+0000 7f7b5589b640 1 -- 172.21.15.88:0/3696970212 >> 172.21.15.88:0/3696970212 conn(0x7f7b500a2c20 msgr2=0x7f7b500a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.409+0000 7f7b5589b640 1 -- 172.21.15.88:0/3696970212 shutdown_connections 2024-01-22T10:13:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.409+0000 7f7b5589b640 1 -- 172.21.15.88:0/3696970212 wait complete. 2024-01-22T10:13:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.410+0000 7f7b5589b640 1 Processor -- start 2024-01-22T10:13:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.410+0000 7f7b5589b640 1 -- start start 2024-01-22T10:13:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b5589b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b500b45a0 0x7f7b500baa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b5589b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b500bbb00 0x7f7b500b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b5589b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b500bdde0 0x7f7b500b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b5589b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500b7b30 con 0x7f7b500bdde0 2024-01-22T10:13:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b5589b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500b7520 con 0x7f7b500b45a0 2024-01-22T10:13:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b5589b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500bb320 con 0x7f7b500bbb00 2024-01-22T10:13:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b4f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b500bdde0 0x7f7b500b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b4f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b500bdde0 0x7f7b500b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47964/0 (socket says 172.21.15.88:47964) 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b4f7fe640 1 -- 172.21.15.88:0/1824546052 learned_addr learned my addr 172.21.15.88:0/1824546052 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b4effd640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b500b45a0 0x7f7b500baa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b4e7fc640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b500bbb00 0x7f7b500b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b4f7fe640 1 -- 172.21.15.88:0/1824546052 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b500bbb00 msgr2=0x7f7b500b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b4f7fe640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b500bbb00 0x7f7b500b6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b4f7fe640 1 -- 172.21.15.88:0/1824546052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b500b45a0 msgr2=0x7f7b500baa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b4f7fe640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b500b45a0 0x7f7b500baa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b4f7fe640 1 -- 172.21.15.88:0/1824546052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b44009b30 con 0x7f7b500bdde0 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b4f7fe640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b500bdde0 0x7f7b500b5110 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000c3f0 tx=0x7f7b4000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.411+0000 7f7b37fff640 1 -- 172.21.15.88:0/1824546052 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400074e0 con 0x7f7b500bdde0 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.412+0000 7f7b37fff640 1 -- 172.21.15.88:0/1824546052 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b40007680 con 0x7f7b500bdde0 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.412+0000 7f7b5589b640 1 -- 172.21.15.88:0/1824546052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b500b7100 con 0x7f7b500bdde0 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.412+0000 7f7b37fff640 1 -- 172.21.15.88:0/1824546052 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40004a20 con 0x7f7b500bdde0 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.412+0000 7f7b5589b640 1 -- 172.21.15.88:0/1824546052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b500baf40 con 0x7f7b500bdde0 2024-01-22T10:13:47.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.413+0000 7f7b5589b640 1 -- 172.21.15.88:0/1824546052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b500bb130 con 0x7f7b500bdde0 2024-01-22T10:13:47.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.413+0000 7f7b37fff640 1 -- 172.21.15.88:0/1824546052 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f7b40004b80 con 0x7f7b500bdde0 2024-01-22T10:13:47.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.413+0000 7f7b37fff640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7b3c06b330 0x7f7b3c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:47.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.413+0000 7f7b37fff640 1 -- 172.21.15.88:0/1824546052 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b40089370 con 0x7f7b500bdde0 2024-01-22T10:13:47.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.413+0000 7f7b4effd640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7b3c06b330 0x7f7b3c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:47.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.414+0000 7f7b4effd640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7b3c06b330 0x7f7b3c06d7f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7b48006fd0 tx=0x7f7b48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:47.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.418+0000 7f7b37fff640 1 -- 172.21.15.88:0/1824546052 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7b40054200 con 0x7f7b500bdde0 2024-01-22T10:13:47.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.622+0000 7f7b5589b640 1 -- 172.21.15.88:0/1824546052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b5004ea30 con 0x7f7b500bdde0 2024-01-22T10:13:47.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.623+0000 7f7b37fff640 1 -- 172.21.15.88:0/1824546052 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4150 (secure 0 0 0) 0x7f7b40057820 con 0x7f7b500bdde0 2024-01-22T10:13:47.605 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:47.605 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1165513551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1165513551},{"type":"v1","addr":"172.21.15.88:6837","nonce":1165513551}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2442028121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2442028121},{"type":"v1","addr":"172.21.15.119:6833","nonce":2442028121}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T10:13:41.931499+0000","modified":"2024-01-22T10:13:44.831394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4983},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4983":{"gid":4983,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6836/2577795457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2577795457},{"type":"v1","addr":"172.21.15.88:6836","nonce":2577795457}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-22T10:13:47.606 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2024-01-22T10:13:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.624+0000 7f7b5589b640 1 -- 172.21.15.88:0/1824546052 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7b3c06b330 msgr2=0x7f7b3c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.624+0000 7f7b5589b640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7b3c06b330 0x7f7b3c06d7f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7b48006fd0 tx=0x7f7b48008040 comp rx=0 tx=0).stop 2024-01-22T10:13:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.624+0000 7f7b5589b640 1 -- 172.21.15.88:0/1824546052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b500bdde0 msgr2=0x7f7b500b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.624+0000 7f7b5589b640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b500bdde0 0x7f7b500b5110 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000c3f0 tx=0x7f7b4000c8b0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.625+0000 7f7b5589b640 1 -- 172.21.15.88:0/1824546052 shutdown_connections 2024-01-22T10:13:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.625+0000 7f7b5589b640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7b3c06b330 0x7f7b3c06d7f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.625+0000 7f7b5589b640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b500bbb00 0x7f7b500b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.625+0000 7f7b5589b640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b500bdde0 0x7f7b500b5110 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.625+0000 7f7b5589b640 1 --2- 172.21.15.88:0/1824546052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b500b45a0 0x7f7b500baa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.625+0000 7f7b5589b640 1 -- 172.21.15.88:0/1824546052 >> 172.21.15.88:0/1824546052 conn(0x7f7b500a2c20 msgr2=0x7f7b50149190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.625+0000 7f7b5589b640 1 -- 172.21.15.88:0/1824546052 shutdown_connections 2024-01-22T10:13:47.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:47.625+0000 7f7b5589b640 1 -- 172.21.15.88:0/1824546052 wait complete. 2024-01-22T10:13:47.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-22T10:13:41.931499+0000', 'modified': '2024-01-22T10:13:44.831394+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4983}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4983': {'gid': 4983, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6836/2577795457', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6834', 'nonce': 2577795457}, {'type': 'v1', 'addr': '172.21.15.88:6836', 'nonce': 2577795457}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-22T10:13:47.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-22T10:13:47.921 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-22T10:13:48.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.040+0000 7ff53eabb640 1 Processor -- start 2024-01-22T10:13:48.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.040+0000 7ff53eabb640 1 -- start start 2024-01-22T10:13:48.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.041+0000 7ff53eabb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380b5310 0x7ff53806d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.041+0000 7ff53eabb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff53806bc20 0x7ff538156040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.041+0000 7ff53eabb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53814c590 con 0x7ff53806b800 2024-01-22T10:13:48.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.041+0000 7ff53eabb640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53806d080 con 0x7ff53806bc20 2024-01-22T10:13:48.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.041+0000 7ff53eabb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53814b7d0 con 0x7ff5380b5310 2024-01-22T10:13:48.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.041+0000 7ff537fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff53806b800 0x7ff5380b4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46580/0 (socket says 172.21.15.88:46580) 2024-01-22T10:13:48.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.041+0000 7ff537fff640 1 -- 172.21.15.88:0/4030952411 learned_addr learned my addr 172.21.15.88:0/4030952411 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:48.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.041+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597927786 0 0) 0x7ff53814c590 con 0x7ff53806b800 2024-01-22T10:13:48.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.041+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff520003520 con 0x7ff53806b800 2024-01-22T10:13:48.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.041+0000 7ff53c857640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380b5310 0x7ff53806d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.041+0000 7ff53d058640 1 --2- 172.21.15.88:0/4030952411 >> v2:172.21.15.119:3300/0 conn(0x7ff53806bc20 0x7ff538156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1972066813 0 0) 0x7ff520003520 con 0x7ff53806b800 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380b5310 msgr2=0x7ff53806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380b5310 0x7ff53806d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 >> v2:172.21.15.119:3300/0 conn(0x7ff53806bc20 msgr2=0x7ff538156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 --2- 172.21.15.88:0/4030952411 >> v2:172.21.15.119:3300/0 conn(0x7ff53806bc20 0x7ff538156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53814bab0 con 0x7ff53806b800 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7ff52c001670 con 0x7ff53806b800 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 >> v1:172.21.15.88:6789/0 conn(0x7ff53806b800 legacy=0x7ff5380b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff520003a50 0x7ff520003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380b5310 0x7ff5200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff520004d00 0x7ff520005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53806d080 con 0x7ff520004d00 2024-01-22T10:13:48.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53814b7d0 con 0x7ff520003a50 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52000baf0 con 0x7ff5380b5310 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff53d058640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff520004d00 0x7ff520005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff537fff640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380b5310 0x7ff5200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff53c857640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff520003a50 0x7ff520003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff53d058640 1 -- 172.21.15.88:0/4030952411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380b5310 msgr2=0x7ff5200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff53d058640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380b5310 0x7ff5200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff53d058640 1 -- 172.21.15.88:0/4030952411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff520003a50 msgr2=0x7ff520003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff53d058640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff520003a50 0x7ff520003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff53d058640 1 -- 172.21.15.88:0/4030952411 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520003520 con 0x7ff520004d00 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.042+0000 7ff53c857640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff520003a50 0x7ff520003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.043+0000 7ff53d058640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff520004d00 0x7ff520005180 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff530009fc0 tx=0x7ff5200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cf9aa63426f537 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.043+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53002cc40 con 0x7ff520004d00 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.043+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53000f040 con 0x7ff520004d00 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.043+0000 7ff5377fe640 1 -- 172.21.15.88:0/4030952411 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530034440 con 0x7ff520004d00 2024-01-22T10:13:48.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.043+0000 7ff53eabb640 1 -- 172.21.15.88:0/4030952411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff520004d00 msgr2=0x7ff520005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.043+0000 7ff53eabb640 1 --2- 172.21.15.88:0/4030952411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff520004d00 0x7ff520005180 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff530009fc0 tx=0x7ff5200057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.043+0000 7ff53d058640 1 -- 172.21.15.88:0/4030952411 reap_dead start 2024-01-22T10:13:48.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.043+0000 7ff53eabb640 1 -- 172.21.15.88:0/4030952411 shutdown_connections 2024-01-22T10:13:48.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.043+0000 7ff53eabb640 1 -- 172.21.15.88:0/4030952411 >> 172.21.15.88:0/4030952411 conn(0x7ff5380bec50 msgr2=0x7ff5380bf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:48.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.044+0000 7ff53eabb640 1 -- 172.21.15.88:0/4030952411 shutdown_connections 2024-01-22T10:13:48.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.044+0000 7ff53eabb640 1 -- 172.21.15.88:0/4030952411 wait complete. 2024-01-22T10:13:48.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.044+0000 7ff53eabb640 1 Processor -- start 2024-01-22T10:13:48.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.045+0000 7ff53eabb640 1 -- start start 2024-01-22T10:13:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.045+0000 7ff53eabb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538146bf0 0x7ff538145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.045+0000 7ff53eabb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff538146fd0 0x7ff5381476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.045+0000 7ff53eabb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff53814c880 0x7ff538147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.045+0000 7ff53eabb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff538148900 con 0x7ff538146bf0 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.045+0000 7ff53eabb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53813b000 con 0x7ff53814c880 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.045+0000 7ff53eabb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5381e1180 con 0x7ff538146fd0 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.045+0000 7ff53c857640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538146bf0 0x7ff538145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.045+0000 7ff53c857640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538146bf0 0x7ff538145fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45390/0 (socket says 172.21.15.88:45390) 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.045+0000 7ff53c857640 1 -- 172.21.15.88:0/2002359222 learned_addr learned my addr 172.21.15.88:0/2002359222 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff53d058640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff53814c880 0x7ff538147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff537fff640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff538146fd0 0x7ff5381476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff53c857640 1 -- 172.21.15.88:0/2002359222 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff538146fd0 msgr2=0x7ff5381476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff53c857640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff538146fd0 0x7ff5381476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff53c857640 1 -- 172.21.15.88:0/2002359222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff53814c880 msgr2=0x7ff538147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff53c857640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff53814c880 0x7ff538147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff53c857640 1 -- 172.21.15.88:0/2002359222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5381e1420 con 0x7ff538146bf0 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff53c857640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538146bf0 0x7ff538145fb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff528006f00 tx=0x7ff52800f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:48.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff5357fa640 1 -- 172.21.15.88:0/2002359222 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528014870 con 0x7ff538146bf0 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff5357fa640 1 -- 172.21.15.88:0/2002359222 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5280149d0 con 0x7ff538146bf0 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff53eabb640 1 -- 172.21.15.88:0/2002359222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5381e1700 con 0x7ff538146bf0 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff5357fa640 1 -- 172.21.15.88:0/2002359222 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528014d40 con 0x7ff538146bf0 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.046+0000 7ff53eabb640 1 -- 172.21.15.88:0/2002359222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5381464f0 con 0x7ff538146bf0 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.048+0000 7ff5357fa640 1 -- 172.21.15.88:0/2002359222 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7ff52801d400 con 0x7ff538146bf0 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.048+0000 7ff5357fa640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff52406b360 0x7ff52406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.048+0000 7ff5357fa640 1 -- 172.21.15.88:0/2002359222 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff52808a2a0 con 0x7ff538146bf0 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.048+0000 7ff537fff640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff52406b360 0x7ff52406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.048+0000 7ff537fff640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff52406b360 0x7ff52406d820 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff52c001050 tx=0x7ff52c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.049+0000 7ff54167d740 1 Processor -- start 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.049+0000 7ff54167d740 1 -- start start 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.049+0000 7ff54167d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 0x55f4239ea980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.049+0000 7ff54167d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4239eaec0 0x55f423a1b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.049+0000 7ff54167d740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a1be00 0x55f423a1c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.049+0000 7ff54167d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4239ab4f0 con 0x55f423a26520 2024-01-22T10:13:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.049+0000 7ff54167d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42395ce60 con 0x55f4239eaec0 2024-01-22T10:13:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.049+0000 7ff54167d740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f42395a550 con 0x55f423a1be00 2024-01-22T10:13:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff53c857640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 0x55f4239ea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff53c857640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 0x55f4239ea980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45400/0 (socket says 172.21.15.88:45400) 2024-01-22T10:13:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff53c857640 1 -- 172.21.15.88:0/3705968771 learned_addr learned my addr 172.21.15.88:0/3705968771 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff53d058640 1 --2- 172.21.15.88:0/3705968771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a1be00 0x55f423a1c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff537fff640 1 --2- 172.21.15.88:0/3705968771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4239eaec0 0x55f423a1b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff53c857640 1 -- 172.21.15.88:0/3705968771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a1be00 msgr2=0x55f423a1c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff53c857640 1 --2- 172.21.15.88:0/3705968771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a1be00 0x55f423a1c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff53c857640 1 -- 172.21.15.88:0/3705968771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4239eaec0 msgr2=0x55f423a1b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff53c857640 1 --2- 172.21.15.88:0/3705968771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4239eaec0 0x55f423a1b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff53c857640 1 -- 172.21.15.88:0/3705968771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f42394db00 con 0x55f423a26520 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff53c857640 1 --2- 172.21.15.88:0/3705968771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 0x55f4239ea980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff528088740 tx=0x7ff528058610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5a8ca35e27921 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff51e7fc640 1 -- 172.21.15.88:0/3705968771 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528083070 con 0x55f423a26520 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff51e7fc640 1 -- 172.21.15.88:0/3705968771 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52805cd40 con 0x55f423a26520 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.050+0000 7ff51e7fc640 1 -- 172.21.15.88:0/3705968771 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528060ef0 con 0x55f423a26520 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.051+0000 7ff54167d740 1 -- 172.21.15.88:0/3705968771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 msgr2=0x55f4239ea980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.051+0000 7ff54167d740 1 --2- 172.21.15.88:0/3705968771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 0x55f4239ea980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff528088740 tx=0x7ff528058610 comp rx=0 tx=0).stop 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.051+0000 7ff54167d740 1 -- 172.21.15.88:0/3705968771 shutdown_connections 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.051+0000 7ff54167d740 1 --2- 172.21.15.88:0/3705968771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a1be00 0x55f423a1c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.051+0000 7ff54167d740 1 --2- 172.21.15.88:0/3705968771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f4239eaec0 0x55f423a1b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.051+0000 7ff54167d740 1 --2- 172.21.15.88:0/3705968771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 0x55f4239ea980 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.051+0000 7ff54167d740 1 -- 172.21.15.88:0/3705968771 >> 172.21.15.88:0/3705968771 conn(0x55f4239ec310 msgr2=0x55f423a25c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.051+0000 7ff54167d740 1 -- 172.21.15.88:0/3705968771 shutdown_connections 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.051+0000 7ff54167d740 1 -- 172.21.15.88:0/3705968771 wait complete. 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.051+0000 7ff54167d740 1 -- start start 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.051+0000 7ff54167d740 1 Processor -- start 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff54167d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a1be00 0x55f423a15610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff54167d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 0x55f423a1b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff54167d740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a184c0 0x55f423a35680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff54167d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f423955e40 con 0x55f423a26520 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff54167d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f42390f250 con 0x55f423a1be00 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff54167d740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f42390eef0 con 0x55f423a184c0 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff54167d740 10 client.0 _ll_register_callbacks cb 0x55f423666ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff537fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 0x55f423a1b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff537fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 0x55f423a1b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45404/0 (socket says 172.21.15.88:45404) 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff537fff640 1 -- 172.21.15.88:0/2076507287 learned_addr learned my addr 172.21.15.88:0/2076507287 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff53c857640 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a1be00 0x55f423a15610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff53d058640 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a184c0 0x55f423a35680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff537fff640 1 -- 172.21.15.88:0/2076507287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a184c0 msgr2=0x55f423a35680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff537fff640 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a184c0 0x55f423a35680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff537fff640 1 -- 172.21.15.88:0/2076507287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a1be00 msgr2=0x55f423a15610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff537fff640 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a1be00 0x55f423a15610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.052+0000 7ff537fff640 1 -- 172.21.15.88:0/2076507287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5381464f0 con 0x55f423a26520 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff537fff640 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 0x55f423a1b400 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff52c015700 tx=0x7ff52c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6e24724080f39d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff5177fe640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff5177fe640 1 -- 172.21.15.88:0/2076507287 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0148e0 con 0x55f423a26520 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff5177fe640 1 -- 172.21.15.88:0/2076507287 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff52c01a040 con 0x55f423a26520 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff54167d740 1 -- 172.21.15.88:0/2076507287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f42394ecd0 con 0x55f423a26520 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff5177fe640 1 -- 172.21.15.88:0/2076507287 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff52c014a40 con 0x55f423a26520 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff54167d740 10 client.5163 fetch_fsmap learned FSMap version 14 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff54167d740 1 -- 172.21.15.88:0/2076507287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55f4239544c0 con 0x55f423a26520 2024-01-22T10:13:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff5177fe640 1 -- 172.21.15.88:0/2076507287 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c030020 con 0x55f423a26520 2024-01-22T10:13:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff5177fe640 1 -- 172.21.15.88:0/2076507287 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 14) v1 ==== 2719+0+0 (secure 0 0 0) 0x7ff52c020040 con 0x55f423a26520 2024-01-22T10:13:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff54167d740 10 client.5163 fetch_fsmap finished waiting for FSMap version 14 2024-01-22T10:13:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff54167d740 10 client.5163 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T10:13:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff54167d740 20 client.5163 populate_metadata read hostname 'smithi088' 2024-01-22T10:13:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff54167d740 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.88:6834/2577795457,v1:172.21.15.88:6836/2577795457] conn(0x55f423a14070 0x55f423a36090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff54167d740 4 client.5163 mds_command: new command op to 4983 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-22T10:13:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff54167d740 1 -- 172.21.15.88:0/2076507287 --> [v2:172.21.15.88:6834/2577795457,v1:172.21.15.88:6836/2577795457] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f42394e9f0 con 0x55f423a14070 2024-01-22T10:13:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.053+0000 7ff53c857640 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.88:6834/2577795457,v1:172.21.15.88:6836/2577795457] conn(0x55f423a14070 0x55f423a36090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff5177fe640 10 client.5163 ms_handle_connect on v2:172.21.15.88:6834/2577795457 2024-01-22T10:13:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff53c857640 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.88:6834/2577795457,v1:172.21.15.88:6836/2577795457] conn(0x55f423a14070 0x55f423a36090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b49a7329bd968e96 server_cookie=d9303ddbf79ce4dd in_seq=0 out_seq=0 2024-01-22T10:13:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff5177fe640 1 -- 172.21.15.88:0/2076507287 <== mds.0 v2:172.21.15.88:6834/2577795457 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f42394e9f0 con 0x55f423a14070 2024-01-22T10:13:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff5177fe640 10 client.5163 handle_command_reply: tid=0 2024-01-22T10:13:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff54167d740 1 client.5163 shutdown 2024-01-22T10:13:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff54167d740 1 -- 172.21.15.88:0/2076507287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 msgr2=0x55f423a1b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff54167d740 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 0x55f423a1b400 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff52c015700 tx=0x7ff52c001a00 comp rx=0 tx=0).stop 2024-01-22T10:13:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff54167d740 1 -- 172.21.15.88:0/2076507287 shutdown_connections 2024-01-22T10:13:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff54167d740 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.88:6834/2577795457,v1:172.21.15.88:6836/2577795457] conn(0x55f423a14070 0x55f423a36090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff54167d740 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a184c0 0x55f423a35680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff54167d740 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a26520 0x55f423a1b400 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff5177fe640 0 client.5163 ms_handle_reset on v2:172.21.15.88:6834/2577795457 2024-01-22T10:13:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff54167d740 1 --2- 172.21.15.88:0/2076507287 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a1be00 0x55f423a15610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff54167d740 1 -- 172.21.15.88:0/2076507287 >> 172.21.15.88:0/2076507287 conn(0x55f4239eaec0 msgr2=0x55f423a21570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff54167d740 1 -- 172.21.15.88:0/2076507287 shutdown_connections 2024-01-22T10:13:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff54167d740 1 -- 172.21.15.88:0/2076507287 wait complete. 2024-01-22T10:13:48.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.054+0000 7ff54167d740 20 client.5163 trim_cache size 0 max 16384 2024-01-22T10:13:48.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.070+0000 7ff54167d740 1 Processor -- start 2024-01-22T10:13:48.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.070+0000 7ff54167d740 1 -- start start 2024-01-22T10:13:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.070+0000 7ff54167d740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a184c0 0x55f423a3c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.070+0000 7ff54167d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 0x55f423a22770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.070+0000 7ff54167d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a26520 0x55f423a22cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.070+0000 7ff54167d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f423a20bc0 con 0x55f423a1be00 2024-01-22T10:13:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.070+0000 7ff54167d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4239eaab0 con 0x55f423a26520 2024-01-22T10:13:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.070+0000 7ff54167d740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4238d4300 con 0x55f423a184c0 2024-01-22T10:13:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.070+0000 7ff537fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 0x55f423a22770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.070+0000 7ff537fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 0x55f423a22770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45418/0 (socket says 172.21.15.88:45418) 2024-01-22T10:13:48.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.070+0000 7ff537fff640 1 -- 172.21.15.88:0/2411105922 learned_addr learned my addr 172.21.15.88:0/2411105922 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff53d058640 1 --2- 172.21.15.88:0/2411105922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a26520 0x55f423a22cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff53c857640 1 --2- 172.21.15.88:0/2411105922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a184c0 0x55f423a3c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff537fff640 1 -- 172.21.15.88:0/2411105922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a184c0 msgr2=0x55f423a3c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff537fff640 1 --2- 172.21.15.88:0/2411105922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a184c0 0x55f423a3c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff537fff640 1 -- 172.21.15.88:0/2411105922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a26520 msgr2=0x55f423a22cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff537fff640 1 --2- 172.21.15.88:0/2411105922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a26520 0x55f423a22cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff537fff640 1 -- 172.21.15.88:0/2411105922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f423986ca0 con 0x55f423a1be00 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff53d058640 1 --2- 172.21.15.88:0/2411105922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a26520 0x55f423a22cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff53c857640 1 --2- 172.21.15.88:0/2411105922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a184c0 0x55f423a3c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff537fff640 1 --2- 172.21.15.88:0/2411105922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 0x55f423a22770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff52c001020 tx=0x7ff52c022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c02eee639201bd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff51dffb640 1 -- 172.21.15.88:0/2411105922 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c014270 con 0x55f423a1be00 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff51dffb640 1 -- 172.21.15.88:0/2411105922 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c030070 con 0x55f423a1be00 2024-01-22T10:13:48.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.071+0000 7ff51dffb640 1 -- 172.21.15.88:0/2411105922 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c014b00 con 0x55f423a1be00 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.072+0000 7ff54167d740 1 -- 172.21.15.88:0/2411105922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 msgr2=0x55f423a22770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.072+0000 7ff54167d740 1 --2- 172.21.15.88:0/2411105922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 0x55f423a22770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff52c001020 tx=0x7ff52c022000 comp rx=0 tx=0).stop 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.072+0000 7ff54167d740 1 -- 172.21.15.88:0/2411105922 shutdown_connections 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.072+0000 7ff54167d740 1 --2- 172.21.15.88:0/2411105922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a26520 0x55f423a22cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.072+0000 7ff54167d740 1 --2- 172.21.15.88:0/2411105922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 0x55f423a22770 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.072+0000 7ff54167d740 1 --2- 172.21.15.88:0/2411105922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a184c0 0x55f423a3c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.072+0000 7ff54167d740 1 -- 172.21.15.88:0/2411105922 >> 172.21.15.88:0/2411105922 conn(0x55f4239eaec0 msgr2=0x55f423a35460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.072+0000 7ff54167d740 1 -- 172.21.15.88:0/2411105922 shutdown_connections 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.072+0000 7ff54167d740 1 -- 172.21.15.88:0/2411105922 wait complete. 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.072+0000 7ff54167d740 1 -- start start 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.072+0000 7ff54167d740 1 Processor -- start 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff54167d740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a184c0 0x55f423a2b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff54167d740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 0x55f423a2a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff54167d740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a26520 0x55f423a871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff54167d740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f423a296a0 con 0x55f423a1be00 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff54167d740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f423a90e30 con 0x55f423a184c0 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff54167d740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f423a12be0 con 0x55f423a26520 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff54167d740 10 client.0 _ll_register_callbacks cb 0x7ff5280043a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff537fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 0x55f423a2a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff537fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 0x55f423a2a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45424/0 (socket says 172.21.15.88:45424) 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff537fff640 1 -- 172.21.15.88:0/3281251958 learned_addr learned my addr 172.21.15.88:0/3281251958 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff53d058640 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a26520 0x55f423a871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff53c857640 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a184c0 0x55f423a2b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff537fff640 1 -- 172.21.15.88:0/3281251958 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a26520 msgr2=0x55f423a871c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff537fff640 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a26520 0x55f423a871c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff537fff640 1 -- 172.21.15.88:0/3281251958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a184c0 msgr2=0x55f423a2b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff537fff640 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a184c0 0x55f423a2b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff537fff640 1 -- 172.21.15.88:0/3281251958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4239544c0 con 0x55f423a1be00 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff53c857640 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a184c0 0x55f423a2b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff537fff640 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 0x55f423a2a3a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff52c001930 tx=0x7ff52c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5352176197b302bf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.073+0000 7ff5177fe640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff5177fe640 1 -- 172.21.15.88:0/3281251958 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c03c070 con 0x55f423a1be00 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff5177fe640 1 -- 172.21.15.88:0/3281251958 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff52c01a070 con 0x55f423a1be00 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff54167d740 1 -- 172.21.15.88:0/3281251958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff52805cd40 con 0x55f423a1be00 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff5177fe640 1 -- 172.21.15.88:0/3281251958 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff52c014af0 con 0x55f423a1be00 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff54167d740 10 client.5169 fetch_fsmap learned FSMap version 14 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff54167d740 1 -- 172.21.15.88:0/3281251958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55f4238f1150 con 0x55f423a1be00 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff5177fe640 1 -- 172.21.15.88:0/3281251958 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52805cd40 con 0x55f423a1be00 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff5177fe640 1 -- 172.21.15.88:0/3281251958 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 14) v1 ==== 2719+0+0 (secure 0 0 0) 0x7ff52c014c50 con 0x55f423a1be00 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff54167d740 10 client.5169 fetch_fsmap finished waiting for FSMap version 14 2024-01-22T10:13:48.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff54167d740 10 client.5169 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff54167d740 20 client.5169 populate_metadata read hostname 'smithi088' 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff54167d740 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.88:6834/2577795457,v1:172.21.15.88:6836/2577795457] conn(0x55f423a877c0 0x55f4239e91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff54167d740 4 client.5169 mds_command: new command op to 4983 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff54167d740 1 -- 172.21.15.88:0/3281251958 --> [v2:172.21.15.88:6834/2577795457,v1:172.21.15.88:6836/2577795457] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f4236556c0 con 0x55f423a877c0 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff53c857640 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.88:6834/2577795457,v1:172.21.15.88:6836/2577795457] conn(0x55f423a877c0 0x55f4239e91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff5177fe640 10 client.5169 ms_handle_connect on v2:172.21.15.88:6834/2577795457 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.074+0000 7ff53c857640 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.88:6834/2577795457,v1:172.21.15.88:6836/2577795457] conn(0x55f423a877c0 0x55f4239e91b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aa789122f92d650 server_cookie=36a7663f75baa10 in_seq=0 out_seq=0 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff5177fe640 1 -- 172.21.15.88:0/3281251958 <== mds.0 v2:172.21.15.88:6834/2577795457 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f4236556c0 con 0x55f423a877c0 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff5177fe640 10 client.5169 handle_command_reply: tid=0 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff54167d740 1 client.5169 shutdown 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff54167d740 1 -- 172.21.15.88:0/3281251958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 msgr2=0x55f423a2a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff54167d740 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 0x55f423a2a3a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff52c001930 tx=0x7ff52c016000 comp rx=0 tx=0).stop 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff54167d740 1 -- 172.21.15.88:0/3281251958 shutdown_connections 2024-01-22T10:13:48.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff54167d740 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.88:6834/2577795457,v1:172.21.15.88:6836/2577795457] conn(0x55f423a877c0 0x55f4239e91b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff54167d740 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f423a26520 0x55f423a871c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff5177fe640 0 client.5169 ms_handle_reset on v2:172.21.15.88:6834/2577795457 2024-01-22T10:13:48.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff54167d740 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f423a1be00 0x55f423a2a3a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff54167d740 1 --2- 172.21.15.88:0/3281251958 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f423a184c0 0x55f423a2b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff54167d740 1 -- 172.21.15.88:0/3281251958 >> 172.21.15.88:0/3281251958 conn(0x55f4239eaec0 msgr2=0x55f4239e5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:48.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff54167d740 1 -- 172.21.15.88:0/3281251958 shutdown_connections 2024-01-22T10:13:48.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff54167d740 1 -- 172.21.15.88:0/3281251958 wait complete. 2024-01-22T10:13:48.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff54167d740 20 client.5169 trim_cache size 0 max 16384 2024-01-22T10:13:48.065 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-01-22T10:13:48.065 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "f2d9b200-f96e-479f-bf7c-16080c3af8a6", 2024-01-22T10:13:48.066 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2024-01-22T10:13:48.066 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4983, 2024-01-22T10:13:48.066 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2024-01-22T10:13:48.066 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2024-01-22T10:13:48.066 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2024-01-22T10:13:48.066 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 5.4693710160000002, 2024-01-22T10:13:48.066 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 14, 2024-01-22T10:13:48.066 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 30, 2024-01-22T10:13:48.066 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 30, 2024-01-22T10:13:48.066 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 12.373377244 2024-01-22T10:13:48.066 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-01-22T10:13:48.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff53eabb640 1 -- 172.21.15.88:0/2002359222 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff52406b360 msgr2=0x7ff52406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff53eabb640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff52406b360 0x7ff52406d820 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff52c001050 tx=0x7ff52c009040 comp rx=0 tx=0).stop 2024-01-22T10:13:48.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff53eabb640 1 -- 172.21.15.88:0/2002359222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538146bf0 msgr2=0x7ff538145fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff53eabb640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538146bf0 0x7ff538145fb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff528006f00 tx=0x7ff52800f970 comp rx=0 tx=0).stop 2024-01-22T10:13:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff53eabb640 1 -- 172.21.15.88:0/2002359222 shutdown_connections 2024-01-22T10:13:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff53eabb640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7ff52406b360 0x7ff52406d820 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff53eabb640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff538146fd0 0x7ff5381476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff53eabb640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff53814c880 0x7ff538147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff53eabb640 1 --2- 172.21.15.88:0/2002359222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff538146bf0 0x7ff538145fb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff53eabb640 1 -- 172.21.15.88:0/2002359222 >> 172.21.15.88:0/2002359222 conn(0x7ff5380bec50 msgr2=0x7ff5380bf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff53eabb640 1 -- 172.21.15.88:0/2002359222 shutdown_connections 2024-01-22T10:13:48.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.075+0000 7ff53eabb640 1 -- 172.21.15.88:0/2002359222 wait complete. 2024-01-22T10:13:48.069 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-22T10:13:48.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.187+0000 7fb0e7aee640 1 Processor -- start 2024-01-22T10:13:48.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.187+0000 7fb0e7aee640 1 -- start start 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.187+0000 7fb0e7aee640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0e006d2b0 0x7fb0e014bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.187+0000 7fb0e7aee640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb0e006baa0 0x7fb0e006bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.187+0000 7fb0e7aee640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e014b700 con 0x7fb0e00a40c0 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.187+0000 7fb0e7aee640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e006f340 con 0x7fb0e006d2b0 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.187+0000 7fb0e7aee640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e006de90 con 0x7fb0e006baa0 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.188+0000 7fb0e588a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0e006d2b0 0x7fb0e014bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.188+0000 7fb0e608b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb0e00a40c0 0x7fb0e014ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46590/0 (socket says 172.21.15.88:46590) 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.188+0000 7fb0e588a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0e006d2b0 0x7fb0e014bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45428/0 (socket says 172.21.15.88:45428) 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.188+0000 7fb0e608b640 1 -- 172.21.15.88:0/909755612 learned_addr learned my addr 172.21.15.88:0/909755612 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.188+0000 7fb0e5089640 1 --2- 172.21.15.88:0/909755612 >> v2:172.21.15.119:3300/0 conn(0x7fb0e006baa0 0x7fb0e006bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.188+0000 7fb0e588a640 1 -- 172.21.15.88:0/909755612 >> v2:172.21.15.119:3300/0 conn(0x7fb0e006baa0 msgr2=0x7fb0e006bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.188+0000 7fb0e588a640 1 --2- 172.21.15.88:0/909755612 >> v2:172.21.15.119:3300/0 conn(0x7fb0e006baa0 0x7fb0e006bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.188+0000 7fb0e588a640 1 -- 172.21.15.88:0/909755612 >> v1:172.21.15.88:6789/0 conn(0x7fb0e00a40c0 legacy=0x7fb0e014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.188+0000 7fb0e588a640 1 -- 172.21.15.88:0/909755612 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e006f5e0 con 0x7fb0e006d2b0 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.188+0000 7fb0e4888640 1 -- 172.21.15.88:0/909755612 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362665063 0 0) 0x7fb0e014b700 con 0x7fb0e00a40c0 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.189+0000 7fb0e588a640 1 --2- 172.21.15.88:0/909755612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0e006d2b0 0x7fb0e014bee0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0072530 tx=0x7fb0dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e644cd8bc5c369 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.189+0000 7fb0e4888640 1 -- 172.21.15.88:0/909755612 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc031830 con 0x7fb0e006d2b0 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.189+0000 7fb0e4888640 1 -- 172.21.15.88:0/909755612 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc031990 con 0x7fb0e006d2b0 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.189+0000 7fb0e4888640 1 -- 172.21.15.88:0/909755612 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc031d20 con 0x7fb0e006d2b0 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.189+0000 7fb0e7aee640 1 -- 172.21.15.88:0/909755612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0e006d2b0 msgr2=0x7fb0e014bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.189+0000 7fb0e7aee640 1 --2- 172.21.15.88:0/909755612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0e006d2b0 0x7fb0e014bee0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0072530 tx=0x7fb0dc02b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.189+0000 7fb0e7aee640 1 -- 172.21.15.88:0/909755612 shutdown_connections 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.189+0000 7fb0e7aee640 1 --2- 172.21.15.88:0/909755612 >> v2:172.21.15.119:3300/0 conn(0x7fb0e006baa0 0x7fb0e006bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.189+0000 7fb0e7aee640 1 --2- 172.21.15.88:0/909755612 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0e006d2b0 0x7fb0e014bee0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.189+0000 7fb0e7aee640 1 -- 172.21.15.88:0/909755612 >> 172.21.15.88:0/909755612 conn(0x7fb0e00bb8d0 msgr2=0x7fb0e00bbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.189+0000 7fb0e7aee640 1 -- 172.21.15.88:0/909755612 shutdown_connections 2024-01-22T10:13:48.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.189+0000 7fb0e7aee640 1 -- 172.21.15.88:0/909755612 wait complete. 2024-01-22T10:13:48.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.190+0000 7fb0e7aee640 1 Processor -- start 2024-01-22T10:13:48.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.190+0000 7fb0e7aee640 1 -- start start 2024-01-22T10:13:48.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e7aee640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0e006baa0 0x7fb0e0146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e7aee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e006d2b0 0x7fb0e0147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e7aee640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e00a40c0 0x7fb0e01482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e7aee640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e01471c0 con 0x7fb0e006baa0 2024-01-22T10:13:48.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e7aee640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e01e0fa0 con 0x7fb0e006d2b0 2024-01-22T10:13:48.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e7aee640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e01e1280 con 0x7fb0e00a40c0 2024-01-22T10:13:48.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e588a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0e006baa0 0x7fb0e0146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e588a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0e006baa0 0x7fb0e0146c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45442/0 (socket says 172.21.15.88:45442) 2024-01-22T10:13:48.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e588a640 1 -- 172.21.15.88:0/1649152381 learned_addr learned my addr 172.21.15.88:0/1649152381 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:48.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e5089640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e006d2b0 0x7fb0e0147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e608b640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e00a40c0 0x7fb0e01482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e588a640 1 -- 172.21.15.88:0/1649152381 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e00a40c0 msgr2=0x7fb0e01482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e588a640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e00a40c0 0x7fb0e01482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e588a640 1 -- 172.21.15.88:0/1649152381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e006d2b0 msgr2=0x7fb0e0147650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e588a640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e006d2b0 0x7fb0e0147650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e588a640 1 -- 172.21.15.88:0/1649152381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc009400 con 0x7fb0e006baa0 2024-01-22T10:13:48.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.191+0000 7fb0e588a640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0e006baa0 0x7fb0e0146c80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009890 tx=0x7fb0dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:48.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.192+0000 7fb0d67fc640 1 -- 172.21.15.88:0/1649152381 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc03ba70 con 0x7fb0e006baa0 2024-01-22T10:13:48.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.192+0000 7fb0d67fc640 1 -- 172.21.15.88:0/1649152381 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc03bbf0 con 0x7fb0e006baa0 2024-01-22T10:13:48.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.192+0000 7fb0e7aee640 1 -- 172.21.15.88:0/1649152381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e01e1560 con 0x7fb0e006baa0 2024-01-22T10:13:48.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.192+0000 7fb0d67fc640 1 -- 172.21.15.88:0/1649152381 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc045400 con 0x7fb0e006baa0 2024-01-22T10:13:48.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.192+0000 7fb0e7aee640 1 -- 172.21.15.88:0/1649152381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e01490c0 con 0x7fb0e006baa0 2024-01-22T10:13:48.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.193+0000 7fb0e7aee640 1 -- 172.21.15.88:0/1649152381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e0067c40 con 0x7fb0e006baa0 2024-01-22T10:13:48.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.193+0000 7fb0d67fc640 1 -- 172.21.15.88:0/1649152381 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fb0dc04e440 con 0x7fb0e006baa0 2024-01-22T10:13:48.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.193+0000 7fb0d67fc640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb0c406b330 0x7fb0c406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:48.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.194+0000 7fb0d67fc640 1 -- 172.21.15.88:0/1649152381 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0dc0abdc0 con 0x7fb0e006baa0 2024-01-22T10:13:48.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.194+0000 7fb0e5089640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb0c406b330 0x7fb0c406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:48.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.194+0000 7fb0e5089640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb0c406b330 0x7fb0c406d7f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb0e01e53e0 tx=0x7fb0d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:48.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.198+0000 7fb0d67fc640 1 -- 172.21.15.88:0/1649152381 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb0dc076ae0 con 0x7fb0e006baa0 2024-01-22T10:13:48.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.401+0000 7fb0e7aee640 1 -- 172.21.15.88:0/1649152381 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0e01e0df0 con 0x7fb0e006baa0 2024-01-22T10:13:48.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.401+0000 7fb0d67fc640 1 -- 172.21.15.88:0/1649152381 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb0dc035070 con 0x7fb0e006baa0 2024-01-22T10:13:48.384 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-22T10:13:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.403+0000 7fb0e7aee640 1 -- 172.21.15.88:0/1649152381 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb0c406b330 msgr2=0x7fb0c406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.403+0000 7fb0e7aee640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb0c406b330 0x7fb0c406d7f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb0e01e53e0 tx=0x7fb0d0008040 comp rx=0 tx=0).stop 2024-01-22T10:13:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.403+0000 7fb0e7aee640 1 -- 172.21.15.88:0/1649152381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0e006baa0 msgr2=0x7fb0e0146c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.403+0000 7fb0e7aee640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0e006baa0 0x7fb0e0146c80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009890 tx=0x7fb0dc0046c0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.403+0000 7fb0e7aee640 1 -- 172.21.15.88:0/1649152381 shutdown_connections 2024-01-22T10:13:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.403+0000 7fb0e7aee640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb0c406b330 0x7fb0c406d7f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.403+0000 7fb0e7aee640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e00a40c0 0x7fb0e01482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.403+0000 7fb0e7aee640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e006d2b0 0x7fb0e0147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.403+0000 7fb0e7aee640 1 --2- 172.21.15.88:0/1649152381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0e006baa0 0x7fb0e0146c80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.403+0000 7fb0e7aee640 1 -- 172.21.15.88:0/1649152381 >> 172.21.15.88:0/1649152381 conn(0x7fb0e00bb8d0 msgr2=0x7fb0e00bd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.403+0000 7fb0e7aee640 1 -- 172.21.15.88:0/1649152381 shutdown_connections 2024-01-22T10:13:48.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:48.403+0000 7fb0e7aee640 1 -- 172.21.15.88:0/1649152381 wait complete. 2024-01-22T10:13:48.396 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-22T10:13:48.396 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-22T10:13:48.396 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2024-01-22T10:13:48.396 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-22T10:13:48.396 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-22T10:13:48.396 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-22T10:13:48.396 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-22T10:13:48.396 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-22T10:13:48.396 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T10:13:48.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:48.397 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2024-01-22T10:13:48.455 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-22T10:13:48.455 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-22T10:13:48.455 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-01-22T10:13:48.455 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-22T10:13:48.455 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-01-22T10:13:48.455 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-22T10:13:48.455 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T10:13:48.455 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42633sec preferred_lft 42633sec 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-22T10:13:48.456 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-22T10:13:48.457 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 86:01:1e:6e:c3:41 brd ff:ff:ff:ff:ff:ff 2024-01-22T10:13:48.457 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-22T10:13:48.457 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-22T10:13:48.457 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::18ba:8eff:fe1a:f2af/64 scope link 2024-01-22T10:13:48.457 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-22T10:13:48.457 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-22T10:13:48.457 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 86:01:1e:6e:c3:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T10:13:48.457 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::8401:1eff:fe6e:c341/64 scope link 2024-01-22T10:13:48.457 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-01-22T10:13:48.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:48.458 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-22T10:13:48.549 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-01-22T10:13:48.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:48.553 DEBUG:teuthology.orchestra.run.smithi161:> route 2024-01-22T10:13:48.608 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2024-01-22T10:13:48.608 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-22T10:13:48.608 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-22T10:13:48.608 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-22T10:13:48.609 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-22T10:13:48.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:48.609 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-01-22T10:13:48.609 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-01-22T10:13:48.609 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-22T10:13:48.609 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-22T10:13:48.609 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-22T10:13:48.609 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-01-22T10:13:48.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:48.795 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-01-22T10:13:48.845 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T10:13:48.845 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-22T10:13:48.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:48.846 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2024-01-22T10:13:48.936 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-22T10:13:48.936 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-22T10:13:48.988 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-22T10:13:48.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-22T10:13:48.989 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-22T10:13:49.040 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-01-22T10:13:49.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:49.041 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-22T10:13:49.169 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-22T10:13:49.169 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-22T10:13:49.170 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2024-01-22T10:13:49.190 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-22T10:13:49.190 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-22T10:13:49.190 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2024-01-22T10:13:49.190 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.119:3300,172.21.15.119:3301" 2024-01-22T10:13:49.190 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-22T10:13:49.216 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-01-22T10:13:49.216 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-01-22T10:13:49.217 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2024-01-22T10:13:49.217 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.119:3300,172.21.15.119:3301" 2024-01-22T10:13:49.217 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2024-01-22T10:13:49.217 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.88:6789,172.21.15.119:6789,172.21.15.119:6790" 2024-01-22T10:13:49.217 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.88:6789,172.21.15.119:6789,172.21.15.119:6790:/ 2024-01-22T10:13:49.217 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f2d9b200-f96e-479f-bf7c-16080c3af8a6" will pass to kernel 2024-01-22T10:13:49.219 INFO:teuthology.orchestra.run.smithi161.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-22T10:13:49.219 INFO:teuthology.orchestra.run.smithi161.stdout: You just mounted a file system that supports labels which does not 2024-01-22T10:13:49.219 INFO:teuthology.orchestra.run.smithi161.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-22T10:13:49.219 INFO:teuthology.orchestra.run.smithi161.stdout: applications will generate AVC messages and not be allowed access to 2024-01-22T10:13:49.219 INFO:teuthology.orchestra.run.smithi161.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-22T10:13:49.223 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-22T10:13:49.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:49.223 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-22T10:13:49.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:49.300 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-22T10:13:49.361 INFO:teuthology.orchestra.run.smithi161.stdout:client5181 2024-01-22T10:13:49.361 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:13:49.361 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-22T10:13:49.411 DEBUG:teuthology.orchestra.run.smithi161:> mktemp -d --suffix=xfstests-dev 2024-01-22T10:13:49.506 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.5e3ymg2iybxfstests-dev 2024-01-22T10:13:49.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:49.506 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.5e3ymg2iybxfstests-dev) 2024-01-22T10:13:49.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:49.594 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.5e3ymg2iybxfstests-dev) 2024-01-22T10:13:49.655 INFO:teuthology.orchestra.run.smithi161.stderr:Cloning into '/tmp/tmp.5e3ymg2iybxfstests-dev'... 2024-01-22T10:13:50.670 DEBUG:teuthology.orchestra.run.smithi161:> mktemp -d --suffix=xfsprogs-dev 2024-01-22T10:13:50.721 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.dUFqxEPsmrxfsprogs-dev 2024-01-22T10:13:50.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:50.721 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.dUFqxEPsmrxfsprogs-dev) 2024-01-22T10:13:50.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:50.809 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.dUFqxEPsmrxfsprogs-dev) 2024-01-22T10:13:50.860 INFO:teuthology.orchestra.run.smithi161.stderr:Cloning into '/tmp/tmp.dUFqxEPsmrxfsprogs-dev'... 2024-01-22T10:13:51.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:51.497 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-01-22T10:13:51.556 DEBUG:teuthology.orchestra.run.smithi161:> mktemp -d --suffix=test 2024-01-22T10:13:51.608 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.U5glxhS8uStest 2024-01-22T10:13:51.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:51.608 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-01-22T10:13:51.664 DEBUG:teuthology.orchestra.run.smithi161:> mktemp -d --suffix=scratch 2024-01-22T10:13:51.713 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.1i7Ko94Pipscratch 2024-01-22T10:13:51.713 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-01-22T10:13:51.713 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel 2024-01-22T10:13:52.544 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:03:22 ago on Mon 22 Jan 2024 10:10:30 AM UTC. 2024-01-22T10:13:52.649 INFO:teuthology.orchestra.run.smithi161.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-01-22T10:13:52.650 INFO:teuthology.orchestra.run.smithi161.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-01-22T10:13:52.651 INFO:teuthology.orchestra.run.smithi161.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-01-22T10:13:52.652 INFO:teuthology.orchestra.run.smithi161.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-01-22T10:13:52.653 INFO:teuthology.orchestra.run.smithi161.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-01-22T10:13:52.654 INFO:teuthology.orchestra.run.smithi161.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-01-22T10:13:52.656 INFO:teuthology.orchestra.run.smithi161.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-01-22T10:13:52.657 INFO:teuthology.orchestra.run.smithi161.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-01-22T10:13:52.659 INFO:teuthology.orchestra.run.smithi161.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-01-22T10:13:52.661 INFO:teuthology.orchestra.run.smithi161.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-01-22T10:13:52.662 INFO:teuthology.orchestra.run.smithi161.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-01-22T10:13:52.664 INFO:teuthology.orchestra.run.smithi161.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-01-22T10:13:52.665 INFO:teuthology.orchestra.run.smithi161.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2024-01-22T10:13:52.666 INFO:teuthology.orchestra.run.smithi161.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-01-22T10:13:52.666 INFO:teuthology.orchestra.run.smithi161.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-01-22T10:13:52.668 INFO:teuthology.orchestra.run.smithi161.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-01-22T10:13:52.668 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-01-22T10:13:52.669 INFO:teuthology.orchestra.run.smithi161.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-01-22T10:13:52.670 INFO:teuthology.orchestra.run.smithi161.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-01-22T10:13:52.673 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-01-22T10:13:52.676 INFO:teuthology.orchestra.run.smithi161.stdout:Package gettext-0.21-8.el9.x86_64 is already installed. 2024-01-22T10:13:52.678 INFO:teuthology.orchestra.run.smithi161.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-22T10:13:52.754 INFO:teuthology.orchestra.run.smithi161.stderr:Error: 2024-01-22T10:13:52.754 INFO:teuthology.orchestra.run.smithi161.stderr: Problem: package device-mapper-devel-9:1.02.195-3.el9.x86_64 from crb requires device-mapper = 9:1.02.195-3.el9, but none of the providers can be installed 2024-01-22T10:13:52.755 INFO:teuthology.orchestra.run.smithi161.stderr: - cannot install both device-mapper-9:1.02.197-1.el9.x86_64 from CentOS-BaseOS and device-mapper-9:1.02.195-3.el9.x86_64 from @System 2024-01-22T10:13:52.755 INFO:teuthology.orchestra.run.smithi161.stderr: - cannot install both device-mapper-9:1.02.195-3.el9.x86_64 from baseos and device-mapper-9:1.02.197-1.el9.x86_64 from CentOS-BaseOS 2024-01-22T10:13:52.755 INFO:teuthology.orchestra.run.smithi161.stderr: - package device-mapper-event-9:1.02.197-1.el9.x86_64 from CentOS-BaseOS requires device-mapper = 9:1.02.197-1.el9, but none of the providers can be installed 2024-01-22T10:13:52.755 INFO:teuthology.orchestra.run.smithi161.stderr: - package lvm2-9:2.03.23-1.el9.x86_64 from CentOS-BaseOS requires lvm2-libs = 9:2.03.23-1.el9, but none of the providers can be installed 2024-01-22T10:13:52.755 INFO:teuthology.orchestra.run.smithi161.stderr: - package lvm2-libs-9:2.03.23-1.el9.i686 from CentOS-BaseOS requires device-mapper-event = 9:1.02.197-1.el9, but none of the providers can be installed 2024-01-22T10:13:52.755 INFO:teuthology.orchestra.run.smithi161.stderr: - package lvm2-libs-9:2.03.23-1.el9.x86_64 from CentOS-BaseOS requires device-mapper-event = 9:1.02.197-1.el9, but none of the providers can be installed 2024-01-22T10:13:52.755 INFO:teuthology.orchestra.run.smithi161.stderr: - cannot install the best candidate for the job 2024-01-22T10:13:52.755 INFO:teuthology.orchestra.run.smithi161.stdout:(try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages) 2024-01-22T10:13:52.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:13:52.799 INFO:tasks.cephfs_test_runner:test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) ... ERROR 2024-01-22T10:13:52.799 INFO:tasks.cephfs_test_runner: 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner:ERROR: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1db5459e688287ea17e1bda532d3c81a51b40e23/qa/tasks/cephfs/xfstests_dev.py", line 29, in setUp 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1db5459e688287ea17e1bda532d3c81a51b40e23/qa/tasks/cephfs/xfstests_dev.py", line 44, in prepare_xfstests_devs 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner: self.install_deps() 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1db5459e688287ea17e1bda532d3c81a51b40e23/qa/tasks/cephfs/xfstests_dev.py", line 252, in install_deps 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-22T10:13:52.800 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi161 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel' 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner: 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner:Ran 1 test in 28.450s 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner: 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner: 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner:ERROR: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1db5459e688287ea17e1bda532d3c81a51b40e23/qa/tasks/cephfs/xfstests_dev.py", line 29, in setUp 2024-01-22T10:13:52.801 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1db5459e688287ea17e1bda532d3c81a51b40e23/qa/tasks/cephfs/xfstests_dev.py", line 44, in prepare_xfstests_devs 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: self.install_deps() 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1db5459e688287ea17e1bda532d3c81a51b40e23/qa/tasks/cephfs/xfstests_dev.py", line 252, in install_deps 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi161 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel' 2024-01-22T10:13:52.802 INFO:tasks.cephfs_test_runner: 2024-01-22T10:13:52.802 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1db5459e688287ea17e1bda532d3c81a51b40e23/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-01-22T10:13:53.043 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7183efa5b6184004b2482bb09606cdb5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1db5459e688287ea17e1bda532d3c81a51b40e23/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-01-22T10:13:53.045 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-22T10:13:53.059 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-22T10:13:53.067 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-22T10:13:53.067 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:13:53.067 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-22T10:13:53.125 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-01-22T10:13:53.125 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-22T10:13:53.175 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:53.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.303+0000 7f66fa475640 1 Processor -- start 2024-01-22T10:13:53.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.303+0000 7f66fa475640 1 -- start start 2024-01-22T10:13:53.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66fa475640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4148d90 0x7f66f40b96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66fa475640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f66f40b4ec0 0x7f66f40bdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66fa475640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f40b9c30 con 0x7f66f414ba30 2024-01-22T10:13:53.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66fa475640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f40b68b0 con 0x7f66f40b4ec0 2024-01-22T10:13:53.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66fa475640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f40b5500 con 0x7f66f4148d90 2024-01-22T10:13:53.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f8a12640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f66f414ba30 0x7f66f414bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46596/0 (socket says 172.21.15.88:46596) 2024-01-22T10:13:53.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f8a12640 1 -- 172.21.15.88:0/821566965 learned_addr learned my addr 172.21.15.88:0/821566965 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:53.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f3fff640 1 --2- 172.21.15.88:0/821566965 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4148d90 0x7f66f40b96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084531007 0 0) 0x7f66f40b9c30 con 0x7f66f414ba30 2024-01-22T10:13:53.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f37fe640 1 --2- 172.21.15.88:0/821566965 >> v2:172.21.15.119:3300/0 conn(0x7f66f40b4ec0 0x7f66f40bdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66dc003520 con 0x7f66f414ba30 2024-01-22T10:13:53.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3175019656 0 0) 0x7f66dc003520 con 0x7f66f414ba30 2024-01-22T10:13:53.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4148d90 msgr2=0x7f66f40b96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:53.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f2ffd640 1 --2- 172.21.15.88:0/821566965 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4148d90 0x7f66f40b96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 >> v2:172.21.15.119:3300/0 conn(0x7f66f40b4ec0 msgr2=0x7f66f40bdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:53.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f2ffd640 1 --2- 172.21.15.88:0/821566965 >> v2:172.21.15.119:3300/0 conn(0x7f66f40b4ec0 0x7f66f40bdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f40b5750 con 0x7f66f414ba30 2024-01-22T10:13:53.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f66ec0019f0 con 0x7f66f414ba30 2024-01-22T10:13:53.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 >> v1:172.21.15.88:6789/0 conn(0x7f66f414ba30 legacy=0x7f66f414bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f2ffd640 1 --2- 172.21.15.88:0/821566965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66dc003a50 0x7f66dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.304+0000 7f66f2ffd640 1 --2- 172.21.15.88:0/821566965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc0047c0 0x7f66dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.305+0000 7f66f2ffd640 1 --2- 172.21.15.88:0/821566965 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4148d90 0x7f66dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.305+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f40b5500 con 0x7f66dc003a50 2024-01-22T10:13:53.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.305+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc00b980 con 0x7f66dc0047c0 2024-01-22T10:13:53.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.305+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc00baf0 con 0x7f66f4148d90 2024-01-22T10:13:53.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.305+0000 7f66f3fff640 1 --2- 172.21.15.88:0/821566965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66dc003a50 0x7f66dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.305+0000 7f66f37fe640 1 --2- 172.21.15.88:0/821566965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc0047c0 0x7f66dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.305+0000 7f66f8a12640 1 --2- 172.21.15.88:0/821566965 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4148d90 0x7f66dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.305+0000 7f66f3fff640 1 -- 172.21.15.88:0/821566965 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4148d90 msgr2=0x7f66dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:53.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.305+0000 7f66f3fff640 1 --2- 172.21.15.88:0/821566965 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4148d90 0x7f66dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.305+0000 7f66f3fff640 1 -- 172.21.15.88:0/821566965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc0047c0 msgr2=0x7f66dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:53.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.305+0000 7f66f3fff640 1 --2- 172.21.15.88:0/821566965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc0047c0 0x7f66dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.305+0000 7f66f3fff640 1 -- 172.21.15.88:0/821566965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc003520 con 0x7f66dc003a50 2024-01-22T10:13:53.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.306+0000 7f66f3fff640 1 --2- 172.21.15.88:0/821566965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66dc003a50 0x7f66dc003e70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009ac0 tx=0x7f66dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7009692bb38b643d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:53.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.306+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e402c6b0 con 0x7f66dc003a50 2024-01-22T10:13:53.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.306+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e402c810 con 0x7f66dc003a50 2024-01-22T10:13:53.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.306+0000 7f66f2ffd640 1 -- 172.21.15.88:0/821566965 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e402cba0 con 0x7f66dc003a50 2024-01-22T10:13:53.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.306+0000 7f66fa475640 1 -- 172.21.15.88:0/821566965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66dc003a50 msgr2=0x7f66dc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.306+0000 7f66fa475640 1 --2- 172.21.15.88:0/821566965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66dc003a50 0x7f66dc003e70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009ac0 tx=0x7f66dc0057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.306+0000 7f66f8a12640 1 -- 172.21.15.88:0/821566965 reap_dead start 2024-01-22T10:13:53.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.306+0000 7f66fa475640 1 -- 172.21.15.88:0/821566965 shutdown_connections 2024-01-22T10:13:53.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.306+0000 7f66fa475640 1 -- 172.21.15.88:0/821566965 >> 172.21.15.88:0/821566965 conn(0x7f66f406ad20 msgr2=0x7f66f40bd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:53.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.306+0000 7f66fa475640 1 -- 172.21.15.88:0/821566965 shutdown_connections 2024-01-22T10:13:53.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.306+0000 7f66fa475640 1 -- 172.21.15.88:0/821566965 wait complete. 2024-01-22T10:13:53.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.307+0000 7f66fa475640 1 Processor -- start 2024-01-22T10:13:53.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.308+0000 7f66fa475640 1 -- start start 2024-01-22T10:13:53.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.308+0000 7f66fa475640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc003a50 0x7f66f41d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.308+0000 7f66fa475640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4143d50 0x7f66f41e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.308+0000 7f66fa475640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f41e4460 0x7f66f4140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.308+0000 7f66fa475640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41d2370 con 0x7f66f41e4460 2024-01-22T10:13:53.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.308+0000 7f66fa475640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41d1ab0 con 0x7f66dc003a50 2024-01-22T10:13:53.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.308+0000 7f66fa475640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41e48e0 con 0x7f66f4143d50 2024-01-22T10:13:53.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.308+0000 7f66f8a12640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f41e4460 0x7f66f4140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.308+0000 7f66f8a12640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f41e4460 0x7f66f4140e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45448/0 (socket says 172.21.15.88:45448) 2024-01-22T10:13:53.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.308+0000 7f66f8a12640 1 -- 172.21.15.88:0/3254713285 learned_addr learned my addr 172.21.15.88:0/3254713285 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:53.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.308+0000 7f66f3fff640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc003a50 0x7f66f41d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.308+0000 7f66f37fe640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4143d50 0x7f66f41e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.309+0000 7f66f8a12640 1 -- 172.21.15.88:0/3254713285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4143d50 msgr2=0x7f66f41e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.309+0000 7f66f8a12640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4143d50 0x7f66f41e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.309+0000 7f66f8a12640 1 -- 172.21.15.88:0/3254713285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc003a50 msgr2=0x7f66f41d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.309+0000 7f66f8a12640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc003a50 0x7f66f41d2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.309+0000 7f66f8a12640 1 -- 172.21.15.88:0/3254713285 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f41441d0 con 0x7f66f41e4460 2024-01-22T10:13:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.309+0000 7f66f8a12640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f41e4460 0x7f66f4140e40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f66f40be4a0 tx=0x7f66ec0079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:53.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.309+0000 7f66f0ff9640 1 -- 172.21.15.88:0/3254713285 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00aa20 con 0x7f66f41e4460 2024-01-22T10:13:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.309+0000 7f66f0ff9640 1 -- 172.21.15.88:0/3254713285 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec00ab80 con 0x7f66f41e4460 2024-01-22T10:13:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.309+0000 7f66f0ff9640 1 -- 172.21.15.88:0/3254713285 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0133f0 con 0x7f66f41e4460 2024-01-22T10:13:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.309+0000 7f66fa475640 1 -- 172.21.15.88:0/3254713285 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f41d3700 con 0x7f66f41e4460 2024-01-22T10:13:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.309+0000 7f66fa475640 1 -- 172.21.15.88:0/3254713285 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f41d2000 con 0x7f66f41e4460 2024-01-22T10:13:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.310+0000 7f66fa475640 1 -- 172.21.15.88:0/3254713285 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f41d21c0 con 0x7f66f41e4460 2024-01-22T10:13:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.310+0000 7f66f0ff9640 1 -- 172.21.15.88:0/3254713285 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f66ec013550 con 0x7f66f41e4460 2024-01-22T10:13:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.311+0000 7f66f0ff9640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f66e006b360 0x7f66e006d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.311+0000 7f66f3fff640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f66e006b360 0x7f66e006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.311+0000 7f66f0ff9640 1 -- 172.21.15.88:0/3254713285 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66ec08a2c0 con 0x7f66f41e4460 2024-01-22T10:13:53.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.311+0000 7f66f3fff640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f66e006b360 0x7f66e006d820 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f66e4036000 tx=0x7f66e4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:53.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.315+0000 7f66f0ff9640 1 -- 172.21.15.88:0/3254713285 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f66ec054fe0 con 0x7f66f41e4460 2024-01-22T10:13:53.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.483+0000 7f66fa475640 1 -- 172.21.15.88:0/3254713285 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66f406b6a0 con 0x7f66f41e4460 2024-01-22T10:13:53.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.484+0000 7f66f0ff9640 1 -- 172.21.15.88:0/3254713285 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16546 (secure 0 0 0) 0x7f66ec058600 con 0x7f66f41e4460 2024-01-22T10:13:53.467 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:53.467 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":30,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:43.614634+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:40.282454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:40.901002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:53.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.486+0000 7f66fa475640 1 -- 172.21.15.88:0/3254713285 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f66e006b360 msgr2=0x7f66e006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.486+0000 7f66fa475640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f66e006b360 0x7f66e006d820 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f66e4036000 tx=0x7f66e4030000 comp rx=0 tx=0).stop 2024-01-22T10:13:53.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.486+0000 7f66fa475640 1 -- 172.21.15.88:0/3254713285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f41e4460 msgr2=0x7f66f4140e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.486+0000 7f66fa475640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f41e4460 0x7f66f4140e40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f66f40be4a0 tx=0x7f66ec0079d0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.486+0000 7f66fa475640 1 -- 172.21.15.88:0/3254713285 shutdown_connections 2024-01-22T10:13:53.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.486+0000 7f66fa475640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f66e006b360 0x7f66e006d820 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.486+0000 7f66fa475640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66f4143d50 0x7f66f41e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.486+0000 7f66fa475640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66f41e4460 0x7f66f4140e40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.486+0000 7f66fa475640 1 --2- 172.21.15.88:0/3254713285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66dc003a50 0x7f66f41d2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.486+0000 7f66fa475640 1 -- 172.21.15.88:0/3254713285 >> 172.21.15.88:0/3254713285 conn(0x7f66f406ad20 msgr2=0x7f66f40b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:53.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.486+0000 7f66fa475640 1 -- 172.21.15.88:0/3254713285 shutdown_connections 2024-01-22T10:13:53.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.486+0000 7f66fa475640 1 -- 172.21.15.88:0/3254713285 wait complete. 2024-01-22T10:13:53.480 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-22T10:12:50.745945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-22T10:13:40.282454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-22T10:13:40.901002+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-22T10:13:53.480 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-22T10:13:53.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.599+0000 7f0a12905640 1 Processor -- start 2024-01-22T10:13:53.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.599+0000 7f0a12905640 1 -- start start 2024-01-22T10:13:53.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a12905640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0a0c06dd00 0x7f0a0c06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a12905640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0a0c06c410 0x7f0a0c155f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a12905640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c0a4860 con 0x7f0a0c14f7c0 2024-01-22T10:13:53.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a12905640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c06fe80 con 0x7f0a0c06c410 2024-01-22T10:13:53.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a12905640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c06c8b0 con 0x7f0a0c06dd00 2024-01-22T10:13:53.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a10ea2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0a0c06c410 0x7f0a0c155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a10ea2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0a0c06c410 0x7f0a0c155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45462/0 (socket says 172.21.15.88:45462) 2024-01-22T10:13:53.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a10ea2640 1 -- 172.21.15.88:0/1604322060 learned_addr learned my addr 172.21.15.88:0/1604322060 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:53.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a0b7fe640 1 --2- 172.21.15.88:0/1604322060 >> v2:172.21.15.119:3300/0 conn(0x7f0a0c06dd00 0x7f0a0c06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a10ea2640 1 -- 172.21.15.88:0/1604322060 >> v2:172.21.15.119:3300/0 conn(0x7f0a0c06dd00 msgr2=0x7f0a0c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:53.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a10ea2640 1 --2- 172.21.15.88:0/1604322060 >> v2:172.21.15.119:3300/0 conn(0x7f0a0c06dd00 0x7f0a0c06bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a10ea2640 1 -- 172.21.15.88:0/1604322060 >> v1:172.21.15.119:6789/0 conn(0x7f0a0c14f7c0 legacy=0x7f0a0c0a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.600+0000 7f0a10ea2640 1 -- 172.21.15.88:0/1604322060 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c06f8c0 con 0x7f0a0c06c410 2024-01-22T10:13:53.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.601+0000 7f0a10ea2640 1 --2- 172.21.15.88:0/1604322060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a0c06c410 0x7f0a0c155f10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0a4b10 tx=0x7f0a0402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4c1eb461b9472 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:53.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.601+0000 7f0a0affd640 1 -- 172.21.15.88:0/1604322060 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0402cbb0 con 0x7f0a0c06c410 2024-01-22T10:13:53.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.601+0000 7f0a0affd640 1 -- 172.21.15.88:0/1604322060 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0402cd10 con 0x7f0a0c06c410 2024-01-22T10:13:53.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.601+0000 7f0a0affd640 1 -- 172.21.15.88:0/1604322060 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04034610 con 0x7f0a0c06c410 2024-01-22T10:13:53.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.602+0000 7f0a12905640 1 -- 172.21.15.88:0/1604322060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a0c06c410 msgr2=0x7f0a0c155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.602+0000 7f0a12905640 1 --2- 172.21.15.88:0/1604322060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a0c06c410 0x7f0a0c155f10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0a4b10 tx=0x7f0a0402c010 comp rx=0 tx=0).stop 2024-01-22T10:13:53.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.602+0000 7f0a12905640 1 -- 172.21.15.88:0/1604322060 shutdown_connections 2024-01-22T10:13:53.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.602+0000 7f0a12905640 1 --2- 172.21.15.88:0/1604322060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a0c06c410 0x7f0a0c155f10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.602+0000 7f0a12905640 1 --2- 172.21.15.88:0/1604322060 >> v2:172.21.15.119:3300/0 conn(0x7f0a0c06dd00 0x7f0a0c06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.602+0000 7f0a12905640 1 -- 172.21.15.88:0/1604322060 >> 172.21.15.88:0/1604322060 conn(0x7f0a0c0bec60 msgr2=0x7f0a0c0bf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:53.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.602+0000 7f0a12905640 1 -- 172.21.15.88:0/1604322060 shutdown_connections 2024-01-22T10:13:53.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.602+0000 7f0a12905640 1 -- 172.21.15.88:0/1604322060 wait complete. 2024-01-22T10:13:53.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.603+0000 7f0a12905640 1 Processor -- start 2024-01-22T10:13:53.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.603+0000 7f0a12905640 1 -- start start 2024-01-22T10:13:53.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a12905640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a0c06c410 0x7f0a0c146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a12905640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a0c14f7c0 0x7f0a0c146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a12905640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a0c14b8a0 0x7f0a0c0b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a12905640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c1480c0 con 0x7f0a0c06c410 2024-01-22T10:13:53.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a12905640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c145cc0 con 0x7f0a0c14f7c0 2024-01-22T10:13:53.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a12905640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c14bd00 con 0x7f0a0c14b8a0 2024-01-22T10:13:53.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a0bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a0c06c410 0x7f0a0c146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a0bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a0c06c410 0x7f0a0c146eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45476/0 (socket says 172.21.15.88:45476) 2024-01-22T10:13:53.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a0bfff640 1 -- 172.21.15.88:0/3210157799 learned_addr learned my addr 172.21.15.88:0/3210157799 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:53.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a0b7fe640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a0c14f7c0 0x7f0a0c146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a10ea2640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a0c14b8a0 0x7f0a0c0b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a0bfff640 1 -- 172.21.15.88:0/3210157799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a0c14b8a0 msgr2=0x7f0a0c0b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a0bfff640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a0c14b8a0 0x7f0a0c0b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a0bfff640 1 -- 172.21.15.88:0/3210157799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a0c14f7c0 msgr2=0x7f0a0c146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a0bfff640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a0c14f7c0 0x7f0a0c146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a0bfff640 1 -- 172.21.15.88:0/3210157799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04009b30 con 0x7f0a0c06c410 2024-01-22T10:13:53.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a0b7fe640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a0c14f7c0 0x7f0a0c146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:53.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a0bfff640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a0c06c410 0x7f0a0c146eb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00c3c0 tx=0x7f09fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:53.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a08ff9640 1 -- 172.21.15.88:0/3210157799 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0052d0 con 0x7f0a0c06c410 2024-01-22T10:13:53.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a08ff9640 1 -- 172.21.15.88:0/3210157799 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc005450 con 0x7f0a0c06c410 2024-01-22T10:13:53.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a12905640 1 -- 172.21.15.88:0/3210157799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c145f60 con 0x7f0a0c06c410 2024-01-22T10:13:53.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a08ff9640 1 -- 172.21.15.88:0/3210157799 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc007260 con 0x7f0a0c06c410 2024-01-22T10:13:53.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.604+0000 7f0a12905640 1 -- 172.21.15.88:0/3210157799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c0bdc60 con 0x7f0a0c06c410 2024-01-22T10:13:53.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.605+0000 7f0a12905640 1 -- 172.21.15.88:0/3210157799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c148f30 con 0x7f0a0c06c410 2024-01-22T10:13:53.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.606+0000 7f0a08ff9640 1 -- 172.21.15.88:0/3210157799 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f09fc0073c0 con 0x7f0a0c06c410 2024-01-22T10:13:53.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.606+0000 7f0a08ff9640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f09f806b330 0x7f09f806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.606+0000 7f0a08ff9640 1 -- 172.21.15.88:0/3210157799 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09fc088ef0 con 0x7f0a0c06c410 2024-01-22T10:13:53.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.606+0000 7f0a0b7fe640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f09f806b330 0x7f09f806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.607+0000 7f0a0b7fe640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f09f806b330 0x7f09f806d7f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c14c2b0 tx=0x7f0a00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:53.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.611+0000 7f0a08ff9640 1 -- 172.21.15.88:0/3210157799 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0a0c148f30 con 0x7f0a0c06c410 2024-01-22T10:13:53.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.779+0000 7f0a12905640 1 -- 172.21.15.88:0/3210157799 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a0c148f30 con 0x7f0a0c06c410 2024-01-22T10:13:53.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.780+0000 7f0a08ff9640 1 -- 172.21.15.88:0/3210157799 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a0c148f30 con 0x7f0a0c06c410 2024-01-22T10:13:53.763 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-01-22T10:13:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.782+0000 7f0a12905640 1 -- 172.21.15.88:0/3210157799 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f09f806b330 msgr2=0x7f09f806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.782+0000 7f0a12905640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f09f806b330 0x7f09f806d7f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c14c2b0 tx=0x7f0a00008040 comp rx=0 tx=0).stop 2024-01-22T10:13:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.782+0000 7f0a12905640 1 -- 172.21.15.88:0/3210157799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a0c06c410 msgr2=0x7f0a0c146eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.782+0000 7f0a12905640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a0c06c410 0x7f0a0c146eb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00c3c0 tx=0x7f09fc00c880 comp rx=0 tx=0).stop 2024-01-22T10:13:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.782+0000 7f0a12905640 1 -- 172.21.15.88:0/3210157799 shutdown_connections 2024-01-22T10:13:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.782+0000 7f0a12905640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f09f806b330 0x7f09f806d7f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.782+0000 7f0a12905640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a0c14b8a0 0x7f0a0c0b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.782+0000 7f0a12905640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a0c14f7c0 0x7f0a0c146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.782+0000 7f0a12905640 1 --2- 172.21.15.88:0/3210157799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a0c06c410 0x7f0a0c146eb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.782+0000 7f0a12905640 1 -- 172.21.15.88:0/3210157799 >> 172.21.15.88:0/3210157799 conn(0x7f0a0c0bec60 msgr2=0x7f0a0c0ba370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.782+0000 7f0a12905640 1 -- 172.21.15.88:0/3210157799 shutdown_connections 2024-01-22T10:13:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.782+0000 7f0a12905640 1 -- 172.21.15.88:0/3210157799 wait complete. 2024-01-22T10:13:53.775 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-22T10:13:53.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.894+0000 7f632196e640 1 Processor -- start 2024-01-22T10:13:53.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.895+0000 7f632196e640 1 -- start start 2024-01-22T10:13:53.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.895+0000 7f632196e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0b45a0 0x7f631c14b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.895+0000 7f632196e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f631c0bdde0 0x7f631c156010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.895+0000 7f632196e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631c0bd1c0 con 0x7f631c0bbb00 2024-01-22T10:13:53.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.895+0000 7f632196e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c0bc560 con 0x7f631c0bdde0 2024-01-22T10:13:53.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.895+0000 7f632196e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0c0820 con 0x7f631c0b45a0 2024-01-22T10:13:53.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.895+0000 7f631b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f631c0bdde0 0x7f631c156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.895+0000 7f631a7fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0b45a0 0x7f631c14b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.895+0000 7f631affd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f631c0bbb00 0x7f631c14ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.88:47622/0 (socket says 172.21.15.88:47622) 2024-01-22T10:13:53.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.895+0000 7f631affd640 1 -- 172.21.15.88:0/2899338798 learned_addr learned my addr 172.21.15.88:0/2899338798 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:53.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.896+0000 7f6319ffb640 1 -- 172.21.15.88:0/2899338798 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570719376 0 0) 0x7f631c0bd1c0 con 0x7f631c0bbb00 2024-01-22T10:13:53.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.896+0000 7f6319ffb640 1 -- 172.21.15.88:0/2899338798 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6304003520 con 0x7f631c0bbb00 2024-01-22T10:13:53.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.896+0000 7f631a7fc640 1 -- 172.21.15.88:0/2899338798 >> v2:172.21.15.119:3300/0 conn(0x7f631c0bdde0 msgr2=0x7f631c156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:53.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.896+0000 7f631a7fc640 1 --2- 172.21.15.88:0/2899338798 >> v2:172.21.15.119:3300/0 conn(0x7f631c0bdde0 0x7f631c156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.896+0000 7f631a7fc640 1 -- 172.21.15.88:0/2899338798 >> v1:172.21.15.119:6789/0 conn(0x7f631c0bbb00 legacy=0x7f631c14ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.896+0000 7f631a7fc640 1 -- 172.21.15.88:0/2899338798 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c0c0b00 con 0x7f631c0b45a0 2024-01-22T10:13:53.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.896+0000 7f631b7fe640 1 --2- 172.21.15.88:0/2899338798 >> v2:172.21.15.119:3300/0 conn(0x7f631c0bdde0 0x7f631c156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:13:53.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.897+0000 7f631a7fc640 1 --2- 172.21.15.88:0/2899338798 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0b45a0 0x7f631c14b580 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f63100097a0 tx=0x7f631002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6efc655bbcd4d909 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:53.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.897+0000 7f6319ffb640 1 -- 172.21.15.88:0/2899338798 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310031830 con 0x7f631c0b45a0 2024-01-22T10:13:53.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.897+0000 7f6319ffb640 1 -- 172.21.15.88:0/2899338798 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310031990 con 0x7f631c0b45a0 2024-01-22T10:13:53.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.897+0000 7f6319ffb640 1 -- 172.21.15.88:0/2899338798 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310031d00 con 0x7f631c0b45a0 2024-01-22T10:13:53.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.897+0000 7f632196e640 1 -- 172.21.15.88:0/2899338798 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0b45a0 msgr2=0x7f631c14b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.897+0000 7f632196e640 1 --2- 172.21.15.88:0/2899338798 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0b45a0 0x7f631c14b580 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f63100097a0 tx=0x7f631002b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.897+0000 7f632196e640 1 -- 172.21.15.88:0/2899338798 shutdown_connections 2024-01-22T10:13:53.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.897+0000 7f632196e640 1 --2- 172.21.15.88:0/2899338798 >> v2:172.21.15.119:3300/0 conn(0x7f631c0bdde0 0x7f631c156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.897+0000 7f632196e640 1 --2- 172.21.15.88:0/2899338798 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0b45a0 0x7f631c14b580 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.897+0000 7f632196e640 1 -- 172.21.15.88:0/2899338798 >> 172.21.15.88:0/2899338798 conn(0x7f631c0a2c20 msgr2=0x7f631c0a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:53.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.897+0000 7f632196e640 1 -- 172.21.15.88:0/2899338798 shutdown_connections 2024-01-22T10:13:53.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.897+0000 7f632196e640 1 -- 172.21.15.88:0/2899338798 wait complete. 2024-01-22T10:13:53.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.898+0000 7f632196e640 1 Processor -- start 2024-01-22T10:13:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.899+0000 7f632196e640 1 -- start start 2024-01-22T10:13:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.899+0000 7f632196e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631c0b45a0 0x7f631c0b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.899+0000 7f632196e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c0bbb00 0x7f631c1e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.899+0000 7f632196e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0bdde0 0x7f631c1e4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.899+0000 7f632196e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0baae0 con 0x7f631c0b45a0 2024-01-22T10:13:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.899+0000 7f632196e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c1e4c40 con 0x7f631c0bbb00 2024-01-22T10:13:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.899+0000 7f632196e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0b76a0 con 0x7f631c0bdde0 2024-01-22T10:13:53.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.899+0000 7f631affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631c0b45a0 0x7f631c0b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.899+0000 7f631affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631c0b45a0 0x7f631c0b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45486/0 (socket says 172.21.15.88:45486) 2024-01-22T10:13:53.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.899+0000 7f631affd640 1 -- 172.21.15.88:0/604023864 learned_addr learned my addr 172.21.15.88:0/604023864 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:53.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.899+0000 7f631b7fe640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0bdde0 0x7f631c1e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.899+0000 7f631a7fc640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c0bbb00 0x7f631c1e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.900+0000 7f631affd640 1 -- 172.21.15.88:0/604023864 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0bdde0 msgr2=0x7f631c1e4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.900+0000 7f631affd640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0bdde0 0x7f631c1e4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.900+0000 7f631affd640 1 -- 172.21.15.88:0/604023864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c0bbb00 msgr2=0x7f631c1e4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.900+0000 7f631affd640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c0bbb00 0x7f631c1e4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.900+0000 7f631affd640 1 -- 172.21.15.88:0/604023864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6314009400 con 0x7f631c0b45a0 2024-01-22T10:13:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.900+0000 7f631affd640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631c0b45a0 0x7f631c0b50a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f630c00cb70 tx=0x7f630c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.900+0000 7f6303fff640 1 -- 172.21.15.88:0/604023864 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c00ad40 con 0x7f631c0b45a0 2024-01-22T10:13:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.900+0000 7f6303fff640 1 -- 172.21.15.88:0/604023864 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c012400 con 0x7f631c0b45a0 2024-01-22T10:13:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.900+0000 7f632196e640 1 -- 172.21.15.88:0/604023864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6310009400 con 0x7f631c0b45a0 2024-01-22T10:13:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.900+0000 7f6303fff640 1 -- 172.21.15.88:0/604023864 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c00aea0 con 0x7f631c0b45a0 2024-01-22T10:13:53.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.900+0000 7f632196e640 1 -- 172.21.15.88:0/604023864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c0b4c50 con 0x7f631c0b45a0 2024-01-22T10:13:53.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.901+0000 7f632196e640 1 -- 172.21.15.88:0/604023864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c0ba8b0 con 0x7f631c0b45a0 2024-01-22T10:13:53.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.901+0000 7f6303fff640 1 -- 172.21.15.88:0/604023864 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f630c007070 con 0x7f631c0b45a0 2024-01-22T10:13:53.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.902+0000 7f6303fff640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f630806b360 0x7f630806d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:53.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.902+0000 7f631a7fc640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f630806b360 0x7f630806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:53.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.902+0000 7f6303fff640 1 -- 172.21.15.88:0/604023864 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f630c089c20 con 0x7f631c0b45a0 2024-01-22T10:13:53.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.902+0000 7f631a7fc640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f630806b360 0x7f630806d820 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6310036000 tx=0x7f6310008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:53.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:53.906+0000 7f6303fff640 1 -- 172.21.15.88:0/604023864 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f631c0ba8b0 con 0x7f631c0b45a0 2024-01-22T10:13:54.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.071+0000 7f632196e640 1 -- 172.21.15.88:0/604023864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f631c0ba8b0 con 0x7f631c0b45a0 2024-01-22T10:13:54.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.072+0000 7f6303fff640 1 -- 172.21.15.88:0/604023864 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f631c0ba8b0 con 0x7f631c0b45a0 2024-01-22T10:13:54.055 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-01-22T10:13:54.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.074+0000 7f632196e640 1 -- 172.21.15.88:0/604023864 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f630806b360 msgr2=0x7f630806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.074+0000 7f632196e640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f630806b360 0x7f630806d820 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6310036000 tx=0x7f6310008030 comp rx=0 tx=0).stop 2024-01-22T10:13:54.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.074+0000 7f632196e640 1 -- 172.21.15.88:0/604023864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631c0b45a0 msgr2=0x7f631c0b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.074+0000 7f632196e640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631c0b45a0 0x7f631c0b50a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f630c00cb70 tx=0x7f630c00a430 comp rx=0 tx=0).stop 2024-01-22T10:13:54.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.074+0000 7f632196e640 1 -- 172.21.15.88:0/604023864 shutdown_connections 2024-01-22T10:13:54.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.074+0000 7f632196e640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f630806b360 0x7f630806d820 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.074+0000 7f632196e640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0bdde0 0x7f631c1e4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.074+0000 7f632196e640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c0bbb00 0x7f631c1e4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.074+0000 7f632196e640 1 --2- 172.21.15.88:0/604023864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f631c0b45a0 0x7f631c0b50a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.074+0000 7f632196e640 1 -- 172.21.15.88:0/604023864 >> 172.21.15.88:0/604023864 conn(0x7f631c0a2c20 msgr2=0x7f631c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:54.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.074+0000 7f632196e640 1 -- 172.21.15.88:0/604023864 shutdown_connections 2024-01-22T10:13:54.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.074+0000 7f632196e640 1 -- 172.21.15.88:0/604023864 wait complete. 2024-01-22T10:13:54.067 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-22T10:13:54.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.187+0000 7f81ad456640 1 Processor -- start 2024-01-22T10:13:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.187+0000 7f81ad456640 1 -- start start 2024-01-22T10:13:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f81ad456640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f81a80b45a0 0x7f81a814b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f81ad456640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81a80bdde0 0x7f81a8156010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f81ad456640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a80bd1c0 con 0x7f81a80bbb00 2024-01-22T10:13:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f81ad456640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80bc560 con 0x7f81a80bdde0 2024-01-22T10:13:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f81ad456640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80c0820 con 0x7f81a80b45a0 2024-01-22T10:13:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f81a77fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81a80bdde0 0x7f81a8156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f81a77fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81a80bdde0 0x7f81a8156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45498/0 (socket says 172.21.15.88:45498) 2024-01-22T10:13:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f81a77fe640 1 -- 172.21.15.88:0/2215891841 learned_addr learned my addr 172.21.15.88:0/2215891841 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f819ffff640 1 --2- 172.21.15.88:0/2215891841 >> v2:172.21.15.119:3300/0 conn(0x7f81a80b45a0 0x7f81a814b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f81a77fe640 1 -- 172.21.15.88:0/2215891841 >> v2:172.21.15.119:3300/0 conn(0x7f81a80b45a0 msgr2=0x7f81a814b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f81a77fe640 1 --2- 172.21.15.88:0/2215891841 >> v2:172.21.15.119:3300/0 conn(0x7f81a80b45a0 0x7f81a814b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f81a77fe640 1 -- 172.21.15.88:0/2215891841 >> v1:172.21.15.119:6789/0 conn(0x7f81a80bbb00 legacy=0x7f81a814ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f81a77fe640 1 -- 172.21.15.88:0/2215891841 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80c0b00 con 0x7f81a80bdde0 2024-01-22T10:13:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.188+0000 7f819ffff640 1 --2- 172.21.15.88:0/2215891841 >> v2:172.21.15.119:3300/0 conn(0x7f81a80b45a0 0x7f81a814b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.189+0000 7f81a77fe640 1 --2- 172.21.15.88:0/2215891841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80bdde0 0x7f81a8156010 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f81a80bf610 tx=0x7f81a002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf17a8def847663 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.189+0000 7f81a67fc640 1 -- 172.21.15.88:0/2215891841 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a002cb20 con 0x7f81a80bdde0 2024-01-22T10:13:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.189+0000 7f81a67fc640 1 -- 172.21.15.88:0/2215891841 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a002cc80 con 0x7f81a80bdde0 2024-01-22T10:13:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.189+0000 7f81a67fc640 1 -- 172.21.15.88:0/2215891841 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a00343f0 con 0x7f81a80bdde0 2024-01-22T10:13:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.189+0000 7f81ad456640 1 -- 172.21.15.88:0/2215891841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80bdde0 msgr2=0x7f81a8156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.189+0000 7f81ad456640 1 --2- 172.21.15.88:0/2215891841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80bdde0 0x7f81a8156010 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f81a80bf610 tx=0x7f81a002bf80 comp rx=0 tx=0).stop 2024-01-22T10:13:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.189+0000 7f81ad456640 1 -- 172.21.15.88:0/2215891841 shutdown_connections 2024-01-22T10:13:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.189+0000 7f81ad456640 1 --2- 172.21.15.88:0/2215891841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80bdde0 0x7f81a8156010 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.189+0000 7f81ad456640 1 --2- 172.21.15.88:0/2215891841 >> v2:172.21.15.119:3300/0 conn(0x7f81a80b45a0 0x7f81a814b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.189+0000 7f81ad456640 1 -- 172.21.15.88:0/2215891841 >> 172.21.15.88:0/2215891841 conn(0x7f81a80a2c20 msgr2=0x7f81a80a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.189+0000 7f81ad456640 1 -- 172.21.15.88:0/2215891841 shutdown_connections 2024-01-22T10:13:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.189+0000 7f81ad456640 1 -- 172.21.15.88:0/2215891841 wait complete. 2024-01-22T10:13:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.190+0000 7f81ad456640 1 Processor -- start 2024-01-22T10:13:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.190+0000 7f81ad456640 1 -- start start 2024-01-22T10:13:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81ad456640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b45a0 0x7f81a80b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81ad456640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a80bbb00 0x7f81a81e4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81ad456640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a80bdde0 0x7f81a80b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:54.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81ad456640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a81e4460 con 0x7f81a80b45a0 2024-01-22T10:13:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81ad456640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80baf30 con 0x7f81a80bbb00 2024-01-22T10:13:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81ad456640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80bb210 con 0x7f81a80bdde0 2024-01-22T10:13:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81a6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b45a0 0x7f81a80b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81a6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b45a0 0x7f81a80b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45514/0 (socket says 172.21.15.88:45514) 2024-01-22T10:13:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81a6ffd640 1 -- 172.21.15.88:0/4058047946 learned_addr learned my addr 172.21.15.88:0/4058047946 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f819ffff640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a80bbb00 0x7f81a81e4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:54.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81a77fe640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a80bdde0 0x7f81a80b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:54.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81a6ffd640 1 -- 172.21.15.88:0/4058047946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a80bdde0 msgr2=0x7f81a80b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81a6ffd640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a80bdde0 0x7f81a80b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81a6ffd640 1 -- 172.21.15.88:0/4058047946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a80bbb00 msgr2=0x7f81a81e4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81a6ffd640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a80bbb00 0x7f81a81e4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.191+0000 7f81a6ffd640 1 -- 172.21.15.88:0/4058047946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a0009b30 con 0x7f81a80b45a0 2024-01-22T10:13:54.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.192+0000 7f81a6ffd640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b45a0 0x7f81a80b6fc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f819800c430 tx=0x7f819800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:54.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.192+0000 7f819f7fe640 1 -- 172.21.15.88:0/4058047946 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980052d0 con 0x7f81a80b45a0 2024-01-22T10:13:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.192+0000 7f819f7fe640 1 -- 172.21.15.88:0/4058047946 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198005430 con 0x7f81a80b45a0 2024-01-22T10:13:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.192+0000 7f81ad456640 1 -- 172.21.15.88:0/4058047946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a81e5130 con 0x7f81a80b45a0 2024-01-22T10:13:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.192+0000 7f819f7fe640 1 -- 172.21.15.88:0/4058047946 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198003850 con 0x7f81a80b45a0 2024-01-22T10:13:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.192+0000 7f81ad456640 1 -- 172.21.15.88:0/4058047946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a81e0e90 con 0x7f81a80b45a0 2024-01-22T10:13:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.193+0000 7f81ad456640 1 -- 172.21.15.88:0/4058047946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a81e4820 con 0x7f81a80b45a0 2024-01-22T10:13:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.193+0000 7f819f7fe640 1 -- 172.21.15.88:0/4058047946 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f81980039b0 con 0x7f81a80b45a0 2024-01-22T10:13:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.193+0000 7f819f7fe640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f818806b330 0x7f818806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:54.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.194+0000 7f819f7fe640 1 -- 172.21.15.88:0/4058047946 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8198089110 con 0x7f81a80b45a0 2024-01-22T10:13:54.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.194+0000 7f819ffff640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f818806b330 0x7f818806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:54.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.194+0000 7f819ffff640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f818806b330 0x7f818806d7f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f81a814cab0 tx=0x7f8190008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:54.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.198+0000 7f819f7fe640 1 -- 172.21.15.88:0/4058047946 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8198053e30 con 0x7f81a80b45a0 2024-01-22T10:13:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.367+0000 7f81ad456640 1 -- 172.21.15.88:0/4058047946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81a804ea30 con 0x7f81a80b45a0 2024-01-22T10:13:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.367+0000 7f819f7fe640 1 -- 172.21.15.88:0/4058047946 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8198001120 con 0x7f81a80b45a0 2024-01-22T10:13:54.350 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-01-22T10:13:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.369+0000 7f81ad456640 1 -- 172.21.15.88:0/4058047946 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f818806b330 msgr2=0x7f818806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.369+0000 7f81ad456640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f818806b330 0x7f818806d7f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f81a814cab0 tx=0x7f8190008040 comp rx=0 tx=0).stop 2024-01-22T10:13:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.369+0000 7f81ad456640 1 -- 172.21.15.88:0/4058047946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b45a0 msgr2=0x7f81a80b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.369+0000 7f81ad456640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b45a0 0x7f81a80b6fc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f819800c430 tx=0x7f819800c8f0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.369+0000 7f81ad456640 1 -- 172.21.15.88:0/4058047946 shutdown_connections 2024-01-22T10:13:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.369+0000 7f81ad456640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f818806b330 0x7f818806d7f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.369+0000 7f81ad456640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a80bdde0 0x7f81a80b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.369+0000 7f81ad456640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a80bbb00 0x7f81a81e4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.369+0000 7f81ad456640 1 --2- 172.21.15.88:0/4058047946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b45a0 0x7f81a80b6fc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.369+0000 7f81ad456640 1 -- 172.21.15.88:0/4058047946 >> 172.21.15.88:0/4058047946 conn(0x7f81a80a2c20 msgr2=0x7f81a81493e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.369+0000 7f81ad456640 1 -- 172.21.15.88:0/4058047946 shutdown_connections 2024-01-22T10:13:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.369+0000 7f81ad456640 1 -- 172.21.15.88:0/4058047946 wait complete. 2024-01-22T10:13:54.363 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-22T10:13:54.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.481+0000 7f130b01e640 1 Processor -- start 2024-01-22T10:13:54.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.481+0000 7f130b01e640 1 -- start start 2024-01-22T10:13:54.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.481+0000 7f130b01e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f13040b6c70 0x7f13041493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:54.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.481+0000 7f130b01e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13040b8eb0 0x7f1304149900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:54.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.481+0000 7f130b01e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13040b2960 con 0x7f13040bd490 2024-01-22T10:13:54.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.481+0000 7f130b01e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13040b3160 con 0x7f13040b8eb0 2024-01-22T10:13:54.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.481+0000 7f130b01e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13040b2df0 con 0x7f13040b6c70 2024-01-22T10:13:54.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.482+0000 7f13095bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13040b8eb0 0x7f1304149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.482+0000 7f13095bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13040b8eb0 0x7f1304149900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45524/0 (socket says 172.21.15.88:45524) 2024-01-22T10:13:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.482+0000 7f13095bb640 1 -- 172.21.15.88:0/1851892240 learned_addr learned my addr 172.21.15.88:0/1851892240 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.482+0000 7f1303fff640 1 --2- 172.21.15.88:0/1851892240 >> v2:172.21.15.119:3300/0 conn(0x7f13040b6c70 0x7f13041493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.482+0000 7f13095bb640 1 -- 172.21.15.88:0/1851892240 >> v2:172.21.15.119:3300/0 conn(0x7f13040b6c70 msgr2=0x7f13041493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.482+0000 7f13095bb640 1 --2- 172.21.15.88:0/1851892240 >> v2:172.21.15.119:3300/0 conn(0x7f13040b6c70 0x7f13041493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.482+0000 7f13095bb640 1 -- 172.21.15.88:0/1851892240 >> v1:172.21.15.119:6789/0 conn(0x7f13040bd490 legacy=0x7f13041433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.482+0000 7f13095bb640 1 -- 172.21.15.88:0/1851892240 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13040b2090 con 0x7f13040b8eb0 2024-01-22T10:13:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.483+0000 7f13095bb640 1 --2- 172.21.15.88:0/1851892240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13040b8eb0 0x7f1304149900 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f130406ba40 tx=0x7f12fc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa256ef776a744d server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.483+0000 7f13037fe640 1 -- 172.21.15.88:0/1851892240 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc02ca80 con 0x7f13040b8eb0 2024-01-22T10:13:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.483+0000 7f13037fe640 1 -- 172.21.15.88:0/1851892240 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc02cbe0 con 0x7f13040b8eb0 2024-01-22T10:13:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.483+0000 7f13037fe640 1 -- 172.21.15.88:0/1851892240 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0343f0 con 0x7f13040b8eb0 2024-01-22T10:13:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.483+0000 7f130b01e640 1 -- 172.21.15.88:0/1851892240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13040b8eb0 msgr2=0x7f1304149900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.483+0000 7f130b01e640 1 --2- 172.21.15.88:0/1851892240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13040b8eb0 0x7f1304149900 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f130406ba40 tx=0x7f12fc02bee0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.483+0000 7f130b01e640 1 -- 172.21.15.88:0/1851892240 shutdown_connections 2024-01-22T10:13:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.483+0000 7f130b01e640 1 --2- 172.21.15.88:0/1851892240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13040b8eb0 0x7f1304149900 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.483+0000 7f130b01e640 1 --2- 172.21.15.88:0/1851892240 >> v2:172.21.15.119:3300/0 conn(0x7f13040b6c70 0x7f13041493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.483+0000 7f130b01e640 1 -- 172.21.15.88:0/1851892240 >> 172.21.15.88:0/1851892240 conn(0x7f130406acf0 msgr2=0x7f13040bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.483+0000 7f130b01e640 1 -- 172.21.15.88:0/1851892240 shutdown_connections 2024-01-22T10:13:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.483+0000 7f130b01e640 1 -- 172.21.15.88:0/1851892240 wait complete. 2024-01-22T10:13:54.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.484+0000 7f130b01e640 1 Processor -- start 2024-01-22T10:13:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.484+0000 7f130b01e640 1 -- start start 2024-01-22T10:13:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f130b01e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13040b6c70 0x7f130414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f130b01e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13040b8eb0 0x7f13040712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f130b01e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13040bd490 0x7f1304070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f130b01e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130414d110 con 0x7f13040bd490 2024-01-22T10:13:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f130b01e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1304072640 con 0x7f13040b8eb0 2024-01-22T10:13:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f130b01e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1304071b90 con 0x7f13040b6c70 2024-01-22T10:13:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f13095bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13040bd490 0x7f1304070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f13095bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13040bd490 0x7f1304070020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45540/0 (socket says 172.21.15.88:45540) 2024-01-22T10:13:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f13095bb640 1 -- 172.21.15.88:0/1499642169 learned_addr learned my addr 172.21.15.88:0/1499642169 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f1308dba640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13040b6c70 0x7f130414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f1303fff640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13040b8eb0 0x7f13040712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f13095bb640 1 -- 172.21.15.88:0/1499642169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13040b6c70 msgr2=0x7f130414d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f13095bb640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13040b6c70 0x7f130414d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f13095bb640 1 -- 172.21.15.88:0/1499642169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13040b8eb0 msgr2=0x7f13040712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f13095bb640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13040b8eb0 0x7f13040712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f13095bb640 1 -- 172.21.15.88:0/1499642169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc009b30 con 0x7f13040bd490 2024-01-22T10:13:54.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.485+0000 7f1303fff640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13040b8eb0 0x7f13040712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:54.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.486+0000 7f13095bb640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13040bd490 0x7f1304070020 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f12fc036040 tx=0x7f12fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:54.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.486+0000 7f13017fa640 1 -- 172.21.15.88:0/1499642169 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc009510 con 0x7f13040bd490 2024-01-22T10:13:54.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.486+0000 7f13017fa640 1 -- 172.21.15.88:0/1499642169 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc03e450 con 0x7f13040bd490 2024-01-22T10:13:54.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.486+0000 7f130b01e640 1 -- 172.21.15.88:0/1499642169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13040b5f40 con 0x7f13040bd490 2024-01-22T10:13:54.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.486+0000 7f13017fa640 1 -- 172.21.15.88:0/1499642169 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc03e7e0 con 0x7f13040bd490 2024-01-22T10:13:54.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.486+0000 7f130b01e640 1 -- 172.21.15.88:0/1499642169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130414ce30 con 0x7f13040bd490 2024-01-22T10:13:54.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.487+0000 7f130b01e640 1 -- 172.21.15.88:0/1499642169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130414b8f0 con 0x7f13040bd490 2024-01-22T10:13:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.487+0000 7f13017fa640 1 -- 172.21.15.88:0/1499642169 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f12fc02cd50 con 0x7f13040bd490 2024-01-22T10:13:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.488+0000 7f13017fa640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f12e806b330 0x7f12e806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.488+0000 7f1308dba640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f12e806b330 0x7f12e806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.488+0000 7f13017fa640 1 -- 172.21.15.88:0/1499642169 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12fc0ac8a0 con 0x7f13040bd490 2024-01-22T10:13:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.488+0000 7f1308dba640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f12e806b330 0x7f12e806d7f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f12f8006fd0 tx=0x7f12f8009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:54.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.492+0000 7f13017fa640 1 -- 172.21.15.88:0/1499642169 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f130414b8f0 con 0x7f13040bd490 2024-01-22T10:13:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.672+0000 7f130b01e640 1 -- 172.21.15.88:0/1499642169 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f130414b8f0 con 0x7f13040bd490 2024-01-22T10:13:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.672+0000 7f13017fa640 1 -- 172.21.15.88:0/1499642169 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f130414b8f0 con 0x7f13040bd490 2024-01-22T10:13:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2024-01-22T10:13:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.674+0000 7f130b01e640 1 -- 172.21.15.88:0/1499642169 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f12e806b330 msgr2=0x7f12e806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.674+0000 7f130b01e640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f12e806b330 0x7f12e806d7f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f12f8006fd0 tx=0x7f12f8009060 comp rx=0 tx=0).stop 2024-01-22T10:13:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.674+0000 7f130b01e640 1 -- 172.21.15.88:0/1499642169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13040bd490 msgr2=0x7f1304070020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.674+0000 7f130b01e640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13040bd490 0x7f1304070020 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f12fc036040 tx=0x7f12fc004a40 comp rx=0 tx=0).stop 2024-01-22T10:13:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.674+0000 7f130b01e640 1 -- 172.21.15.88:0/1499642169 shutdown_connections 2024-01-22T10:13:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.674+0000 7f130b01e640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f12e806b330 0x7f12e806d7f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.674+0000 7f130b01e640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13040bd490 0x7f1304070020 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.674+0000 7f130b01e640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13040b8eb0 0x7f13040712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.674+0000 7f130b01e640 1 --2- 172.21.15.88:0/1499642169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13040b6c70 0x7f130414d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.674+0000 7f130b01e640 1 -- 172.21.15.88:0/1499642169 >> 172.21.15.88:0/1499642169 conn(0x7f130406acf0 msgr2=0x7f13040bc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.674+0000 7f130b01e640 1 -- 172.21.15.88:0/1499642169 shutdown_connections 2024-01-22T10:13:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:54.674+0000 7f130b01e640 1 -- 172.21.15.88:0/1499642169 wait complete. 2024-01-22T10:13:54.667 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-22T10:13:54.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:54.667 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-22T10:13:54.777 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2024-01-22T10:13:54.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:54.778 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-22T10:13:54.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:54.826 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-01-22T10:13:54.870 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-22T10:13:54.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:54.871 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-22T10:13:55.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-22T10:13:55.007 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-01-22T10:13:55.136 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-22T10:13:55.145 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-22T10:13:55.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T10:13:55.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.263+0000 7f61b6a9b640 1 Processor -- start 2024-01-22T10:13:55.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.263+0000 7f61b6a9b640 1 -- start start 2024-01-22T10:13:55.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61b6a9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61b014c9b0 0x7f61b00b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61b6a9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61b00b9ba0 0x7f61b0153d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61b6a9b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b00ba940 con 0x7f61b014d640 2024-01-22T10:13:55.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61b6a9b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b00b4e10 con 0x7f61b014c9b0 2024-01-22T10:13:55.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61b6a9b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00b44e0 con 0x7f61b00b9ba0 2024-01-22T10:13:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61a7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61b014c9b0 0x7f61b00b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61b4837640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f61b014d640 0x7f61b00bb0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46612/0 (socket says 172.21.15.88:46612) 2024-01-22T10:13:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61b4837640 1 -- 172.21.15.88:0/2900748303 learned_addr learned my addr 172.21.15.88:0/2900748303 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61b5038640 1 --2- 172.21.15.88:0/2900748303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61b00b9ba0 0x7f61b0153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61a7fff640 1 -- 172.21.15.88:0/2900748303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61b00b9ba0 msgr2=0x7f61b0153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61a7fff640 1 --2- 172.21.15.88:0/2900748303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61b00b9ba0 0x7f61b0153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61a7fff640 1 -- 172.21.15.88:0/2900748303 >> v1:172.21.15.88:6789/0 conn(0x7f61b014d640 legacy=0x7f61b00bb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61a7fff640 1 -- 172.21.15.88:0/2900748303 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b00b3e90 con 0x7f61b014c9b0 2024-01-22T10:13:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.264+0000 7f61a77fe640 1 -- 172.21.15.88:0/2900748303 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565985063 0 0) 0x7f61b00ba940 con 0x7f61b014d640 2024-01-22T10:13:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.265+0000 7f61a7fff640 1 --2- 172.21.15.88:0/2900748303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b014c9b0 0x7f61b00b8ca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f61a00097a0 tx=0x7f61a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e23d995ceb670fe server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.265+0000 7f61a77fe640 1 -- 172.21.15.88:0/2900748303 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0031830 con 0x7f61b014c9b0 2024-01-22T10:13:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.265+0000 7f61a77fe640 1 -- 172.21.15.88:0/2900748303 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a0031990 con 0x7f61b014c9b0 2024-01-22T10:13:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.265+0000 7f61a77fe640 1 -- 172.21.15.88:0/2900748303 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0031d20 con 0x7f61b014c9b0 2024-01-22T10:13:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.265+0000 7f61b6a9b640 1 -- 172.21.15.88:0/2900748303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b014c9b0 msgr2=0x7f61b00b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.265+0000 7f61b6a9b640 1 --2- 172.21.15.88:0/2900748303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b014c9b0 0x7f61b00b8ca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f61a00097a0 tx=0x7f61a002b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.265+0000 7f61b6a9b640 1 -- 172.21.15.88:0/2900748303 shutdown_connections 2024-01-22T10:13:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.265+0000 7f61b6a9b640 1 --2- 172.21.15.88:0/2900748303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61b00b9ba0 0x7f61b0153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.265+0000 7f61b6a9b640 1 --2- 172.21.15.88:0/2900748303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b014c9b0 0x7f61b00b8ca0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.265+0000 7f61b6a9b640 1 -- 172.21.15.88:0/2900748303 >> 172.21.15.88:0/2900748303 conn(0x7f61b00bb840 msgr2=0x7f61b00bbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:55.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.265+0000 7f61b6a9b640 1 -- 172.21.15.88:0/2900748303 shutdown_connections 2024-01-22T10:13:55.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.265+0000 7f61b6a9b640 1 -- 172.21.15.88:0/2900748303 wait complete. 2024-01-22T10:13:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.266+0000 7f61b6a9b640 1 Processor -- start 2024-01-22T10:13:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.266+0000 7f61b6a9b640 1 -- start start 2024-01-22T10:13:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.267+0000 7f61b6a9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b00b9ba0 0x7f61b01456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.267+0000 7f61b6a9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61b014c9b0 0x7f61b00b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.267+0000 7f61b6a9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b014d640 0x7f61b01e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.267+0000 7f61b6a9b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00b83f0 con 0x7f61b00b9ba0 2024-01-22T10:13:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.267+0000 7f61b6a9b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0146350 con 0x7f61b014d640 2024-01-22T10:13:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.267+0000 7f61b6a9b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b01e27e0 con 0x7f61b014c9b0 2024-01-22T10:13:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.267+0000 7f61b4837640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b00b9ba0 0x7f61b01456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.267+0000 7f61b4837640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b00b9ba0 0x7f61b01456b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45556/0 (socket says 172.21.15.88:45556) 2024-01-22T10:13:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.267+0000 7f61b4837640 1 -- 172.21.15.88:0/3480522428 learned_addr learned my addr 172.21.15.88:0/3480522428 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.267+0000 7f61b5038640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b014d640 0x7f61b01e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.267+0000 7f61a7fff640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61b014c9b0 0x7f61b00b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.268+0000 7f61b4837640 1 -- 172.21.15.88:0/3480522428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61b014c9b0 msgr2=0x7f61b00b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.268+0000 7f61b4837640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61b014c9b0 0x7f61b00b7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.268+0000 7f61b4837640 1 -- 172.21.15.88:0/3480522428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b014d640 msgr2=0x7f61b01e22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.268+0000 7f61b4837640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b014d640 0x7f61b01e22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.268+0000 7f61b4837640 1 -- 172.21.15.88:0/3480522428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a0009400 con 0x7f61b00b9ba0 2024-01-22T10:13:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.268+0000 7f61b5038640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b014d640 0x7f61b01e22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.268+0000 7f61b4837640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b00b9ba0 0x7f61b01456b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00c430 tx=0x7f61ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.268+0000 7f61a57fa640 1 -- 172.21.15.88:0/3480522428 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0074e0 con 0x7f61b00b9ba0 2024-01-22T10:13:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.268+0000 7f61a57fa640 1 -- 172.21.15.88:0/3480522428 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac007660 con 0x7f61b00b9ba0 2024-01-22T10:13:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.268+0000 7f61b6a9b640 1 -- 172.21.15.88:0/3480522428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b0144930 con 0x7f61b00b9ba0 2024-01-22T10:13:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.268+0000 7f61a57fa640 1 -- 172.21.15.88:0/3480522428 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac004a20 con 0x7f61b00b9ba0 2024-01-22T10:13:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.268+0000 7f61b6a9b640 1 -- 172.21.15.88:0/3480522428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b01483b0 con 0x7f61b00b9ba0 2024-01-22T10:13:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.269+0000 7f61b6a9b640 1 -- 172.21.15.88:0/3480522428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b01461b0 con 0x7f61b00b9ba0 2024-01-22T10:13:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.269+0000 7f61a57fa640 1 -- 172.21.15.88:0/3480522428 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f61ac004b80 con 0x7f61b00b9ba0 2024-01-22T10:13:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.270+0000 7f61a57fa640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f619c06b330 0x7f619c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.270+0000 7f61a57fa640 1 -- 172.21.15.88:0/3480522428 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61ac089a20 con 0x7f61b00b9ba0 2024-01-22T10:13:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.270+0000 7f61a7fff640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f619c06b330 0x7f619c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.270+0000 7f61a7fff640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f619c06b330 0x7f619c06d7f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f61a0036000 tx=0x7f61a0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:55.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.274+0000 7f61a57fa640 1 -- 172.21.15.88:0/3480522428 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f61b01461b0 con 0x7f61b00b9ba0 2024-01-22T10:13:55.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.437+0000 7f61b6a9b640 1 -- 172.21.15.88:0/3480522428 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61b00ba620 con 0x7f619c06b330 2024-01-22T10:13:55.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.444+0000 7f61a57fa640 1 -- 172.21.15.88:0/3480522428 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267791 (secure 0 0 0) 0x7f61a0031b00 con 0x7f619c06b330 2024-01-22T10:13:55.429 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:55.431 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-01-22T10:13:55.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.447+0000 7f61b6a9b640 1 -- 172.21.15.88:0/3480522428 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f619c06b330 msgr2=0x7f619c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.447+0000 7f61b6a9b640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f619c06b330 0x7f619c06d7f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f61a0036000 tx=0x7f61a0008030 comp rx=0 tx=0).stop 2024-01-22T10:13:55.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.447+0000 7f61b6a9b640 1 -- 172.21.15.88:0/3480522428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b00b9ba0 msgr2=0x7f61b01456b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.447+0000 7f61b6a9b640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b00b9ba0 0x7f61b01456b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00c430 tx=0x7f61ac00c8f0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.447+0000 7f61b6a9b640 1 -- 172.21.15.88:0/3480522428 shutdown_connections 2024-01-22T10:13:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.447+0000 7f61b6a9b640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f619c06b330 0x7f619c06d7f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.447+0000 7f61b6a9b640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61b014c9b0 0x7f61b00b7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.447+0000 7f61b6a9b640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61b014d640 0x7f61b01e22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.447+0000 7f61b6a9b640 1 --2- 172.21.15.88:0/3480522428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61b00b9ba0 0x7f61b01456b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.447+0000 7f61b6a9b640 1 -- 172.21.15.88:0/3480522428 >> 172.21.15.88:0/3480522428 conn(0x7f61b00bb840 msgr2=0x7f61b00bbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.447+0000 7f61b6a9b640 1 -- 172.21.15.88:0/3480522428 shutdown_connections 2024-01-22T10:13:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.447+0000 7f61b6a9b640 1 -- 172.21.15.88:0/3480522428 wait complete. 2024-01-22T10:13:55.440 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-01-22T10:13:54.715586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594019,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220048,"kb_used_data":3848,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754672,"statfs":{"total":773094113280,"available":772868784128,"internally_reserved":0,"allocated":3940352,"data_stored":2218424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3651,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.094255"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986737+0000","last_change":"2024-01-22T10:13:42.628705+0000","last_active":"2024-01-22T10:13:43.986737+0000","last_peered":"2024-01-22T10:13:43.986737+0000","last_clean":"2024-01-22T10:13:43.986737+0000","last_became_active":"2024-01-22T10:13:42.627514+0000","last_became_peered":"2024-01-22T10:13:42.627514+0000","last_unstale":"2024-01-22T10:13:43.986737+0000","last_undegraded":"2024-01-22T10:13:43.986737+0000","last_fullsized":"2024-01-22T10:13:43.986737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624367+0000","last_change":"2024-01-22T10:13:42.623390+0000","last_active":"2024-01-22T10:13:43.624367+0000","last_peered":"2024-01-22T10:13:43.624367+0000","last_clean":"2024-01-22T10:13:43.624367+0000","last_became_active":"2024-01-22T10:13:42.623152+0000","last_became_peered":"2024-01-22T10:13:42.623152+0000","last_unstale":"2024-01-22T10:13:43.624367+0000","last_undegraded":"2024-01-22T10:13:43.624367+0000","last_fullsized":"2024-01-22T10:13:43.624367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:45:45.479717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034543+0000","last_change":"2024-01-22T10:13:42.627502+0000","last_active":"2024-01-22T10:13:44.034543+0000","last_peered":"2024-01-22T10:13:44.034543+0000","last_clean":"2024-01-22T10:13:44.034543+0000","last_became_active":"2024-01-22T10:13:42.627157+0000","last_became_peered":"2024-01-22T10:13:42.627157+0000","last_unstale":"2024-01-22T10:13:44.034543+0000","last_undegraded":"2024-01-22T10:13:44.034543+0000","last_fullsized":"2024-01-22T10:13:44.034543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622679+0000","last_change":"2024-01-22T10:13:42.631690+0000","last_active":"2024-01-22T10:13:43.622679+0000","last_peered":"2024-01-22T10:13:43.622679+0000","last_clean":"2024-01-22T10:13:43.622679+0000","last_became_active":"2024-01-22T10:13:42.630134+0000","last_became_peered":"2024-01-22T10:13:42.630134+0000","last_unstale":"2024-01-22T10:13:43.622679+0000","last_undegraded":"2024-01-22T10:13:43.622679+0000","last_fullsized":"2024-01-22T10:13:43.622679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:00:21.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034028+0000","last_change":"2024-01-22T10:13:42.636628+0000","last_active":"2024-01-22T10:13:44.034028+0000","last_peered":"2024-01-22T10:13:44.034028+0000","last_clean":"2024-01-22T10:13:44.034028+0000","last_became_active":"2024-01-22T10:13:42.636239+0000","last_became_peered":"2024-01-22T10:13:42.636239+0000","last_unstale":"2024-01-22T10:13:44.034028+0000","last_undegraded":"2024-01-22T10:13:44.034028+0000","last_fullsized":"2024-01-22T10:13:44.034028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:44:19.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624118+0000","last_change":"2024-01-22T10:13:42.621975+0000","last_active":"2024-01-22T10:13:43.624118+0000","last_peered":"2024-01-22T10:13:43.624118+0000","last_clean":"2024-01-22T10:13:43.624118+0000","last_became_active":"2024-01-22T10:13:42.621590+0000","last_became_peered":"2024-01-22T10:13:42.621590+0000","last_unstale":"2024-01-22T10:13:43.624118+0000","last_undegraded":"2024-01-22T10:13:43.624118+0000","last_fullsized":"2024-01-22T10:13:43.624118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624659+0000","last_change":"2024-01-22T10:13:42.617901+0000","last_active":"2024-01-22T10:13:43.624659+0000","last_peered":"2024-01-22T10:13:43.624659+0000","last_clean":"2024-01-22T10:13:43.624659+0000","last_became_active":"2024-01-22T10:13:42.617384+0000","last_became_peered":"2024-01-22T10:13:42.617384+0000","last_unstale":"2024-01-22T10:13:43.624659+0000","last_undegraded":"2024-01-22T10:13:43.624659+0000","last_fullsized":"2024-01-22T10:13:43.624659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624647+0000","last_change":"2024-01-22T10:13:42.622490+0000","last_active":"2024-01-22T10:13:43.624647+0000","last_peered":"2024-01-22T10:13:43.624647+0000","last_clean":"2024-01-22T10:13:43.624647+0000","last_became_active":"2024-01-22T10:13:42.622220+0000","last_became_peered":"2024-01-22T10:13:42.622220+0000","last_unstale":"2024-01-22T10:13:43.624647+0000","last_undegraded":"2024-01-22T10:13:43.624647+0000","last_fullsized":"2024-01-22T10:13:43.624647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035496+0000","last_change":"2024-01-22T10:13:42.635502+0000","last_active":"2024-01-22T10:13:44.035496+0000","last_peered":"2024-01-22T10:13:44.035496+0000","last_clean":"2024-01-22T10:13:44.035496+0000","last_became_active":"2024-01-22T10:13:42.635312+0000","last_became_peered":"2024-01-22T10:13:42.635312+0000","last_unstale":"2024-01-22T10:13:44.035496+0000","last_undegraded":"2024-01-22T10:13:44.035496+0000","last_fullsized":"2024-01-22T10:13:44.035496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:19:17.630353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622947+0000","last_change":"2024-01-22T10:13:42.635158+0000","last_active":"2024-01-22T10:13:43.622947+0000","last_peered":"2024-01-22T10:13:43.622947+0000","last_clean":"2024-01-22T10:13:43.622947+0000","last_became_active":"2024-01-22T10:13:42.634191+0000","last_became_peered":"2024-01-22T10:13:42.634191+0000","last_unstale":"2024-01-22T10:13:43.622947+0000","last_undegraded":"2024-01-22T10:13:43.622947+0000","last_fullsized":"2024-01-22T10:13:43.622947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:17.709645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624931+0000","last_change":"2024-01-22T10:13:42.621049+0000","last_active":"2024-01-22T10:13:43.624931+0000","last_peered":"2024-01-22T10:13:43.624931+0000","last_clean":"2024-01-22T10:13:43.624931+0000","last_became_active":"2024-01-22T10:13:42.620763+0000","last_became_peered":"2024-01-22T10:13:42.620763+0000","last_unstale":"2024-01-22T10:13:43.624931+0000","last_undegraded":"2024-01-22T10:13:43.624931+0000","last_fullsized":"2024-01-22T10:13:43.624931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:45:45.479717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034352+0000","last_change":"2024-01-22T10:13:42.634597+0000","last_active":"2024-01-22T10:13:44.034352+0000","last_peered":"2024-01-22T10:13:44.034352+0000","last_clean":"2024-01-22T10:13:44.034352+0000","last_became_active":"2024-01-22T10:13:42.634366+0000","last_became_peered":"2024-01-22T10:13:42.634366+0000","last_unstale":"2024-01-22T10:13:44.034352+0000","last_undegraded":"2024-01-22T10:13:44.034352+0000","last_fullsized":"2024-01-22T10:13:44.034352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034137+0000","last_change":"2024-01-22T10:13:42.624821+0000","last_active":"2024-01-22T10:13:44.034137+0000","last_peered":"2024-01-22T10:13:44.034137+0000","last_clean":"2024-01-22T10:13:44.034137+0000","last_became_active":"2024-01-22T10:13:42.624548+0000","last_became_peered":"2024-01-22T10:13:42.624548+0000","last_unstale":"2024-01-22T10:13:44.034137+0000","last_undegraded":"2024-01-22T10:13:44.034137+0000","last_fullsized":"2024-01-22T10:13:44.034137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:26.195084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624093+0000","last_change":"2024-01-22T10:13:42.625911+0000","last_active":"2024-01-22T10:13:43.624093+0000","last_peered":"2024-01-22T10:13:43.624093+0000","last_clean":"2024-01-22T10:13:43.624093+0000","last_became_active":"2024-01-22T10:13:42.625647+0000","last_became_peered":"2024-01-22T10:13:42.625647+0000","last_unstale":"2024-01-22T10:13:43.624093+0000","last_undegraded":"2024-01-22T10:13:43.624093+0000","last_fullsized":"2024-01-22T10:13:43.624093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034305+0000","last_change":"2024-01-22T10:13:42.621130+0000","last_active":"2024-01-22T10:13:44.034305+0000","last_peered":"2024-01-22T10:13:44.034305+0000","last_clean":"2024-01-22T10:13:44.034305+0000","last_became_active":"2024-01-22T10:13:42.620805+0000","last_became_peered":"2024-01-22T10:13:42.620805+0000","last_unstale":"2024-01-22T10:13:44.034305+0000","last_undegraded":"2024-01-22T10:13:44.034305+0000","last_fullsized":"2024-01-22T10:13:44.034305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:20.447342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624819+0000","last_change":"2024-01-22T10:13:42.624267+0000","last_active":"2024-01-22T10:13:43.624819+0000","last_peered":"2024-01-22T10:13:43.624819+0000","last_clean":"2024-01-22T10:13:43.624819+0000","last_became_active":"2024-01-22T10:13:42.623306+0000","last_became_peered":"2024-01-22T10:13:42.623306+0000","last_unstale":"2024-01-22T10:13:43.624819+0000","last_undegraded":"2024-01-22T10:13:43.624819+0000","last_fullsized":"2024-01-22T10:13:43.624819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:55.572047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.625077+0000","last_change":"2024-01-22T10:13:42.617345+0000","last_active":"2024-01-22T10:13:43.625077+0000","last_peered":"2024-01-22T10:13:43.625077+0000","last_clean":"2024-01-22T10:13:43.625077+0000","last_became_active":"2024-01-22T10:13:42.617072+0000","last_became_peered":"2024-01-22T10:13:42.617072+0000","last_unstale":"2024-01-22T10:13:43.625077+0000","last_undegraded":"2024-01-22T10:13:43.625077+0000","last_fullsized":"2024-01-22T10:13:43.625077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:08:00.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624439+0000","last_change":"2024-01-22T10:13:42.625193+0000","last_active":"2024-01-22T10:13:43.624439+0000","last_peered":"2024-01-22T10:13:43.624439+0000","last_clean":"2024-01-22T10:13:43.624439+0000","last_became_active":"2024-01-22T10:13:42.624862+0000","last_became_peered":"2024-01-22T10:13:42.624862+0000","last_unstale":"2024-01-22T10:13:43.624439+0000","last_undegraded":"2024-01-22T10:13:43.624439+0000","last_fullsized":"2024-01-22T10:13:43.624439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:08:00.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624133+0000","last_change":"2024-01-22T10:13:42.626004+0000","last_active":"2024-01-22T10:13:43.624133+0000","last_peered":"2024-01-22T10:13:43.624133+0000","last_clean":"2024-01-22T10:13:43.624133+0000","last_became_active":"2024-01-22T10:13:42.625078+0000","last_became_peered":"2024-01-22T10:13:42.625078+0000","last_unstale":"2024-01-22T10:13:43.624133+0000","last_undegraded":"2024-01-22T10:13:43.624133+0000","last_fullsized":"2024-01-22T10:13:43.624133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034290+0000","last_change":"2024-01-22T10:13:42.626913+0000","last_active":"2024-01-22T10:13:44.034290+0000","last_peered":"2024-01-22T10:13:44.034290+0000","last_clean":"2024-01-22T10:13:44.034290+0000","last_became_active":"2024-01-22T10:13:42.626641+0000","last_became_peered":"2024-01-22T10:13:42.626641+0000","last_unstale":"2024-01-22T10:13:44.034290+0000","last_undegraded":"2024-01-22T10:13:44.034290+0000","last_fullsized":"2024-01-22T10:13:44.034290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:48.542860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035305+0000","last_change":"2024-01-22T10:13:42.626420+0000","last_active":"2024-01-22T10:13:44.035305+0000","last_peered":"2024-01-22T10:13:44.035305+0000","last_clean":"2024-01-22T10:13:44.035305+0000","last_became_active":"2024-01-22T10:13:42.626133+0000","last_became_peered":"2024-01-22T10:13:42.626133+0000","last_unstale":"2024-01-22T10:13:44.035305+0000","last_undegraded":"2024-01-22T10:13:44.035305+0000","last_fullsized":"2024-01-22T10:13:44.035305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:33:09.287996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035119+0000","last_change":"2024-01-22T10:13:42.637449+0000","last_active":"2024-01-22T10:13:44.035119+0000","last_peered":"2024-01-22T10:13:44.035119+0000","last_clean":"2024-01-22T10:13:44.035119+0000","last_became_active":"2024-01-22T10:13:42.637144+0000","last_became_peered":"2024-01-22T10:13:42.637144+0000","last_unstale":"2024-01-22T10:13:44.035119+0000","last_undegraded":"2024-01-22T10:13:44.035119+0000","last_fullsized":"2024-01-22T10:13:44.035119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:09.341746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033847+0000","last_change":"2024-01-22T10:13:42.623905+0000","last_active":"2024-01-22T10:13:44.033847+0000","last_peered":"2024-01-22T10:13:44.033847+0000","last_clean":"2024-01-22T10:13:44.033847+0000","last_became_active":"2024-01-22T10:13:42.623652+0000","last_became_peered":"2024-01-22T10:13:42.623652+0000","last_unstale":"2024-01-22T10:13:44.033847+0000","last_undegraded":"2024-01-22T10:13:44.033847+0000","last_fullsized":"2024-01-22T10:13:44.033847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034166+0000","last_change":"2024-01-22T10:13:42.626456+0000","last_active":"2024-01-22T10:13:44.034166+0000","last_peered":"2024-01-22T10:13:44.034166+0000","last_clean":"2024-01-22T10:13:44.034166+0000","last_became_active":"2024-01-22T10:13:42.626193+0000","last_became_peered":"2024-01-22T10:13:42.626193+0000","last_unstale":"2024-01-22T10:13:44.034166+0000","last_undegraded":"2024-01-22T10:13:44.034166+0000","last_fullsized":"2024-01-22T10:13:44.034166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:17.709645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622986+0000","last_change":"2024-01-22T10:13:42.619961+0000","last_active":"2024-01-22T10:13:43.622986+0000","last_peered":"2024-01-22T10:13:43.622986+0000","last_clean":"2024-01-22T10:13:43.622986+0000","last_became_active":"2024-01-22T10:13:42.619484+0000","last_became_peered":"2024-01-22T10:13:42.619484+0000","last_unstale":"2024-01-22T10:13:43.622986+0000","last_undegraded":"2024-01-22T10:13:43.622986+0000","last_fullsized":"2024-01-22T10:13:43.622986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624437+0000","last_change":"2024-01-22T10:13:42.621000+0000","last_active":"2024-01-22T10:13:43.624437+0000","last_peered":"2024-01-22T10:13:43.624437+0000","last_clean":"2024-01-22T10:13:43.624437+0000","last_became_active":"2024-01-22T10:13:42.620624+0000","last_became_peered":"2024-01-22T10:13:42.620624+0000","last_unstale":"2024-01-22T10:13:43.624437+0000","last_undegraded":"2024-01-22T10:13:43.624437+0000","last_fullsized":"2024-01-22T10:13:43.624437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:13.693929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622855+0000","last_change":"2024-01-22T10:13:42.631519+0000","last_active":"2024-01-22T10:13:43.622855+0000","last_peered":"2024-01-22T10:13:43.622855+0000","last_clean":"2024-01-22T10:13:43.622855+0000","last_became_active":"2024-01-22T10:13:42.630812+0000","last_became_peered":"2024-01-22T10:13:42.630812+0000","last_unstale":"2024-01-22T10:13:43.622855+0000","last_undegraded":"2024-01-22T10:13:43.622855+0000","last_fullsized":"2024-01-22T10:13:43.622855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:30:17.081991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034519+0000","last_change":"2024-01-22T10:13:42.624797+0000","last_active":"2024-01-22T10:13:44.034519+0000","last_peered":"2024-01-22T10:13:44.034519+0000","last_clean":"2024-01-22T10:13:44.034519+0000","last_became_active":"2024-01-22T10:13:42.624529+0000","last_became_peered":"2024-01-22T10:13:42.624529+0000","last_unstale":"2024-01-22T10:13:44.034519+0000","last_undegraded":"2024-01-22T10:13:44.034519+0000","last_fullsized":"2024-01-22T10:13:44.034519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035160+0000","last_change":"2024-01-22T10:13:42.637426+0000","last_active":"2024-01-22T10:13:44.035160+0000","last_peered":"2024-01-22T10:13:44.035160+0000","last_clean":"2024-01-22T10:13:44.035160+0000","last_became_active":"2024-01-22T10:13:42.637077+0000","last_became_peered":"2024-01-22T10:13:42.637077+0000","last_unstale":"2024-01-22T10:13:44.035160+0000","last_undegraded":"2024-01-22T10:13:44.035160+0000","last_fullsized":"2024-01-22T10:13:44.035160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:21:10.389082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624648+0000","last_change":"2024-01-22T10:13:42.617414+0000","last_active":"2024-01-22T10:13:43.624648+0000","last_peered":"2024-01-22T10:13:43.624648+0000","last_clean":"2024-01-22T10:13:43.624648+0000","last_became_active":"2024-01-22T10:13:42.617110+0000","last_became_peered":"2024-01-22T10:13:42.617110+0000","last_unstale":"2024-01-22T10:13:43.624648+0000","last_undegraded":"2024-01-22T10:13:43.624648+0000","last_fullsized":"2024-01-22T10:13:43.624648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986570+0000","last_change":"2024-01-22T10:13:42.628627+0000","last_active":"2024-01-22T10:13:43.986570+0000","last_peered":"2024-01-22T10:13:43.986570+0000","last_clean":"2024-01-22T10:13:43.986570+0000","last_became_active":"2024-01-22T10:13:42.628259+0000","last_became_peered":"2024-01-22T10:13:42.628259+0000","last_unstale":"2024-01-22T10:13:43.986570+0000","last_undegraded":"2024-01-22T10:13:43.986570+0000","last_fullsized":"2024-01-22T10:13:43.986570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:49.014219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624513+0000","last_change":"2024-01-22T10:13:42.624473+0000","last_active":"2024-01-22T10:13:43.624513+0000","last_peered":"2024-01-22T10:13:43.624513+0000","last_clean":"2024-01-22T10:13:43.624513+0000","last_became_active":"2024-01-22T10:13:42.623675+0000","last_became_peered":"2024-01-22T10:13:42.623675+0000","last_unstale":"2024-01-22T10:13:43.624513+0000","last_undegraded":"2024-01-22T10:13:43.624513+0000","last_fullsized":"2024-01-22T10:13:43.624513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:00:42.245954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034197+0000","last_change":"2024-01-22T10:13:42.623919+0000","last_active":"2024-01-22T10:13:44.034197+0000","last_peered":"2024-01-22T10:13:44.034197+0000","last_clean":"2024-01-22T10:13:44.034197+0000","last_became_active":"2024-01-22T10:13:42.623680+0000","last_became_peered":"2024-01-22T10:13:42.623680+0000","last_unstale":"2024-01-22T10:13:44.034197+0000","last_undegraded":"2024-01-22T10:13:44.034197+0000","last_fullsized":"2024-01-22T10:13:44.034197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:09.341746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.638092+0000","last_change":"2024-01-22T10:13:41.601272+0000","last_active":"2024-01-22T10:13:42.638092+0000","last_peered":"2024-01-22T10:13:42.638092+0000","last_clean":"2024-01-22T10:13:42.638092+0000","last_became_active":"2024-01-22T10:13:41.600823+0000","last_became_peered":"2024-01-22T10:13:41.600823+0000","last_unstale":"2024-01-22T10:13:42.638092+0000","last_undegraded":"2024-01-22T10:13:42.638092+0000","last_fullsized":"2024-01-22T10:13:42.638092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:25.193353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986817+0000","last_change":"2024-01-22T10:13:42.628954+0000","last_active":"2024-01-22T10:13:43.986817+0000","last_peered":"2024-01-22T10:13:43.986817+0000","last_clean":"2024-01-22T10:13:43.986817+0000","last_became_active":"2024-01-22T10:13:42.626926+0000","last_became_peered":"2024-01-22T10:13:42.626926+0000","last_unstale":"2024-01-22T10:13:43.986817+0000","last_undegraded":"2024-01-22T10:13:43.986817+0000","last_fullsized":"2024-01-22T10:13:43.986817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.629143+0000","last_change":"2024-01-22T10:13:41.598256+0000","last_active":"2024-01-22T10:13:42.629143+0000","last_peered":"2024-01-22T10:13:42.629143+0000","last_clean":"2024-01-22T10:13:42.629143+0000","last_became_active":"2024-01-22T10:13:41.597853+0000","last_became_peered":"2024-01-22T10:13:41.597853+0000","last_unstale":"2024-01-22T10:13:42.629143+0000","last_undegraded":"2024-01-22T10:13:42.629143+0000","last_fullsized":"2024-01-22T10:13:42.629143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:49:40.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035276+0000","last_change":"2024-01-22T10:13:42.637399+0000","last_active":"2024-01-22T10:13:44.035276+0000","last_peered":"2024-01-22T10:13:44.035276+0000","last_clean":"2024-01-22T10:13:44.035276+0000","last_became_active":"2024-01-22T10:13:42.637040+0000","last_became_peered":"2024-01-22T10:13:42.637040+0000","last_unstale":"2024-01-22T10:13:44.035276+0000","last_undegraded":"2024-01-22T10:13:44.035276+0000","last_fullsized":"2024-01-22T10:13:44.035276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:24:30.281721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.636032+0000","last_change":"2024-01-22T10:13:41.594947+0000","last_active":"2024-01-22T10:13:42.636032+0000","last_peered":"2024-01-22T10:13:42.636032+0000","last_clean":"2024-01-22T10:13:42.636032+0000","last_became_active":"2024-01-22T10:13:41.594297+0000","last_became_peered":"2024-01-22T10:13:41.594297+0000","last_unstale":"2024-01-22T10:13:42.636032+0000","last_undegraded":"2024-01-22T10:13:42.636032+0000","last_fullsized":"2024-01-22T10:13:42.636032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:08.340015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622980+0000","last_change":"2024-01-22T10:13:42.631105+0000","last_active":"2024-01-22T10:13:43.622980+0000","last_peered":"2024-01-22T10:13:43.622980+0000","last_clean":"2024-01-22T10:13:43.622980+0000","last_became_active":"2024-01-22T10:13:42.630434+0000","last_became_peered":"2024-01-22T10:13:42.630434+0000","last_unstale":"2024-01-22T10:13:43.622980+0000","last_undegraded":"2024-01-22T10:13:43.622980+0000","last_fullsized":"2024-01-22T10:13:43.622980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:20.447342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635390+0000","last_change":"2024-01-22T10:13:41.595358+0000","last_active":"2024-01-22T10:13:42.635390+0000","last_peered":"2024-01-22T10:13:42.635390+0000","last_clean":"2024-01-22T10:13:42.635390+0000","last_became_active":"2024-01-22T10:13:41.595111+0000","last_became_peered":"2024-01-22T10:13:41.595111+0000","last_unstale":"2024-01-22T10:13:42.635390+0000","last_undegraded":"2024-01-22T10:13:42.635390+0000","last_fullsized":"2024-01-22T10:13:42.635390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:42:01.516366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624715+0000","last_change":"2024-01-22T10:13:42.623899+0000","last_active":"2024-01-22T10:13:43.624715+0000","last_peered":"2024-01-22T10:13:43.624715+0000","last_clean":"2024-01-22T10:13:43.624715+0000","last_became_active":"2024-01-22T10:13:42.623634+0000","last_became_peered":"2024-01-22T10:13:42.623634+0000","last_unstale":"2024-01-22T10:13:43.624715+0000","last_undegraded":"2024-01-22T10:13:43.624715+0000","last_fullsized":"2024-01-22T10:13:43.624715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640552+0000","last_change":"2024-01-22T10:13:41.598117+0000","last_active":"2024-01-22T10:13:42.640552+0000","last_peered":"2024-01-22T10:13:42.640552+0000","last_clean":"2024-01-22T10:13:42.640552+0000","last_became_active":"2024-01-22T10:13:41.597046+0000","last_became_peered":"2024-01-22T10:13:41.597046+0000","last_unstale":"2024-01-22T10:13:42.640552+0000","last_undegraded":"2024-01-22T10:13:42.640552+0000","last_fullsized":"2024-01-22T10:13:42.640552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:44.239736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034430+0000","last_change":"2024-01-22T10:13:42.624025+0000","last_active":"2024-01-22T10:13:44.034430+0000","last_peered":"2024-01-22T10:13:44.034430+0000","last_clean":"2024-01-22T10:13:44.034430+0000","last_became_active":"2024-01-22T10:13:42.623760+0000","last_became_peered":"2024-01-22T10:13:42.623760+0000","last_unstale":"2024-01-22T10:13:44.034430+0000","last_undegraded":"2024-01-22T10:13:44.034430+0000","last_fullsized":"2024-01-22T10:13:44.034430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637438+0000","last_change":"2024-01-22T10:13:41.597237+0000","last_active":"2024-01-22T10:13:42.637438+0000","last_peered":"2024-01-22T10:13:42.637438+0000","last_clean":"2024-01-22T10:13:42.637438+0000","last_became_active":"2024-01-22T10:13:41.596938+0000","last_became_peered":"2024-01-22T10:13:41.596938+0000","last_unstale":"2024-01-22T10:13:42.637438+0000","last_undegraded":"2024-01-22T10:13:42.637438+0000","last_fullsized":"2024-01-22T10:13:42.637438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:25.193353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034876+0000","last_change":"2024-01-22T10:13:42.622658+0000","last_active":"2024-01-22T10:13:44.034876+0000","last_peered":"2024-01-22T10:13:44.034876+0000","last_clean":"2024-01-22T10:13:44.034876+0000","last_became_active":"2024-01-22T10:13:42.622398+0000","last_became_peered":"2024-01-22T10:13:42.622398+0000","last_unstale":"2024-01-22T10:13:44.034876+0000","last_undegraded":"2024-01-22T10:13:44.034876+0000","last_fullsized":"2024-01-22T10:13:44.034876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.610874+0000","last_change":"2024-01-22T10:13:41.593515+0000","last_active":"2024-01-22T10:13:42.610874+0000","last_peered":"2024-01-22T10:13:42.610874+0000","last_clean":"2024-01-22T10:13:42.610874+0000","last_became_active":"2024-01-22T10:13:41.593248+0000","last_became_peered":"2024-01-22T10:13:41.593248+0000","last_unstale":"2024-01-22T10:13:42.610874+0000","last_undegraded":"2024-01-22T10:13:42.610874+0000","last_fullsized":"2024-01-22T10:13:42.610874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:48.475424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622556+0000","last_change":"2024-01-22T10:13:42.630318+0000","last_active":"2024-01-22T10:13:43.622556+0000","last_peered":"2024-01-22T10:13:43.622556+0000","last_clean":"2024-01-22T10:13:43.622556+0000","last_became_active":"2024-01-22T10:13:42.623690+0000","last_became_peered":"2024-01-22T10:13:42.623690+0000","last_unstale":"2024-01-22T10:13:43.622556+0000","last_undegraded":"2024-01-22T10:13:43.622556+0000","last_fullsized":"2024-01-22T10:13:43.622556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:33:09.287996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621953+0000","last_change":"2024-01-22T10:13:41.601278+0000","last_active":"2024-01-22T10:13:42.621953+0000","last_peered":"2024-01-22T10:13:42.621953+0000","last_clean":"2024-01-22T10:13:42.621953+0000","last_became_active":"2024-01-22T10:13:41.601016+0000","last_became_peered":"2024-01-22T10:13:41.601016+0000","last_unstale":"2024-01-22T10:13:42.621953+0000","last_undegraded":"2024-01-22T10:13:42.621953+0000","last_fullsized":"2024-01-22T10:13:42.621953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:44:18.938485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034523+0000","last_change":"2024-01-22T10:13:42.633673+0000","last_active":"2024-01-22T10:13:44.034523+0000","last_peered":"2024-01-22T10:13:44.034523+0000","last_clean":"2024-01-22T10:13:44.034523+0000","last_became_active":"2024-01-22T10:13:42.633419+0000","last_became_peered":"2024-01-22T10:13:42.633419+0000","last_unstale":"2024-01-22T10:13:44.034523+0000","last_undegraded":"2024-01-22T10:13:44.034523+0000","last_fullsized":"2024-01-22T10:13:44.034523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.609891+0000","last_change":"2024-01-22T10:13:41.599944+0000","last_active":"2024-01-22T10:13:42.609891+0000","last_peered":"2024-01-22T10:13:42.609891+0000","last_clean":"2024-01-22T10:13:42.609891+0000","last_became_active":"2024-01-22T10:13:41.599658+0000","last_became_peered":"2024-01-22T10:13:41.599658+0000","last_unstale":"2024-01-22T10:13:42.609891+0000","last_undegraded":"2024-01-22T10:13:42.609891+0000","last_fullsized":"2024-01-22T10:13:42.609891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:48.012488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624289+0000","last_change":"2024-01-22T10:13:42.624509+0000","last_active":"2024-01-22T10:13:43.624289+0000","last_peered":"2024-01-22T10:13:43.624289+0000","last_clean":"2024-01-22T10:13:43.624289+0000","last_became_active":"2024-01-22T10:13:42.624258+0000","last_became_peered":"2024-01-22T10:13:42.624258+0000","last_unstale":"2024-01-22T10:13:43.624289+0000","last_undegraded":"2024-01-22T10:13:43.624289+0000","last_fullsized":"2024-01-22T10:13:43.624289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614510+0000","last_change":"2024-01-22T10:13:41.603096+0000","last_active":"2024-01-22T10:13:42.614510+0000","last_peered":"2024-01-22T10:13:42.614510+0000","last_clean":"2024-01-22T10:13:42.614510+0000","last_became_active":"2024-01-22T10:13:41.602525+0000","last_became_peered":"2024-01-22T10:13:41.602525+0000","last_unstale":"2024-01-22T10:13:42.614510+0000","last_undegraded":"2024-01-22T10:13:42.614510+0000","last_fullsized":"2024-01-22T10:13:42.614510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624219+0000","last_change":"2024-01-22T10:13:42.615910+0000","last_active":"2024-01-22T10:13:43.624219+0000","last_peered":"2024-01-22T10:13:43.624219+0000","last_clean":"2024-01-22T10:13:43.624219+0000","last_became_active":"2024-01-22T10:13:42.615658+0000","last_became_peered":"2024-01-22T10:13:42.615658+0000","last_unstale":"2024-01-22T10:13:43.624219+0000","last_undegraded":"2024-01-22T10:13:43.624219+0000","last_fullsized":"2024-01-22T10:13:43.624219+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.632230+0000","last_change":"2024-01-22T10:13:41.599287+0000","last_active":"2024-01-22T10:13:42.632230+0000","last_peered":"2024-01-22T10:13:42.632230+0000","last_clean":"2024-01-22T10:13:42.632230+0000","last_became_active":"2024-01-22T10:13:41.598984+0000","last_became_peered":"2024-01-22T10:13:41.598984+0000","last_unstale":"2024-01-22T10:13:42.632230+0000","last_undegraded":"2024-01-22T10:13:42.632230+0000","last_fullsized":"2024-01-22T10:13:42.632230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:48.012488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034398+0000","last_change":"2024-01-22T10:13:42.627844+0000","last_active":"2024-01-22T10:13:44.034398+0000","last_peered":"2024-01-22T10:13:44.034398+0000","last_clean":"2024-01-22T10:13:44.034398+0000","last_became_active":"2024-01-22T10:13:42.626619+0000","last_became_peered":"2024-01-22T10:13:42.626619+0000","last_unstale":"2024-01-22T10:13:44.034398+0000","last_undegraded":"2024-01-22T10:13:44.034398+0000","last_fullsized":"2024-01-22T10:13:44.034398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:00:42.245954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:49.232274+0000","last_change":"2024-01-22T10:13:41.596903+0000","last_active":"2024-01-22T10:13:49.232274+0000","last_peered":"2024-01-22T10:13:49.232274+0000","last_clean":"2024-01-22T10:13:49.232274+0000","last_became_active":"2024-01-22T10:13:41.596658+0000","last_became_peered":"2024-01-22T10:13:41.596658+0000","last_unstale":"2024-01-22T10:13:49.232274+0000","last_undegraded":"2024-01-22T10:13:49.232274+0000","last_fullsized":"2024-01-22T10:13:49.232274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T22:02:40.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2853,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622560+0000","last_change":"2024-01-22T10:13:42.627496+0000","last_active":"2024-01-22T10:13:43.622560+0000","last_peered":"2024-01-22T10:13:43.622560+0000","last_clean":"2024-01-22T10:13:43.622560+0000","last_became_active":"2024-01-22T10:13:42.627194+0000","last_became_peered":"2024-01-22T10:13:42.627194+0000","last_unstale":"2024-01-22T10:13:43.622560+0000","last_undegraded":"2024-01-22T10:13:43.622560+0000","last_fullsized":"2024-01-22T10:13:43.622560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:24:30.281721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640785+0000","last_change":"2024-01-22T10:13:41.602468+0000","last_active":"2024-01-22T10:13:42.640785+0000","last_peered":"2024-01-22T10:13:42.640785+0000","last_clean":"2024-01-22T10:13:42.640785+0000","last_became_active":"2024-01-22T10:13:41.602166+0000","last_became_peered":"2024-01-22T10:13:41.602166+0000","last_unstale":"2024-01-22T10:13:42.640785+0000","last_undegraded":"2024-01-22T10:13:42.640785+0000","last_fullsized":"2024-01-22T10:13:42.640785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:47.541129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624319+0000","last_change":"2024-01-22T10:13:42.624284+0000","last_active":"2024-01-22T10:13:43.624319+0000","last_peered":"2024-01-22T10:13:43.624319+0000","last_clean":"2024-01-22T10:13:43.624319+0000","last_became_active":"2024-01-22T10:13:42.623996+0000","last_became_peered":"2024-01-22T10:13:42.623996+0000","last_unstale":"2024-01-22T10:13:43.624319+0000","last_undegraded":"2024-01-22T10:13:43.624319+0000","last_fullsized":"2024-01-22T10:13:43.624319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:55.572047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.611919+0000","last_change":"2024-01-22T10:13:41.596625+0000","last_active":"2024-01-22T10:13:42.611919+0000","last_peered":"2024-01-22T10:13:42.611919+0000","last_clean":"2024-01-22T10:13:42.611919+0000","last_became_active":"2024-01-22T10:13:41.596376+0000","last_became_peered":"2024-01-22T10:13:41.596376+0000","last_unstale":"2024-01-22T10:13:42.611919+0000","last_undegraded":"2024-01-22T10:13:42.611919+0000","last_fullsized":"2024-01-22T10:13:42.611919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:49:40.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624720+0000","last_change":"2024-01-22T10:13:42.624678+0000","last_active":"2024-01-22T10:13:43.624720+0000","last_peered":"2024-01-22T10:13:43.624720+0000","last_clean":"2024-01-22T10:13:43.624720+0000","last_became_active":"2024-01-22T10:13:42.624005+0000","last_became_peered":"2024-01-22T10:13:42.624005+0000","last_unstale":"2024-01-22T10:13:43.624720+0000","last_undegraded":"2024-01-22T10:13:43.624720+0000","last_fullsized":"2024-01-22T10:13:43.624720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.611000+0000","last_change":"2024-01-22T10:13:41.597383+0000","last_active":"2024-01-22T10:13:42.611000+0000","last_peered":"2024-01-22T10:13:42.611000+0000","last_clean":"2024-01-22T10:13:42.611000+0000","last_became_active":"2024-01-22T10:13:41.597155+0000","last_became_peered":"2024-01-22T10:13:41.597155+0000","last_unstale":"2024-01-22T10:13:42.611000+0000","last_undegraded":"2024-01-22T10:13:42.611000+0000","last_fullsized":"2024-01-22T10:13:42.611000+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:32.767529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986697+0000","last_change":"2024-01-22T10:13:42.625547+0000","last_active":"2024-01-22T10:13:43.986697+0000","last_peered":"2024-01-22T10:13:43.986697+0000","last_clean":"2024-01-22T10:13:43.986697+0000","last_became_active":"2024-01-22T10:13:42.625291+0000","last_became_peered":"2024-01-22T10:13:42.625291+0000","last_unstale":"2024-01-22T10:13:43.986697+0000","last_undegraded":"2024-01-22T10:13:43.986697+0000","last_fullsized":"2024-01-22T10:13:43.986697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:23:18.919792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635796+0000","last_change":"2024-01-22T10:13:41.595957+0000","last_active":"2024-01-22T10:13:42.635796+0000","last_peered":"2024-01-22T10:13:42.635796+0000","last_clean":"2024-01-22T10:13:42.635796+0000","last_became_active":"2024-01-22T10:13:41.594410+0000","last_became_peered":"2024-01-22T10:13:41.594410+0000","last_unstale":"2024-01-22T10:13:42.635796+0000","last_undegraded":"2024-01-22T10:13:42.635796+0000","last_fullsized":"2024-01-22T10:13:42.635796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:22:33.851960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035330+0000","last_change":"2024-01-22T10:13:42.633175+0000","last_active":"2024-01-22T10:13:44.035330+0000","last_peered":"2024-01-22T10:13:44.035330+0000","last_clean":"2024-01-22T10:13:44.035330+0000","last_became_active":"2024-01-22T10:13:42.632877+0000","last_became_peered":"2024-01-22T10:13:42.632877+0000","last_unstale":"2024-01-22T10:13:44.035330+0000","last_undegraded":"2024-01-22T10:13:44.035330+0000","last_fullsized":"2024-01-22T10:13:44.035330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:00:21.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637591+0000","last_change":"2024-01-22T10:13:41.595203+0000","last_active":"2024-01-22T10:13:42.637591+0000","last_peered":"2024-01-22T10:13:42.637591+0000","last_clean":"2024-01-22T10:13:42.637591+0000","last_became_active":"2024-01-22T10:13:41.594555+0000","last_became_peered":"2024-01-22T10:13:41.594555+0000","last_unstale":"2024-01-22T10:13:42.637591+0000","last_undegraded":"2024-01-22T10:13:42.637591+0000","last_fullsized":"2024-01-22T10:13:42.637591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034639+0000","last_change":"2024-01-22T10:13:42.630113+0000","last_active":"2024-01-22T10:13:44.034639+0000","last_peered":"2024-01-22T10:13:44.034639+0000","last_clean":"2024-01-22T10:13:44.034639+0000","last_became_active":"2024-01-22T10:13:42.629837+0000","last_became_peered":"2024-01-22T10:13:42.629837+0000","last_unstale":"2024-01-22T10:13:44.034639+0000","last_undegraded":"2024-01-22T10:13:44.034639+0000","last_fullsized":"2024-01-22T10:13:44.034639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635198+0000","last_change":"2024-01-22T10:13:41.602980+0000","last_active":"2024-01-22T10:13:42.635198+0000","last_peered":"2024-01-22T10:13:42.635198+0000","last_clean":"2024-01-22T10:13:42.635198+0000","last_became_active":"2024-01-22T10:13:41.602710+0000","last_became_peered":"2024-01-22T10:13:41.602710+0000","last_unstale":"2024-01-22T10:13:42.635198+0000","last_undegraded":"2024-01-22T10:13:42.635198+0000","last_fullsized":"2024-01-22T10:13:42.635198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622803+0000","last_change":"2024-01-22T10:13:42.629784+0000","last_active":"2024-01-22T10:13:43.622803+0000","last_peered":"2024-01-22T10:13:43.622803+0000","last_clean":"2024-01-22T10:13:43.622803+0000","last_became_active":"2024-01-22T10:13:42.629488+0000","last_became_peered":"2024-01-22T10:13:42.629488+0000","last_unstale":"2024-01-22T10:13:43.622803+0000","last_undegraded":"2024-01-22T10:13:43.622803+0000","last_fullsized":"2024-01-22T10:13:43.622803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:19:17.630353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637429+0000","last_change":"2024-01-22T10:13:41.599558+0000","last_active":"2024-01-22T10:13:42.637429+0000","last_peered":"2024-01-22T10:13:42.637429+0000","last_clean":"2024-01-22T10:13:42.637429+0000","last_became_active":"2024-01-22T10:13:41.599228+0000","last_became_peered":"2024-01-22T10:13:41.599228+0000","last_unstale":"2024-01-22T10:13:42.637429+0000","last_undegraded":"2024-01-22T10:13:42.637429+0000","last_fullsized":"2024-01-22T10:13:42.637429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034332+0000","last_change":"2024-01-22T10:13:42.626089+0000","last_active":"2024-01-22T10:13:44.034332+0000","last_peered":"2024-01-22T10:13:44.034332+0000","last_clean":"2024-01-22T10:13:44.034332+0000","last_became_active":"2024-01-22T10:13:42.625809+0000","last_became_peered":"2024-01-22T10:13:42.625809+0000","last_unstale":"2024-01-22T10:13:44.034332+0000","last_undegraded":"2024-01-22T10:13:44.034332+0000","last_fullsized":"2024-01-22T10:13:44.034332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:55.872670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.622441+0000","last_change":"2024-01-22T10:13:41.597556+0000","last_active":"2024-01-22T10:13:42.622441+0000","last_peered":"2024-01-22T10:13:42.622441+0000","last_clean":"2024-01-22T10:13:42.622441+0000","last_became_active":"2024-01-22T10:13:41.597157+0000","last_became_peered":"2024-01-22T10:13:41.597157+0000","last_unstale":"2024-01-22T10:13:42.622441+0000","last_undegraded":"2024-01-22T10:13:42.622441+0000","last_fullsized":"2024-01-22T10:13:42.622441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:54.870939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034040+0000","last_change":"2024-01-22T10:13:42.630577+0000","last_active":"2024-01-22T10:13:44.034040+0000","last_peered":"2024-01-22T10:13:44.034040+0000","last_clean":"2024-01-22T10:13:44.034040+0000","last_became_active":"2024-01-22T10:13:42.630345+0000","last_became_peered":"2024-01-22T10:13:42.630345+0000","last_unstale":"2024-01-22T10:13:44.034040+0000","last_undegraded":"2024-01-22T10:13:44.034040+0000","last_fullsized":"2024-01-22T10:13:44.034040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:33:00.953623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.633167+0000","last_change":"2024-01-22T10:13:41.603385+0000","last_active":"2024-01-22T10:13:42.633167+0000","last_peered":"2024-01-22T10:13:42.633167+0000","last_clean":"2024-01-22T10:13:42.633167+0000","last_became_active":"2024-01-22T10:13:41.603096+0000","last_became_peered":"2024-01-22T10:13:41.603096+0000","last_unstale":"2024-01-22T10:13:42.633167+0000","last_undegraded":"2024-01-22T10:13:42.633167+0000","last_fullsized":"2024-01-22T10:13:42.633167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:52:13.557327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034134+0000","last_change":"2024-01-22T10:13:42.625780+0000","last_active":"2024-01-22T10:13:44.034134+0000","last_peered":"2024-01-22T10:13:44.034134+0000","last_clean":"2024-01-22T10:13:44.034134+0000","last_became_active":"2024-01-22T10:13:42.625524+0000","last_became_peered":"2024-01-22T10:13:42.625524+0000","last_unstale":"2024-01-22T10:13:44.034134+0000","last_undegraded":"2024-01-22T10:13:44.034134+0000","last_fullsized":"2024-01-22T10:13:44.034134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:45.241467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614787+0000","last_change":"2024-01-22T10:13:41.600994+0000","last_active":"2024-01-22T10:13:42.614787+0000","last_peered":"2024-01-22T10:13:42.614787+0000","last_clean":"2024-01-22T10:13:42.614787+0000","last_became_active":"2024-01-22T10:13:41.600704+0000","last_became_peered":"2024-01-22T10:13:41.600704+0000","last_unstale":"2024-01-22T10:13:42.614787+0000","last_undegraded":"2024-01-22T10:13:42.614787+0000","last_fullsized":"2024-01-22T10:13:42.614787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:54.870939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033907+0000","last_change":"2024-01-22T10:13:42.622896+0000","last_active":"2024-01-22T10:13:44.033907+0000","last_peered":"2024-01-22T10:13:44.033907+0000","last_clean":"2024-01-22T10:13:44.033907+0000","last_became_active":"2024-01-22T10:13:42.622631+0000","last_became_peered":"2024-01-22T10:13:42.622631+0000","last_unstale":"2024-01-22T10:13:44.033907+0000","last_undegraded":"2024-01-22T10:13:44.033907+0000","last_fullsized":"2024-01-22T10:13:44.033907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:43:02.897571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621795+0000","last_change":"2024-01-22T10:13:41.597586+0000","last_active":"2024-01-22T10:13:42.621795+0000","last_peered":"2024-01-22T10:13:42.621795+0000","last_clean":"2024-01-22T10:13:42.621795+0000","last_became_active":"2024-01-22T10:13:41.597324+0000","last_became_peered":"2024-01-22T10:13:41.597324+0000","last_unstale":"2024-01-22T10:13:42.621795+0000","last_undegraded":"2024-01-22T10:13:42.621795+0000","last_fullsized":"2024-01-22T10:13:42.621795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:43:01.895840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624510+0000","last_change":"2024-01-22T10:13:42.617670+0000","last_active":"2024-01-22T10:13:43.624510+0000","last_peered":"2024-01-22T10:13:43.624510+0000","last_clean":"2024-01-22T10:13:43.624510+0000","last_became_active":"2024-01-22T10:13:42.616992+0000","last_became_peered":"2024-01-22T10:13:42.616992+0000","last_unstale":"2024-01-22T10:13:43.624510+0000","last_undegraded":"2024-01-22T10:13:43.624510+0000","last_fullsized":"2024-01-22T10:13:43.624510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614491+0000","last_change":"2024-01-22T10:13:41.599431+0000","last_active":"2024-01-22T10:13:42.614491+0000","last_peered":"2024-01-22T10:13:42.614491+0000","last_clean":"2024-01-22T10:13:42.614491+0000","last_became_active":"2024-01-22T10:13:41.599008+0000","last_became_peered":"2024-01-22T10:13:41.599008+0000","last_unstale":"2024-01-22T10:13:42.614491+0000","last_undegraded":"2024-01-22T10:13:42.614491+0000","last_fullsized":"2024-01-22T10:13:42.614491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T22:02:40.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034455+0000","last_change":"2024-01-22T10:13:42.626317+0000","last_active":"2024-01-22T10:13:44.034455+0000","last_peered":"2024-01-22T10:13:44.034455+0000","last_clean":"2024-01-22T10:13:44.034455+0000","last_became_active":"2024-01-22T10:13:42.626088+0000","last_became_peered":"2024-01-22T10:13:42.626088+0000","last_unstale":"2024-01-22T10:13:44.034455+0000","last_undegraded":"2024-01-22T10:13:44.034455+0000","last_fullsized":"2024-01-22T10:13:44.034455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:39:36.530327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640956+0000","last_change":"2024-01-22T10:13:41.597369+0000","last_active":"2024-01-22T10:13:42.640956+0000","last_peered":"2024-01-22T10:13:42.640956+0000","last_clean":"2024-01-22T10:13:42.640956+0000","last_became_active":"2024-01-22T10:13:41.597126+0000","last_became_peered":"2024-01-22T10:13:41.597126+0000","last_unstale":"2024-01-22T10:13:42.640956+0000","last_undegraded":"2024-01-22T10:13:42.640956+0000","last_fullsized":"2024-01-22T10:13:42.640956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034664+0000","last_change":"2024-01-22T10:13:42.624684+0000","last_active":"2024-01-22T10:13:44.034664+0000","last_peered":"2024-01-22T10:13:44.034664+0000","last_clean":"2024-01-22T10:13:44.034664+0000","last_became_active":"2024-01-22T10:13:42.624431+0000","last_became_peered":"2024-01-22T10:13:42.624431+0000","last_unstale":"2024-01-22T10:13:44.034664+0000","last_undegraded":"2024-01-22T10:13:44.034664+0000","last_fullsized":"2024-01-22T10:13:44.034664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.612790+0000","last_change":"2024-01-22T10:13:41.603337+0000","last_active":"2024-01-22T10:13:43.612790+0000","last_peered":"2024-01-22T10:13:43.612790+0000","last_clean":"2024-01-22T10:13:43.612790+0000","last_became_active":"2024-01-22T10:13:41.602818+0000","last_became_peered":"2024-01-22T10:13:41.602818+0000","last_unstale":"2024-01-22T10:13:43.612790+0000","last_undegraded":"2024-01-22T10:13:43.612790+0000","last_fullsized":"2024-01-22T10:13:43.612790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033982+0000","last_change":"2024-01-22T10:13:42.626012+0000","last_active":"2024-01-22T10:13:44.033982+0000","last_peered":"2024-01-22T10:13:44.033982+0000","last_clean":"2024-01-22T10:13:44.033982+0000","last_became_active":"2024-01-22T10:13:42.625759+0000","last_became_peered":"2024-01-22T10:13:42.625759+0000","last_unstale":"2024-01-22T10:13:44.033982+0000","last_undegraded":"2024-01-22T10:13:44.033982+0000","last_fullsized":"2024-01-22T10:13:44.033982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.613216+0000","last_change":"2024-01-22T10:13:41.593779+0000","last_active":"2024-01-22T10:13:42.613216+0000","last_peered":"2024-01-22T10:13:42.613216+0000","last_clean":"2024-01-22T10:13:42.613216+0000","last_became_active":"2024-01-22T10:13:41.593469+0000","last_became_peered":"2024-01-22T10:13:41.593469+0000","last_unstale":"2024-01-22T10:13:42.613216+0000","last_undegraded":"2024-01-22T10:13:42.613216+0000","last_fullsized":"2024-01-22T10:13:42.613216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:52:13.557327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986594+0000","last_change":"2024-01-22T10:13:42.622705+0000","last_active":"2024-01-22T10:13:43.986594+0000","last_peered":"2024-01-22T10:13:43.986594+0000","last_clean":"2024-01-22T10:13:43.986594+0000","last_became_active":"2024-01-22T10:13:42.622464+0000","last_became_peered":"2024-01-22T10:13:42.622464+0000","last_unstale":"2024-01-22T10:13:43.986594+0000","last_undegraded":"2024-01-22T10:13:43.986594+0000","last_fullsized":"2024-01-22T10:13:43.986594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:22:34.853691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614866+0000","last_change":"2024-01-22T10:13:41.601304+0000","last_active":"2024-01-22T10:13:42.614866+0000","last_peered":"2024-01-22T10:13:42.614866+0000","last_clean":"2024-01-22T10:13:42.614866+0000","last_became_active":"2024-01-22T10:13:41.601010+0000","last_became_peered":"2024-01-22T10:13:41.601010+0000","last_unstale":"2024-01-22T10:13:42.614866+0000","last_undegraded":"2024-01-22T10:13:42.614866+0000","last_fullsized":"2024-01-22T10:13:42.614866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:33:12.832661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034206+0000","last_change":"2024-01-22T10:13:42.623113+0000","last_active":"2024-01-22T10:13:44.034206+0000","last_peered":"2024-01-22T10:13:44.034206+0000","last_clean":"2024-01-22T10:13:44.034206+0000","last_became_active":"2024-01-22T10:13:42.622855+0000","last_became_peered":"2024-01-22T10:13:42.622855+0000","last_unstale":"2024-01-22T10:13:44.034206+0000","last_undegraded":"2024-01-22T10:13:44.034206+0000","last_fullsized":"2024-01-22T10:13:44.034206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:21:10.389082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.612039+0000","last_change":"2024-01-22T10:13:41.597546+0000","last_active":"2024-01-22T10:13:42.612039+0000","last_peered":"2024-01-22T10:13:42.612039+0000","last_clean":"2024-01-22T10:13:42.612039+0000","last_became_active":"2024-01-22T10:13:41.597270+0000","last_became_peered":"2024-01-22T10:13:41.597270+0000","last_unstale":"2024-01-22T10:13:42.612039+0000","last_undegraded":"2024-01-22T10:13:42.612039+0000","last_fullsized":"2024-01-22T10:13:42.612039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:33:12.832661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624046+0000","last_change":"2024-01-22T10:13:42.623605+0000","last_active":"2024-01-22T10:13:43.624046+0000","last_peered":"2024-01-22T10:13:43.624046+0000","last_clean":"2024-01-22T10:13:43.624046+0000","last_became_active":"2024-01-22T10:13:42.623331+0000","last_became_peered":"2024-01-22T10:13:42.623331+0000","last_unstale":"2024-01-22T10:13:43.624046+0000","last_undegraded":"2024-01-22T10:13:43.624046+0000","last_fullsized":"2024-01-22T10:13:43.624046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621970+0000","last_change":"2024-01-22T10:13:41.596973+0000","last_active":"2024-01-22T10:13:42.621970+0000","last_peered":"2024-01-22T10:13:42.621970+0000","last_clean":"2024-01-22T10:13:42.621970+0000","last_became_active":"2024-01-22T10:13:41.596639+0000","last_became_peered":"2024-01-22T10:13:41.596639+0000","last_unstale":"2024-01-22T10:13:42.621970+0000","last_undegraded":"2024-01-22T10:13:42.621970+0000","last_fullsized":"2024-01-22T10:13:42.621970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:32:59.951892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034916+0000","last_change":"2024-01-22T10:13:42.637594+0000","last_active":"2024-01-22T10:13:44.034916+0000","last_peered":"2024-01-22T10:13:44.034916+0000","last_clean":"2024-01-22T10:13:44.034916+0000","last_became_active":"2024-01-22T10:13:42.637152+0000","last_became_peered":"2024-01-22T10:13:42.637152+0000","last_unstale":"2024-01-22T10:13:44.034916+0000","last_undegraded":"2024-01-22T10:13:44.034916+0000","last_fullsized":"2024-01-22T10:13:44.034916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.610626+0000","last_change":"2024-01-22T10:13:41.600670+0000","last_active":"2024-01-22T10:13:42.610626+0000","last_peered":"2024-01-22T10:13:42.610626+0000","last_clean":"2024-01-22T10:13:42.610626+0000","last_became_active":"2024-01-22T10:13:41.600181+0000","last_became_peered":"2024-01-22T10:13:41.600181+0000","last_unstale":"2024-01-22T10:13:42.610626+0000","last_undegraded":"2024-01-22T10:13:42.610626+0000","last_fullsized":"2024-01-22T10:13:42.610626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:23:17.918061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624601+0000","last_change":"2024-01-22T10:13:42.626739+0000","last_active":"2024-01-22T10:13:43.624601+0000","last_peered":"2024-01-22T10:13:43.624601+0000","last_clean":"2024-01-22T10:13:43.624601+0000","last_became_active":"2024-01-22T10:13:42.626445+0000","last_became_peered":"2024-01-22T10:13:42.626445+0000","last_unstale":"2024-01-22T10:13:43.624601+0000","last_undegraded":"2024-01-22T10:13:43.624601+0000","last_fullsized":"2024-01-22T10:13:43.624601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.613827+0000","last_change":"2024-01-22T10:13:41.600294+0000","last_active":"2024-01-22T10:13:42.613827+0000","last_peered":"2024-01-22T10:13:42.613827+0000","last_clean":"2024-01-22T10:13:42.613827+0000","last_became_active":"2024-01-22T10:13:41.599985+0000","last_became_peered":"2024-01-22T10:13:41.599985+0000","last_unstale":"2024-01-22T10:13:42.613827+0000","last_undegraded":"2024-01-22T10:13:42.613827+0000","last_fullsized":"2024-01-22T10:13:42.613827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:47.541129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.609823+0000","last_change":"2024-01-22T10:12:52.033359+0000","last_active":"2024-01-22T10:13:42.609823+0000","last_peered":"2024-01-22T10:13:42.609823+0000","last_clean":"2024-01-22T10:13:42.609823+0000","last_became_active":"2024-01-22T10:12:52.033101+0000","last_became_peered":"2024-01-22T10:12:52.033101+0000","last_unstale":"2024-01-22T10:13:42.609823+0000","last_undegraded":"2024-01-22T10:13:42.609823+0000","last_fullsized":"2024-01-22T10:13:42.609823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_clean_scrub_stamp":"2024-01-22T10:12:51.022957+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:45:37.023233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3651,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":719503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.61699999999999999}]},{"osd":1,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.497},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.66300000000000003}]},{"osd":2,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.441},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.46500000000000002}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59799999999999998}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.40500000000000003}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.371}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":130933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":129115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":130933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":719413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T10:13:55.445 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T10:13:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.597+0000 7f2ce6c51640 1 Processor -- start 2024-01-22T10:13:55.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.597+0000 7f2ce6c51640 1 -- start start 2024-01-22T10:13:55.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.597+0000 7f2ce6c51640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce00bb8b0 0x7f2ce00b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.597+0000 7f2ce6c51640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ce00b5830 0x7f2ce0143240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.597+0000 7f2ce6c51640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce00b8850 con 0x7f2ce0143780 2024-01-22T10:13:55.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.597+0000 7f2ce6c51640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce00b9060 con 0x7f2ce00b5830 2024-01-22T10:13:55.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.597+0000 7f2ce6c51640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce00bab60 con 0x7f2ce00bb8b0 2024-01-22T10:13:55.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.597+0000 7f2cdffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ce00b5830 0x7f2ce0143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.598+0000 7f2cdffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ce00b5830 0x7f2ce0143240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45566/0 (socket says 172.21.15.88:45566) 2024-01-22T10:13:55.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.598+0000 7f2cdffff640 1 -- 172.21.15.88:0/2000099953 learned_addr learned my addr 172.21.15.88:0/2000099953 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:55.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.598+0000 7f2ce49ed640 1 --2- 172.21.15.88:0/2000099953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce00bb8b0 0x7f2ce00b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.598+0000 7f2cdffff640 1 -- 172.21.15.88:0/2000099953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce00bb8b0 msgr2=0x7f2ce00b95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:55.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.598+0000 7f2cdffff640 1 --2- 172.21.15.88:0/2000099953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce00bb8b0 0x7f2ce00b95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.598+0000 7f2cdffff640 1 -- 172.21.15.88:0/2000099953 >> v1:172.21.15.119:6789/0 conn(0x7f2ce0143780 legacy=0x7f2ce0149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:55.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.598+0000 7f2cdffff640 1 -- 172.21.15.88:0/2000099953 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce00b8aa0 con 0x7f2ce00b5830 2024-01-22T10:13:55.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.598+0000 7f2cdffff640 1 --2- 172.21.15.88:0/2000099953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce00b5830 0x7f2ce0143240 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009870 tx=0x7f2ccc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6cfe3c939aabd75 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:55.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.599+0000 7f2cdf7fe640 1 -- 172.21.15.88:0/2000099953 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc030840 con 0x7f2ce00b5830 2024-01-22T10:13:55.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.599+0000 7f2cdf7fe640 1 -- 172.21.15.88:0/2000099953 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc0309a0 con 0x7f2ce00b5830 2024-01-22T10:13:55.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.599+0000 7f2cdf7fe640 1 -- 172.21.15.88:0/2000099953 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc030d30 con 0x7f2ce00b5830 2024-01-22T10:13:55.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.599+0000 7f2ce6c51640 1 -- 172.21.15.88:0/2000099953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce00b5830 msgr2=0x7f2ce0143240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.599+0000 7f2ce6c51640 1 --2- 172.21.15.88:0/2000099953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce00b5830 0x7f2ce0143240 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009870 tx=0x7f2ccc02b980 comp rx=0 tx=0).stop 2024-01-22T10:13:55.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.599+0000 7f2ce6c51640 1 -- 172.21.15.88:0/2000099953 shutdown_connections 2024-01-22T10:13:55.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.599+0000 7f2ce6c51640 1 --2- 172.21.15.88:0/2000099953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce00b5830 0x7f2ce0143240 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.599+0000 7f2ce6c51640 1 --2- 172.21.15.88:0/2000099953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce00bb8b0 0x7f2ce00b95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.599+0000 7f2ce6c51640 1 -- 172.21.15.88:0/2000099953 >> 172.21.15.88:0/2000099953 conn(0x7f2ce0066380 msgr2=0x7f2ce0066760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:55.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.599+0000 7f2ce6c51640 1 -- 172.21.15.88:0/2000099953 shutdown_connections 2024-01-22T10:13:55.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.599+0000 7f2ce6c51640 1 -- 172.21.15.88:0/2000099953 wait complete. 2024-01-22T10:13:55.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.600+0000 7f2ce6c51640 1 Processor -- start 2024-01-22T10:13:55.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.600+0000 7f2ce6c51640 1 -- start start 2024-01-22T10:13:55.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce6c51640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce00b5830 0x7f2ce0148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce6c51640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce00bb8b0 0x7f2ce0148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce6c51640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce0143780 0x7f2ce01d5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce6c51640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce01d4fa0 con 0x7f2ce00b5830 2024-01-22T10:13:55.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce6c51640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce01d49e0 con 0x7f2ce00bb8b0 2024-01-22T10:13:55.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce6c51640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce0144ff0 con 0x7f2ce0143780 2024-01-22T10:13:55.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce49ed640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce00b5830 0x7f2ce0148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce49ed640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce00b5830 0x7f2ce0148850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45568/0 (socket says 172.21.15.88:45568) 2024-01-22T10:13:55.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce49ed640 1 -- 172.21.15.88:0/3978820331 learned_addr learned my addr 172.21.15.88:0/3978820331 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:55.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2cdffff640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce00bb8b0 0x7f2ce0148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce49ed640 1 -- 172.21.15.88:0/3978820331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce0143780 msgr2=0x7f2ce01d5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce51ee640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce0143780 0x7f2ce01d5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce49ed640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce0143780 0x7f2ce01d5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce49ed640 1 -- 172.21.15.88:0/3978820331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce00bb8b0 msgr2=0x7f2ce0148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce49ed640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce00bb8b0 0x7f2ce0148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce49ed640 1 -- 172.21.15.88:0/3978820331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc0094d0 con 0x7f2ce00b5830 2024-01-22T10:13:55.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2cdffff640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce00bb8b0 0x7f2ce0148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:55.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.601+0000 7f2ce49ed640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce00b5830 0x7f2ce0148850 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400c820 tx=0x7f2cd400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.602+0000 7f2cdd7fa640 1 -- 172.21.15.88:0/3978820331 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4004220 con 0x7f2ce00b5830 2024-01-22T10:13:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.602+0000 7f2cdd7fa640 1 -- 172.21.15.88:0/3978820331 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd40043a0 con 0x7f2ce00b5830 2024-01-22T10:13:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.602+0000 7f2ce6c51640 1 -- 172.21.15.88:0/3978820331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce0145260 con 0x7f2ce00b5830 2024-01-22T10:13:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.602+0000 7f2cdd7fa640 1 -- 172.21.15.88:0/3978820331 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4007a70 con 0x7f2ce00b5830 2024-01-22T10:13:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.602+0000 7f2ce6c51640 1 -- 172.21.15.88:0/3978820331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce01d4c30 con 0x7f2ce00b5830 2024-01-22T10:13:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.603+0000 7f2ce6c51640 1 -- 172.21.15.88:0/3978820331 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce00ba370 con 0x7f2ce00b5830 2024-01-22T10:13:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.603+0000 7f2cdd7fa640 1 -- 172.21.15.88:0/3978820331 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f2cd4007bd0 con 0x7f2ce00b5830 2024-01-22T10:13:55.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.603+0000 7f2cdd7fa640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2cc406b360 0x7f2cc406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.603+0000 7f2cdd7fa640 1 -- 172.21.15.88:0/3978820331 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cd40898c0 con 0x7f2ce00b5830 2024-01-22T10:13:55.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.603+0000 7f2cdffff640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2cc406b360 0x7f2cc406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.604+0000 7f2cdffff640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2cc406b360 0x7f2cc406d820 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc036000 tx=0x7f2ccc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:55.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.608+0000 7f2cdd7fa640 1 -- 172.21.15.88:0/3978820331 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2cd40545e0 con 0x7f2ce00b5830 2024-01-22T10:13:55.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.774+0000 7f2ce6c51640 1 -- 172.21.15.88:0/3978820331 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ce00bbc90 con 0x7f2cc406b360 2024-01-22T10:13:55.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.780+0000 7f2cdd7fa640 1 -- 172.21.15.88:0/3978820331 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267791 (secure 0 0 0) 0x7f2ccc030c10 con 0x7f2cc406b360 2024-01-22T10:13:55.766 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-01-22T10:13:55.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.783+0000 7f2ce6c51640 1 -- 172.21.15.88:0/3978820331 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2cc406b360 msgr2=0x7f2cc406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.783+0000 7f2ce6c51640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2cc406b360 0x7f2cc406d820 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc036000 tx=0x7f2ccc03b040 comp rx=0 tx=0).stop 2024-01-22T10:13:55.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.783+0000 7f2ce6c51640 1 -- 172.21.15.88:0/3978820331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce00b5830 msgr2=0x7f2ce0148850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.783+0000 7f2ce6c51640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce00b5830 0x7f2ce0148850 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400c820 tx=0x7f2cd400cce0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.783+0000 7f2ce6c51640 1 -- 172.21.15.88:0/3978820331 shutdown_connections 2024-01-22T10:13:55.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.783+0000 7f2ce6c51640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f2cc406b360 0x7f2cc406d820 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.783+0000 7f2ce6c51640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce0143780 0x7f2ce01d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.783+0000 7f2ce6c51640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce00bb8b0 0x7f2ce0148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.783+0000 7f2ce6c51640 1 --2- 172.21.15.88:0/3978820331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ce00b5830 0x7f2ce0148850 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.783+0000 7f2ce6c51640 1 -- 172.21.15.88:0/3978820331 >> 172.21.15.88:0/3978820331 conn(0x7f2ce0066380 msgr2=0x7f2ce01414c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:55.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.783+0000 7f2ce6c51640 1 -- 172.21.15.88:0/3978820331 shutdown_connections 2024-01-22T10:13:55.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.783+0000 7f2ce6c51640 1 -- 172.21.15.88:0/3978820331 wait complete. 2024-01-22T10:13:55.776 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-01-22T10:13:54.715586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594019,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220048,"kb_used_data":3848,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754672,"statfs":{"total":773094113280,"available":772868784128,"internally_reserved":0,"allocated":3940352,"data_stored":2218424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3651,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.094255"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986737+0000","last_change":"2024-01-22T10:13:42.628705+0000","last_active":"2024-01-22T10:13:43.986737+0000","last_peered":"2024-01-22T10:13:43.986737+0000","last_clean":"2024-01-22T10:13:43.986737+0000","last_became_active":"2024-01-22T10:13:42.627514+0000","last_became_peered":"2024-01-22T10:13:42.627514+0000","last_unstale":"2024-01-22T10:13:43.986737+0000","last_undegraded":"2024-01-22T10:13:43.986737+0000","last_fullsized":"2024-01-22T10:13:43.986737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624367+0000","last_change":"2024-01-22T10:13:42.623390+0000","last_active":"2024-01-22T10:13:43.624367+0000","last_peered":"2024-01-22T10:13:43.624367+0000","last_clean":"2024-01-22T10:13:43.624367+0000","last_became_active":"2024-01-22T10:13:42.623152+0000","last_became_peered":"2024-01-22T10:13:42.623152+0000","last_unstale":"2024-01-22T10:13:43.624367+0000","last_undegraded":"2024-01-22T10:13:43.624367+0000","last_fullsized":"2024-01-22T10:13:43.624367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:45:45.479717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034543+0000","last_change":"2024-01-22T10:13:42.627502+0000","last_active":"2024-01-22T10:13:44.034543+0000","last_peered":"2024-01-22T10:13:44.034543+0000","last_clean":"2024-01-22T10:13:44.034543+0000","last_became_active":"2024-01-22T10:13:42.627157+0000","last_became_peered":"2024-01-22T10:13:42.627157+0000","last_unstale":"2024-01-22T10:13:44.034543+0000","last_undegraded":"2024-01-22T10:13:44.034543+0000","last_fullsized":"2024-01-22T10:13:44.034543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622679+0000","last_change":"2024-01-22T10:13:42.631690+0000","last_active":"2024-01-22T10:13:43.622679+0000","last_peered":"2024-01-22T10:13:43.622679+0000","last_clean":"2024-01-22T10:13:43.622679+0000","last_became_active":"2024-01-22T10:13:42.630134+0000","last_became_peered":"2024-01-22T10:13:42.630134+0000","last_unstale":"2024-01-22T10:13:43.622679+0000","last_undegraded":"2024-01-22T10:13:43.622679+0000","last_fullsized":"2024-01-22T10:13:43.622679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:00:21.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034028+0000","last_change":"2024-01-22T10:13:42.636628+0000","last_active":"2024-01-22T10:13:44.034028+0000","last_peered":"2024-01-22T10:13:44.034028+0000","last_clean":"2024-01-22T10:13:44.034028+0000","last_became_active":"2024-01-22T10:13:42.636239+0000","last_became_peered":"2024-01-22T10:13:42.636239+0000","last_unstale":"2024-01-22T10:13:44.034028+0000","last_undegraded":"2024-01-22T10:13:44.034028+0000","last_fullsized":"2024-01-22T10:13:44.034028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:44:19.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624118+0000","last_change":"2024-01-22T10:13:42.621975+0000","last_active":"2024-01-22T10:13:43.624118+0000","last_peered":"2024-01-22T10:13:43.624118+0000","last_clean":"2024-01-22T10:13:43.624118+0000","last_became_active":"2024-01-22T10:13:42.621590+0000","last_became_peered":"2024-01-22T10:13:42.621590+0000","last_unstale":"2024-01-22T10:13:43.624118+0000","last_undegraded":"2024-01-22T10:13:43.624118+0000","last_fullsized":"2024-01-22T10:13:43.624118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624659+0000","last_change":"2024-01-22T10:13:42.617901+0000","last_active":"2024-01-22T10:13:43.624659+0000","last_peered":"2024-01-22T10:13:43.624659+0000","last_clean":"2024-01-22T10:13:43.624659+0000","last_became_active":"2024-01-22T10:13:42.617384+0000","last_became_peered":"2024-01-22T10:13:42.617384+0000","last_unstale":"2024-01-22T10:13:43.624659+0000","last_undegraded":"2024-01-22T10:13:43.624659+0000","last_fullsized":"2024-01-22T10:13:43.624659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624647+0000","last_change":"2024-01-22T10:13:42.622490+0000","last_active":"2024-01-22T10:13:43.624647+0000","last_peered":"2024-01-22T10:13:43.624647+0000","last_clean":"2024-01-22T10:13:43.624647+0000","last_became_active":"2024-01-22T10:13:42.622220+0000","last_became_peered":"2024-01-22T10:13:42.622220+0000","last_unstale":"2024-01-22T10:13:43.624647+0000","last_undegraded":"2024-01-22T10:13:43.624647+0000","last_fullsized":"2024-01-22T10:13:43.624647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035496+0000","last_change":"2024-01-22T10:13:42.635502+0000","last_active":"2024-01-22T10:13:44.035496+0000","last_peered":"2024-01-22T10:13:44.035496+0000","last_clean":"2024-01-22T10:13:44.035496+0000","last_became_active":"2024-01-22T10:13:42.635312+0000","last_became_peered":"2024-01-22T10:13:42.635312+0000","last_unstale":"2024-01-22T10:13:44.035496+0000","last_undegraded":"2024-01-22T10:13:44.035496+0000","last_fullsized":"2024-01-22T10:13:44.035496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:19:17.630353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622947+0000","last_change":"2024-01-22T10:13:42.635158+0000","last_active":"2024-01-22T10:13:43.622947+0000","last_peered":"2024-01-22T10:13:43.622947+0000","last_clean":"2024-01-22T10:13:43.622947+0000","last_became_active":"2024-01-22T10:13:42.634191+0000","last_became_peered":"2024-01-22T10:13:42.634191+0000","last_unstale":"2024-01-22T10:13:43.622947+0000","last_undegraded":"2024-01-22T10:13:43.622947+0000","last_fullsized":"2024-01-22T10:13:43.622947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:17.709645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624931+0000","last_change":"2024-01-22T10:13:42.621049+0000","last_active":"2024-01-22T10:13:43.624931+0000","last_peered":"2024-01-22T10:13:43.624931+0000","last_clean":"2024-01-22T10:13:43.624931+0000","last_became_active":"2024-01-22T10:13:42.620763+0000","last_became_peered":"2024-01-22T10:13:42.620763+0000","last_unstale":"2024-01-22T10:13:43.624931+0000","last_undegraded":"2024-01-22T10:13:43.624931+0000","last_fullsized":"2024-01-22T10:13:43.624931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:45:45.479717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034352+0000","last_change":"2024-01-22T10:13:42.634597+0000","last_active":"2024-01-22T10:13:44.034352+0000","last_peered":"2024-01-22T10:13:44.034352+0000","last_clean":"2024-01-22T10:13:44.034352+0000","last_became_active":"2024-01-22T10:13:42.634366+0000","last_became_peered":"2024-01-22T10:13:42.634366+0000","last_unstale":"2024-01-22T10:13:44.034352+0000","last_undegraded":"2024-01-22T10:13:44.034352+0000","last_fullsized":"2024-01-22T10:13:44.034352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034137+0000","last_change":"2024-01-22T10:13:42.624821+0000","last_active":"2024-01-22T10:13:44.034137+0000","last_peered":"2024-01-22T10:13:44.034137+0000","last_clean":"2024-01-22T10:13:44.034137+0000","last_became_active":"2024-01-22T10:13:42.624548+0000","last_became_peered":"2024-01-22T10:13:42.624548+0000","last_unstale":"2024-01-22T10:13:44.034137+0000","last_undegraded":"2024-01-22T10:13:44.034137+0000","last_fullsized":"2024-01-22T10:13:44.034137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:26.195084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624093+0000","last_change":"2024-01-22T10:13:42.625911+0000","last_active":"2024-01-22T10:13:43.624093+0000","last_peered":"2024-01-22T10:13:43.624093+0000","last_clean":"2024-01-22T10:13:43.624093+0000","last_became_active":"2024-01-22T10:13:42.625647+0000","last_became_peered":"2024-01-22T10:13:42.625647+0000","last_unstale":"2024-01-22T10:13:43.624093+0000","last_undegraded":"2024-01-22T10:13:43.624093+0000","last_fullsized":"2024-01-22T10:13:43.624093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034305+0000","last_change":"2024-01-22T10:13:42.621130+0000","last_active":"2024-01-22T10:13:44.034305+0000","last_peered":"2024-01-22T10:13:44.034305+0000","last_clean":"2024-01-22T10:13:44.034305+0000","last_became_active":"2024-01-22T10:13:42.620805+0000","last_became_peered":"2024-01-22T10:13:42.620805+0000","last_unstale":"2024-01-22T10:13:44.034305+0000","last_undegraded":"2024-01-22T10:13:44.034305+0000","last_fullsized":"2024-01-22T10:13:44.034305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:20.447342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624819+0000","last_change":"2024-01-22T10:13:42.624267+0000","last_active":"2024-01-22T10:13:43.624819+0000","last_peered":"2024-01-22T10:13:43.624819+0000","last_clean":"2024-01-22T10:13:43.624819+0000","last_became_active":"2024-01-22T10:13:42.623306+0000","last_became_peered":"2024-01-22T10:13:42.623306+0000","last_unstale":"2024-01-22T10:13:43.624819+0000","last_undegraded":"2024-01-22T10:13:43.624819+0000","last_fullsized":"2024-01-22T10:13:43.624819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:55.572047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.625077+0000","last_change":"2024-01-22T10:13:42.617345+0000","last_active":"2024-01-22T10:13:43.625077+0000","last_peered":"2024-01-22T10:13:43.625077+0000","last_clean":"2024-01-22T10:13:43.625077+0000","last_became_active":"2024-01-22T10:13:42.617072+0000","last_became_peered":"2024-01-22T10:13:42.617072+0000","last_unstale":"2024-01-22T10:13:43.625077+0000","last_undegraded":"2024-01-22T10:13:43.625077+0000","last_fullsized":"2024-01-22T10:13:43.625077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:08:00.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624439+0000","last_change":"2024-01-22T10:13:42.625193+0000","last_active":"2024-01-22T10:13:43.624439+0000","last_peered":"2024-01-22T10:13:43.624439+0000","last_clean":"2024-01-22T10:13:43.624439+0000","last_became_active":"2024-01-22T10:13:42.624862+0000","last_became_peered":"2024-01-22T10:13:42.624862+0000","last_unstale":"2024-01-22T10:13:43.624439+0000","last_undegraded":"2024-01-22T10:13:43.624439+0000","last_fullsized":"2024-01-22T10:13:43.624439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:08:00.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624133+0000","last_change":"2024-01-22T10:13:42.626004+0000","last_active":"2024-01-22T10:13:43.624133+0000","last_peered":"2024-01-22T10:13:43.624133+0000","last_clean":"2024-01-22T10:13:43.624133+0000","last_became_active":"2024-01-22T10:13:42.625078+0000","last_became_peered":"2024-01-22T10:13:42.625078+0000","last_unstale":"2024-01-22T10:13:43.624133+0000","last_undegraded":"2024-01-22T10:13:43.624133+0000","last_fullsized":"2024-01-22T10:13:43.624133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034290+0000","last_change":"2024-01-22T10:13:42.626913+0000","last_active":"2024-01-22T10:13:44.034290+0000","last_peered":"2024-01-22T10:13:44.034290+0000","last_clean":"2024-01-22T10:13:44.034290+0000","last_became_active":"2024-01-22T10:13:42.626641+0000","last_became_peered":"2024-01-22T10:13:42.626641+0000","last_unstale":"2024-01-22T10:13:44.034290+0000","last_undegraded":"2024-01-22T10:13:44.034290+0000","last_fullsized":"2024-01-22T10:13:44.034290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:48.542860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035305+0000","last_change":"2024-01-22T10:13:42.626420+0000","last_active":"2024-01-22T10:13:44.035305+0000","last_peered":"2024-01-22T10:13:44.035305+0000","last_clean":"2024-01-22T10:13:44.035305+0000","last_became_active":"2024-01-22T10:13:42.626133+0000","last_became_peered":"2024-01-22T10:13:42.626133+0000","last_unstale":"2024-01-22T10:13:44.035305+0000","last_undegraded":"2024-01-22T10:13:44.035305+0000","last_fullsized":"2024-01-22T10:13:44.035305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:33:09.287996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035119+0000","last_change":"2024-01-22T10:13:42.637449+0000","last_active":"2024-01-22T10:13:44.035119+0000","last_peered":"2024-01-22T10:13:44.035119+0000","last_clean":"2024-01-22T10:13:44.035119+0000","last_became_active":"2024-01-22T10:13:42.637144+0000","last_became_peered":"2024-01-22T10:13:42.637144+0000","last_unstale":"2024-01-22T10:13:44.035119+0000","last_undegraded":"2024-01-22T10:13:44.035119+0000","last_fullsized":"2024-01-22T10:13:44.035119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:09.341746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033847+0000","last_change":"2024-01-22T10:13:42.623905+0000","last_active":"2024-01-22T10:13:44.033847+0000","last_peered":"2024-01-22T10:13:44.033847+0000","last_clean":"2024-01-22T10:13:44.033847+0000","last_became_active":"2024-01-22T10:13:42.623652+0000","last_became_peered":"2024-01-22T10:13:42.623652+0000","last_unstale":"2024-01-22T10:13:44.033847+0000","last_undegraded":"2024-01-22T10:13:44.033847+0000","last_fullsized":"2024-01-22T10:13:44.033847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034166+0000","last_change":"2024-01-22T10:13:42.626456+0000","last_active":"2024-01-22T10:13:44.034166+0000","last_peered":"2024-01-22T10:13:44.034166+0000","last_clean":"2024-01-22T10:13:44.034166+0000","last_became_active":"2024-01-22T10:13:42.626193+0000","last_became_peered":"2024-01-22T10:13:42.626193+0000","last_unstale":"2024-01-22T10:13:44.034166+0000","last_undegraded":"2024-01-22T10:13:44.034166+0000","last_fullsized":"2024-01-22T10:13:44.034166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:17.709645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622986+0000","last_change":"2024-01-22T10:13:42.619961+0000","last_active":"2024-01-22T10:13:43.622986+0000","last_peered":"2024-01-22T10:13:43.622986+0000","last_clean":"2024-01-22T10:13:43.622986+0000","last_became_active":"2024-01-22T10:13:42.619484+0000","last_became_peered":"2024-01-22T10:13:42.619484+0000","last_unstale":"2024-01-22T10:13:43.622986+0000","last_undegraded":"2024-01-22T10:13:43.622986+0000","last_fullsized":"2024-01-22T10:13:43.622986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624437+0000","last_change":"2024-01-22T10:13:42.621000+0000","last_active":"2024-01-22T10:13:43.624437+0000","last_peered":"2024-01-22T10:13:43.624437+0000","last_clean":"2024-01-22T10:13:43.624437+0000","last_became_active":"2024-01-22T10:13:42.620624+0000","last_became_peered":"2024-01-22T10:13:42.620624+0000","last_unstale":"2024-01-22T10:13:43.624437+0000","last_undegraded":"2024-01-22T10:13:43.624437+0000","last_fullsized":"2024-01-22T10:13:43.624437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:13.693929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622855+0000","last_change":"2024-01-22T10:13:42.631519+0000","last_active":"2024-01-22T10:13:43.622855+0000","last_peered":"2024-01-22T10:13:43.622855+0000","last_clean":"2024-01-22T10:13:43.622855+0000","last_became_active":"2024-01-22T10:13:42.630812+0000","last_became_peered":"2024-01-22T10:13:42.630812+0000","last_unstale":"2024-01-22T10:13:43.622855+0000","last_undegraded":"2024-01-22T10:13:43.622855+0000","last_fullsized":"2024-01-22T10:13:43.622855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:30:17.081991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034519+0000","last_change":"2024-01-22T10:13:42.624797+0000","last_active":"2024-01-22T10:13:44.034519+0000","last_peered":"2024-01-22T10:13:44.034519+0000","last_clean":"2024-01-22T10:13:44.034519+0000","last_became_active":"2024-01-22T10:13:42.624529+0000","last_became_peered":"2024-01-22T10:13:42.624529+0000","last_unstale":"2024-01-22T10:13:44.034519+0000","last_undegraded":"2024-01-22T10:13:44.034519+0000","last_fullsized":"2024-01-22T10:13:44.034519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035160+0000","last_change":"2024-01-22T10:13:42.637426+0000","last_active":"2024-01-22T10:13:44.035160+0000","last_peered":"2024-01-22T10:13:44.035160+0000","last_clean":"2024-01-22T10:13:44.035160+0000","last_became_active":"2024-01-22T10:13:42.637077+0000","last_became_peered":"2024-01-22T10:13:42.637077+0000","last_unstale":"2024-01-22T10:13:44.035160+0000","last_undegraded":"2024-01-22T10:13:44.035160+0000","last_fullsized":"2024-01-22T10:13:44.035160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:21:10.389082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624648+0000","last_change":"2024-01-22T10:13:42.617414+0000","last_active":"2024-01-22T10:13:43.624648+0000","last_peered":"2024-01-22T10:13:43.624648+0000","last_clean":"2024-01-22T10:13:43.624648+0000","last_became_active":"2024-01-22T10:13:42.617110+0000","last_became_peered":"2024-01-22T10:13:42.617110+0000","last_unstale":"2024-01-22T10:13:43.624648+0000","last_undegraded":"2024-01-22T10:13:43.624648+0000","last_fullsized":"2024-01-22T10:13:43.624648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986570+0000","last_change":"2024-01-22T10:13:42.628627+0000","last_active":"2024-01-22T10:13:43.986570+0000","last_peered":"2024-01-22T10:13:43.986570+0000","last_clean":"2024-01-22T10:13:43.986570+0000","last_became_active":"2024-01-22T10:13:42.628259+0000","last_became_peered":"2024-01-22T10:13:42.628259+0000","last_unstale":"2024-01-22T10:13:43.986570+0000","last_undegraded":"2024-01-22T10:13:43.986570+0000","last_fullsized":"2024-01-22T10:13:43.986570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:49.014219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624513+0000","last_change":"2024-01-22T10:13:42.624473+0000","last_active":"2024-01-22T10:13:43.624513+0000","last_peered":"2024-01-22T10:13:43.624513+0000","last_clean":"2024-01-22T10:13:43.624513+0000","last_became_active":"2024-01-22T10:13:42.623675+0000","last_became_peered":"2024-01-22T10:13:42.623675+0000","last_unstale":"2024-01-22T10:13:43.624513+0000","last_undegraded":"2024-01-22T10:13:43.624513+0000","last_fullsized":"2024-01-22T10:13:43.624513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:00:42.245954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034197+0000","last_change":"2024-01-22T10:13:42.623919+0000","last_active":"2024-01-22T10:13:44.034197+0000","last_peered":"2024-01-22T10:13:44.034197+0000","last_clean":"2024-01-22T10:13:44.034197+0000","last_became_active":"2024-01-22T10:13:42.623680+0000","last_became_peered":"2024-01-22T10:13:42.623680+0000","last_unstale":"2024-01-22T10:13:44.034197+0000","last_undegraded":"2024-01-22T10:13:44.034197+0000","last_fullsized":"2024-01-22T10:13:44.034197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:09.341746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.638092+0000","last_change":"2024-01-22T10:13:41.601272+0000","last_active":"2024-01-22T10:13:42.638092+0000","last_peered":"2024-01-22T10:13:42.638092+0000","last_clean":"2024-01-22T10:13:42.638092+0000","last_became_active":"2024-01-22T10:13:41.600823+0000","last_became_peered":"2024-01-22T10:13:41.600823+0000","last_unstale":"2024-01-22T10:13:42.638092+0000","last_undegraded":"2024-01-22T10:13:42.638092+0000","last_fullsized":"2024-01-22T10:13:42.638092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:25.193353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986817+0000","last_change":"2024-01-22T10:13:42.628954+0000","last_active":"2024-01-22T10:13:43.986817+0000","last_peered":"2024-01-22T10:13:43.986817+0000","last_clean":"2024-01-22T10:13:43.986817+0000","last_became_active":"2024-01-22T10:13:42.626926+0000","last_became_peered":"2024-01-22T10:13:42.626926+0000","last_unstale":"2024-01-22T10:13:43.986817+0000","last_undegraded":"2024-01-22T10:13:43.986817+0000","last_fullsized":"2024-01-22T10:13:43.986817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.629143+0000","last_change":"2024-01-22T10:13:41.598256+0000","last_active":"2024-01-22T10:13:42.629143+0000","last_peered":"2024-01-22T10:13:42.629143+0000","last_clean":"2024-01-22T10:13:42.629143+0000","last_became_active":"2024-01-22T10:13:41.597853+0000","last_became_peered":"2024-01-22T10:13:41.597853+0000","last_unstale":"2024-01-22T10:13:42.629143+0000","last_undegraded":"2024-01-22T10:13:42.629143+0000","last_fullsized":"2024-01-22T10:13:42.629143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:49:40.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035276+0000","last_change":"2024-01-22T10:13:42.637399+0000","last_active":"2024-01-22T10:13:44.035276+0000","last_peered":"2024-01-22T10:13:44.035276+0000","last_clean":"2024-01-22T10:13:44.035276+0000","last_became_active":"2024-01-22T10:13:42.637040+0000","last_became_peered":"2024-01-22T10:13:42.637040+0000","last_unstale":"2024-01-22T10:13:44.035276+0000","last_undegraded":"2024-01-22T10:13:44.035276+0000","last_fullsized":"2024-01-22T10:13:44.035276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:24:30.281721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.636032+0000","last_change":"2024-01-22T10:13:41.594947+0000","last_active":"2024-01-22T10:13:42.636032+0000","last_peered":"2024-01-22T10:13:42.636032+0000","last_clean":"2024-01-22T10:13:42.636032+0000","last_became_active":"2024-01-22T10:13:41.594297+0000","last_became_peered":"2024-01-22T10:13:41.594297+0000","last_unstale":"2024-01-22T10:13:42.636032+0000","last_undegraded":"2024-01-22T10:13:42.636032+0000","last_fullsized":"2024-01-22T10:13:42.636032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:08.340015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622980+0000","last_change":"2024-01-22T10:13:42.631105+0000","last_active":"2024-01-22T10:13:43.622980+0000","last_peered":"2024-01-22T10:13:43.622980+0000","last_clean":"2024-01-22T10:13:43.622980+0000","last_became_active":"2024-01-22T10:13:42.630434+0000","last_became_peered":"2024-01-22T10:13:42.630434+0000","last_unstale":"2024-01-22T10:13:43.622980+0000","last_undegraded":"2024-01-22T10:13:43.622980+0000","last_fullsized":"2024-01-22T10:13:43.622980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:20.447342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635390+0000","last_change":"2024-01-22T10:13:41.595358+0000","last_active":"2024-01-22T10:13:42.635390+0000","last_peered":"2024-01-22T10:13:42.635390+0000","last_clean":"2024-01-22T10:13:42.635390+0000","last_became_active":"2024-01-22T10:13:41.595111+0000","last_became_peered":"2024-01-22T10:13:41.595111+0000","last_unstale":"2024-01-22T10:13:42.635390+0000","last_undegraded":"2024-01-22T10:13:42.635390+0000","last_fullsized":"2024-01-22T10:13:42.635390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:42:01.516366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624715+0000","last_change":"2024-01-22T10:13:42.623899+0000","last_active":"2024-01-22T10:13:43.624715+0000","last_peered":"2024-01-22T10:13:43.624715+0000","last_clean":"2024-01-22T10:13:43.624715+0000","last_became_active":"2024-01-22T10:13:42.623634+0000","last_became_peered":"2024-01-22T10:13:42.623634+0000","last_unstale":"2024-01-22T10:13:43.624715+0000","last_undegraded":"2024-01-22T10:13:43.624715+0000","last_fullsized":"2024-01-22T10:13:43.624715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640552+0000","last_change":"2024-01-22T10:13:41.598117+0000","last_active":"2024-01-22T10:13:42.640552+0000","last_peered":"2024-01-22T10:13:42.640552+0000","last_clean":"2024-01-22T10:13:42.640552+0000","last_became_active":"2024-01-22T10:13:41.597046+0000","last_became_peered":"2024-01-22T10:13:41.597046+0000","last_unstale":"2024-01-22T10:13:42.640552+0000","last_undegraded":"2024-01-22T10:13:42.640552+0000","last_fullsized":"2024-01-22T10:13:42.640552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:44.239736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034430+0000","last_change":"2024-01-22T10:13:42.624025+0000","last_active":"2024-01-22T10:13:44.034430+0000","last_peered":"2024-01-22T10:13:44.034430+0000","last_clean":"2024-01-22T10:13:44.034430+0000","last_became_active":"2024-01-22T10:13:42.623760+0000","last_became_peered":"2024-01-22T10:13:42.623760+0000","last_unstale":"2024-01-22T10:13:44.034430+0000","last_undegraded":"2024-01-22T10:13:44.034430+0000","last_fullsized":"2024-01-22T10:13:44.034430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637438+0000","last_change":"2024-01-22T10:13:41.597237+0000","last_active":"2024-01-22T10:13:42.637438+0000","last_peered":"2024-01-22T10:13:42.637438+0000","last_clean":"2024-01-22T10:13:42.637438+0000","last_became_active":"2024-01-22T10:13:41.596938+0000","last_became_peered":"2024-01-22T10:13:41.596938+0000","last_unstale":"2024-01-22T10:13:42.637438+0000","last_undegraded":"2024-01-22T10:13:42.637438+0000","last_fullsized":"2024-01-22T10:13:42.637438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:25.193353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034876+0000","last_change":"2024-01-22T10:13:42.622658+0000","last_active":"2024-01-22T10:13:44.034876+0000","last_peered":"2024-01-22T10:13:44.034876+0000","last_clean":"2024-01-22T10:13:44.034876+0000","last_became_active":"2024-01-22T10:13:42.622398+0000","last_became_peered":"2024-01-22T10:13:42.622398+0000","last_unstale":"2024-01-22T10:13:44.034876+0000","last_undegraded":"2024-01-22T10:13:44.034876+0000","last_fullsized":"2024-01-22T10:13:44.034876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.610874+0000","last_change":"2024-01-22T10:13:41.593515+0000","last_active":"2024-01-22T10:13:42.610874+0000","last_peered":"2024-01-22T10:13:42.610874+0000","last_clean":"2024-01-22T10:13:42.610874+0000","last_became_active":"2024-01-22T10:13:41.593248+0000","last_became_peered":"2024-01-22T10:13:41.593248+0000","last_unstale":"2024-01-22T10:13:42.610874+0000","last_undegraded":"2024-01-22T10:13:42.610874+0000","last_fullsized":"2024-01-22T10:13:42.610874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:48.475424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622556+0000","last_change":"2024-01-22T10:13:42.630318+0000","last_active":"2024-01-22T10:13:43.622556+0000","last_peered":"2024-01-22T10:13:43.622556+0000","last_clean":"2024-01-22T10:13:43.622556+0000","last_became_active":"2024-01-22T10:13:42.623690+0000","last_became_peered":"2024-01-22T10:13:42.623690+0000","last_unstale":"2024-01-22T10:13:43.622556+0000","last_undegraded":"2024-01-22T10:13:43.622556+0000","last_fullsized":"2024-01-22T10:13:43.622556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:33:09.287996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621953+0000","last_change":"2024-01-22T10:13:41.601278+0000","last_active":"2024-01-22T10:13:42.621953+0000","last_peered":"2024-01-22T10:13:42.621953+0000","last_clean":"2024-01-22T10:13:42.621953+0000","last_became_active":"2024-01-22T10:13:41.601016+0000","last_became_peered":"2024-01-22T10:13:41.601016+0000","last_unstale":"2024-01-22T10:13:42.621953+0000","last_undegraded":"2024-01-22T10:13:42.621953+0000","last_fullsized":"2024-01-22T10:13:42.621953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:44:18.938485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034523+0000","last_change":"2024-01-22T10:13:42.633673+0000","last_active":"2024-01-22T10:13:44.034523+0000","last_peered":"2024-01-22T10:13:44.034523+0000","last_clean":"2024-01-22T10:13:44.034523+0000","last_became_active":"2024-01-22T10:13:42.633419+0000","last_became_peered":"2024-01-22T10:13:42.633419+0000","last_unstale":"2024-01-22T10:13:44.034523+0000","last_undegraded":"2024-01-22T10:13:44.034523+0000","last_fullsized":"2024-01-22T10:13:44.034523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.609891+0000","last_change":"2024-01-22T10:13:41.599944+0000","last_active":"2024-01-22T10:13:42.609891+0000","last_peered":"2024-01-22T10:13:42.609891+0000","last_clean":"2024-01-22T10:13:42.609891+0000","last_became_active":"2024-01-22T10:13:41.599658+0000","last_became_peered":"2024-01-22T10:13:41.599658+0000","last_unstale":"2024-01-22T10:13:42.609891+0000","last_undegraded":"2024-01-22T10:13:42.609891+0000","last_fullsized":"2024-01-22T10:13:42.609891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:48.012488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624289+0000","last_change":"2024-01-22T10:13:42.624509+0000","last_active":"2024-01-22T10:13:43.624289+0000","last_peered":"2024-01-22T10:13:43.624289+0000","last_clean":"2024-01-22T10:13:43.624289+0000","last_became_active":"2024-01-22T10:13:42.624258+0000","last_became_peered":"2024-01-22T10:13:42.624258+0000","last_unstale":"2024-01-22T10:13:43.624289+0000","last_undegraded":"2024-01-22T10:13:43.624289+0000","last_fullsized":"2024-01-22T10:13:43.624289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614510+0000","last_change":"2024-01-22T10:13:41.603096+0000","last_active":"2024-01-22T10:13:42.614510+0000","last_peered":"2024-01-22T10:13:42.614510+0000","last_clean":"2024-01-22T10:13:42.614510+0000","last_became_active":"2024-01-22T10:13:41.602525+0000","last_became_peered":"2024-01-22T10:13:41.602525+0000","last_unstale":"2024-01-22T10:13:42.614510+0000","last_undegraded":"2024-01-22T10:13:42.614510+0000","last_fullsized":"2024-01-22T10:13:42.614510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624219+0000","last_change":"2024-01-22T10:13:42.615910+0000","last_active":"2024-01-22T10:13:43.624219+0000","last_peered":"2024-01-22T10:13:43.624219+0000","last_clean":"2024-01-22T10:13:43.624219+0000","last_became_active":"2024-01-22T10:13:42.615658+0000","last_became_peered":"2024-01-22T10:13:42.615658+0000","last_unstale":"2024-01-22T10:13:43.624219+0000","last_undegraded":"2024-01-22T10:13:43.624219+0000","last_fullsized":"2024-01-22T10:13:43.624219+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.632230+0000","last_change":"2024-01-22T10:13:41.599287+0000","last_active":"2024-01-22T10:13:42.632230+0000","last_peered":"2024-01-22T10:13:42.632230+0000","last_clean":"2024-01-22T10:13:42.632230+0000","last_became_active":"2024-01-22T10:13:41.598984+0000","last_became_peered":"2024-01-22T10:13:41.598984+0000","last_unstale":"2024-01-22T10:13:42.632230+0000","last_undegraded":"2024-01-22T10:13:42.632230+0000","last_fullsized":"2024-01-22T10:13:42.632230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:48.012488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034398+0000","last_change":"2024-01-22T10:13:42.627844+0000","last_active":"2024-01-22T10:13:44.034398+0000","last_peered":"2024-01-22T10:13:44.034398+0000","last_clean":"2024-01-22T10:13:44.034398+0000","last_became_active":"2024-01-22T10:13:42.626619+0000","last_became_peered":"2024-01-22T10:13:42.626619+0000","last_unstale":"2024-01-22T10:13:44.034398+0000","last_undegraded":"2024-01-22T10:13:44.034398+0000","last_fullsized":"2024-01-22T10:13:44.034398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:00:42.245954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:49.232274+0000","last_change":"2024-01-22T10:13:41.596903+0000","last_active":"2024-01-22T10:13:49.232274+0000","last_peered":"2024-01-22T10:13:49.232274+0000","last_clean":"2024-01-22T10:13:49.232274+0000","last_became_active":"2024-01-22T10:13:41.596658+0000","last_became_peered":"2024-01-22T10:13:41.596658+0000","last_unstale":"2024-01-22T10:13:49.232274+0000","last_undegraded":"2024-01-22T10:13:49.232274+0000","last_fullsized":"2024-01-22T10:13:49.232274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T22:02:40.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2853,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622560+0000","last_change":"2024-01-22T10:13:42.627496+0000","last_active":"2024-01-22T10:13:43.622560+0000","last_peered":"2024-01-22T10:13:43.622560+0000","last_clean":"2024-01-22T10:13:43.622560+0000","last_became_active":"2024-01-22T10:13:42.627194+0000","last_became_peered":"2024-01-22T10:13:42.627194+0000","last_unstale":"2024-01-22T10:13:43.622560+0000","last_undegraded":"2024-01-22T10:13:43.622560+0000","last_fullsized":"2024-01-22T10:13:43.622560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:24:30.281721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640785+0000","last_change":"2024-01-22T10:13:41.602468+0000","last_active":"2024-01-22T10:13:42.640785+0000","last_peered":"2024-01-22T10:13:42.640785+0000","last_clean":"2024-01-22T10:13:42.640785+0000","last_became_active":"2024-01-22T10:13:41.602166+0000","last_became_peered":"2024-01-22T10:13:41.602166+0000","last_unstale":"2024-01-22T10:13:42.640785+0000","last_undegraded":"2024-01-22T10:13:42.640785+0000","last_fullsized":"2024-01-22T10:13:42.640785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:47.541129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624319+0000","last_change":"2024-01-22T10:13:42.624284+0000","last_active":"2024-01-22T10:13:43.624319+0000","last_peered":"2024-01-22T10:13:43.624319+0000","last_clean":"2024-01-22T10:13:43.624319+0000","last_became_active":"2024-01-22T10:13:42.623996+0000","last_became_peered":"2024-01-22T10:13:42.623996+0000","last_unstale":"2024-01-22T10:13:43.624319+0000","last_undegraded":"2024-01-22T10:13:43.624319+0000","last_fullsized":"2024-01-22T10:13:43.624319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:55.572047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.611919+0000","last_change":"2024-01-22T10:13:41.596625+0000","last_active":"2024-01-22T10:13:42.611919+0000","last_peered":"2024-01-22T10:13:42.611919+0000","last_clean":"2024-01-22T10:13:42.611919+0000","last_became_active":"2024-01-22T10:13:41.596376+0000","last_became_peered":"2024-01-22T10:13:41.596376+0000","last_unstale":"2024-01-22T10:13:42.611919+0000","last_undegraded":"2024-01-22T10:13:42.611919+0000","last_fullsized":"2024-01-22T10:13:42.611919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:49:40.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624720+0000","last_change":"2024-01-22T10:13:42.624678+0000","last_active":"2024-01-22T10:13:43.624720+0000","last_peered":"2024-01-22T10:13:43.624720+0000","last_clean":"2024-01-22T10:13:43.624720+0000","last_became_active":"2024-01-22T10:13:42.624005+0000","last_became_peered":"2024-01-22T10:13:42.624005+0000","last_unstale":"2024-01-22T10:13:43.624720+0000","last_undegraded":"2024-01-22T10:13:43.624720+0000","last_fullsized":"2024-01-22T10:13:43.624720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.611000+0000","last_change":"2024-01-22T10:13:41.597383+0000","last_active":"2024-01-22T10:13:42.611000+0000","last_peered":"2024-01-22T10:13:42.611000+0000","last_clean":"2024-01-22T10:13:42.611000+0000","last_became_active":"2024-01-22T10:13:41.597155+0000","last_became_peered":"2024-01-22T10:13:41.597155+0000","last_unstale":"2024-01-22T10:13:42.611000+0000","last_undegraded":"2024-01-22T10:13:42.611000+0000","last_fullsized":"2024-01-22T10:13:42.611000+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:32.767529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986697+0000","last_change":"2024-01-22T10:13:42.625547+0000","last_active":"2024-01-22T10:13:43.986697+0000","last_peered":"2024-01-22T10:13:43.986697+0000","last_clean":"2024-01-22T10:13:43.986697+0000","last_became_active":"2024-01-22T10:13:42.625291+0000","last_became_peered":"2024-01-22T10:13:42.625291+0000","last_unstale":"2024-01-22T10:13:43.986697+0000","last_undegraded":"2024-01-22T10:13:43.986697+0000","last_fullsized":"2024-01-22T10:13:43.986697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:23:18.919792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635796+0000","last_change":"2024-01-22T10:13:41.595957+0000","last_active":"2024-01-22T10:13:42.635796+0000","last_peered":"2024-01-22T10:13:42.635796+0000","last_clean":"2024-01-22T10:13:42.635796+0000","last_became_active":"2024-01-22T10:13:41.594410+0000","last_became_peered":"2024-01-22T10:13:41.594410+0000","last_unstale":"2024-01-22T10:13:42.635796+0000","last_undegraded":"2024-01-22T10:13:42.635796+0000","last_fullsized":"2024-01-22T10:13:42.635796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:22:33.851960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035330+0000","last_change":"2024-01-22T10:13:42.633175+0000","last_active":"2024-01-22T10:13:44.035330+0000","last_peered":"2024-01-22T10:13:44.035330+0000","last_clean":"2024-01-22T10:13:44.035330+0000","last_became_active":"2024-01-22T10:13:42.632877+0000","last_became_peered":"2024-01-22T10:13:42.632877+0000","last_unstale":"2024-01-22T10:13:44.035330+0000","last_undegraded":"2024-01-22T10:13:44.035330+0000","last_fullsized":"2024-01-22T10:13:44.035330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:00:21.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637591+0000","last_change":"2024-01-22T10:13:41.595203+0000","last_active":"2024-01-22T10:13:42.637591+0000","last_peered":"2024-01-22T10:13:42.637591+0000","last_clean":"2024-01-22T10:13:42.637591+0000","last_became_active":"2024-01-22T10:13:41.594555+0000","last_became_peered":"2024-01-22T10:13:41.594555+0000","last_unstale":"2024-01-22T10:13:42.637591+0000","last_undegraded":"2024-01-22T10:13:42.637591+0000","last_fullsized":"2024-01-22T10:13:42.637591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034639+0000","last_change":"2024-01-22T10:13:42.630113+0000","last_active":"2024-01-22T10:13:44.034639+0000","last_peered":"2024-01-22T10:13:44.034639+0000","last_clean":"2024-01-22T10:13:44.034639+0000","last_became_active":"2024-01-22T10:13:42.629837+0000","last_became_peered":"2024-01-22T10:13:42.629837+0000","last_unstale":"2024-01-22T10:13:44.034639+0000","last_undegraded":"2024-01-22T10:13:44.034639+0000","last_fullsized":"2024-01-22T10:13:44.034639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635198+0000","last_change":"2024-01-22T10:13:41.602980+0000","last_active":"2024-01-22T10:13:42.635198+0000","last_peered":"2024-01-22T10:13:42.635198+0000","last_clean":"2024-01-22T10:13:42.635198+0000","last_became_active":"2024-01-22T10:13:41.602710+0000","last_became_peered":"2024-01-22T10:13:41.602710+0000","last_unstale":"2024-01-22T10:13:42.635198+0000","last_undegraded":"2024-01-22T10:13:42.635198+0000","last_fullsized":"2024-01-22T10:13:42.635198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622803+0000","last_change":"2024-01-22T10:13:42.629784+0000","last_active":"2024-01-22T10:13:43.622803+0000","last_peered":"2024-01-22T10:13:43.622803+0000","last_clean":"2024-01-22T10:13:43.622803+0000","last_became_active":"2024-01-22T10:13:42.629488+0000","last_became_peered":"2024-01-22T10:13:42.629488+0000","last_unstale":"2024-01-22T10:13:43.622803+0000","last_undegraded":"2024-01-22T10:13:43.622803+0000","last_fullsized":"2024-01-22T10:13:43.622803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:19:17.630353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637429+0000","last_change":"2024-01-22T10:13:41.599558+0000","last_active":"2024-01-22T10:13:42.637429+0000","last_peered":"2024-01-22T10:13:42.637429+0000","last_clean":"2024-01-22T10:13:42.637429+0000","last_became_active":"2024-01-22T10:13:41.599228+0000","last_became_peered":"2024-01-22T10:13:41.599228+0000","last_unstale":"2024-01-22T10:13:42.637429+0000","last_undegraded":"2024-01-22T10:13:42.637429+0000","last_fullsized":"2024-01-22T10:13:42.637429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034332+0000","last_change":"2024-01-22T10:13:42.626089+0000","last_active":"2024-01-22T10:13:44.034332+0000","last_peered":"2024-01-22T10:13:44.034332+0000","last_clean":"2024-01-22T10:13:44.034332+0000","last_became_active":"2024-01-22T10:13:42.625809+0000","last_became_peered":"2024-01-22T10:13:42.625809+0000","last_unstale":"2024-01-22T10:13:44.034332+0000","last_undegraded":"2024-01-22T10:13:44.034332+0000","last_fullsized":"2024-01-22T10:13:44.034332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:55.872670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.622441+0000","last_change":"2024-01-22T10:13:41.597556+0000","last_active":"2024-01-22T10:13:42.622441+0000","last_peered":"2024-01-22T10:13:42.622441+0000","last_clean":"2024-01-22T10:13:42.622441+0000","last_became_active":"2024-01-22T10:13:41.597157+0000","last_became_peered":"2024-01-22T10:13:41.597157+0000","last_unstale":"2024-01-22T10:13:42.622441+0000","last_undegraded":"2024-01-22T10:13:42.622441+0000","last_fullsized":"2024-01-22T10:13:42.622441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:54.870939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034040+0000","last_change":"2024-01-22T10:13:42.630577+0000","last_active":"2024-01-22T10:13:44.034040+0000","last_peered":"2024-01-22T10:13:44.034040+0000","last_clean":"2024-01-22T10:13:44.034040+0000","last_became_active":"2024-01-22T10:13:42.630345+0000","last_became_peered":"2024-01-22T10:13:42.630345+0000","last_unstale":"2024-01-22T10:13:44.034040+0000","last_undegraded":"2024-01-22T10:13:44.034040+0000","last_fullsized":"2024-01-22T10:13:44.034040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:33:00.953623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.633167+0000","last_change":"2024-01-22T10:13:41.603385+0000","last_active":"2024-01-22T10:13:42.633167+0000","last_peered":"2024-01-22T10:13:42.633167+0000","last_clean":"2024-01-22T10:13:42.633167+0000","last_became_active":"2024-01-22T10:13:41.603096+0000","last_became_peered":"2024-01-22T10:13:41.603096+0000","last_unstale":"2024-01-22T10:13:42.633167+0000","last_undegraded":"2024-01-22T10:13:42.633167+0000","last_fullsized":"2024-01-22T10:13:42.633167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:52:13.557327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034134+0000","last_change":"2024-01-22T10:13:42.625780+0000","last_active":"2024-01-22T10:13:44.034134+0000","last_peered":"2024-01-22T10:13:44.034134+0000","last_clean":"2024-01-22T10:13:44.034134+0000","last_became_active":"2024-01-22T10:13:42.625524+0000","last_became_peered":"2024-01-22T10:13:42.625524+0000","last_unstale":"2024-01-22T10:13:44.034134+0000","last_undegraded":"2024-01-22T10:13:44.034134+0000","last_fullsized":"2024-01-22T10:13:44.034134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:45.241467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614787+0000","last_change":"2024-01-22T10:13:41.600994+0000","last_active":"2024-01-22T10:13:42.614787+0000","last_peered":"2024-01-22T10:13:42.614787+0000","last_clean":"2024-01-22T10:13:42.614787+0000","last_became_active":"2024-01-22T10:13:41.600704+0000","last_became_peered":"2024-01-22T10:13:41.600704+0000","last_unstale":"2024-01-22T10:13:42.614787+0000","last_undegraded":"2024-01-22T10:13:42.614787+0000","last_fullsized":"2024-01-22T10:13:42.614787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:54.870939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033907+0000","last_change":"2024-01-22T10:13:42.622896+0000","last_active":"2024-01-22T10:13:44.033907+0000","last_peered":"2024-01-22T10:13:44.033907+0000","last_clean":"2024-01-22T10:13:44.033907+0000","last_became_active":"2024-01-22T10:13:42.622631+0000","last_became_peered":"2024-01-22T10:13:42.622631+0000","last_unstale":"2024-01-22T10:13:44.033907+0000","last_undegraded":"2024-01-22T10:13:44.033907+0000","last_fullsized":"2024-01-22T10:13:44.033907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:43:02.897571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621795+0000","last_change":"2024-01-22T10:13:41.597586+0000","last_active":"2024-01-22T10:13:42.621795+0000","last_peered":"2024-01-22T10:13:42.621795+0000","last_clean":"2024-01-22T10:13:42.621795+0000","last_became_active":"2024-01-22T10:13:41.597324+0000","last_became_peered":"2024-01-22T10:13:41.597324+0000","last_unstale":"2024-01-22T10:13:42.621795+0000","last_undegraded":"2024-01-22T10:13:42.621795+0000","last_fullsized":"2024-01-22T10:13:42.621795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:43:01.895840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624510+0000","last_change":"2024-01-22T10:13:42.617670+0000","last_active":"2024-01-22T10:13:43.624510+0000","last_peered":"2024-01-22T10:13:43.624510+0000","last_clean":"2024-01-22T10:13:43.624510+0000","last_became_active":"2024-01-22T10:13:42.616992+0000","last_became_peered":"2024-01-22T10:13:42.616992+0000","last_unstale":"2024-01-22T10:13:43.624510+0000","last_undegraded":"2024-01-22T10:13:43.624510+0000","last_fullsized":"2024-01-22T10:13:43.624510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614491+0000","last_change":"2024-01-22T10:13:41.599431+0000","last_active":"2024-01-22T10:13:42.614491+0000","last_peered":"2024-01-22T10:13:42.614491+0000","last_clean":"2024-01-22T10:13:42.614491+0000","last_became_active":"2024-01-22T10:13:41.599008+0000","last_became_peered":"2024-01-22T10:13:41.599008+0000","last_unstale":"2024-01-22T10:13:42.614491+0000","last_undegraded":"2024-01-22T10:13:42.614491+0000","last_fullsized":"2024-01-22T10:13:42.614491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T22:02:40.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034455+0000","last_change":"2024-01-22T10:13:42.626317+0000","last_active":"2024-01-22T10:13:44.034455+0000","last_peered":"2024-01-22T10:13:44.034455+0000","last_clean":"2024-01-22T10:13:44.034455+0000","last_became_active":"2024-01-22T10:13:42.626088+0000","last_became_peered":"2024-01-22T10:13:42.626088+0000","last_unstale":"2024-01-22T10:13:44.034455+0000","last_undegraded":"2024-01-22T10:13:44.034455+0000","last_fullsized":"2024-01-22T10:13:44.034455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:39:36.530327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640956+0000","last_change":"2024-01-22T10:13:41.597369+0000","last_active":"2024-01-22T10:13:42.640956+0000","last_peered":"2024-01-22T10:13:42.640956+0000","last_clean":"2024-01-22T10:13:42.640956+0000","last_became_active":"2024-01-22T10:13:41.597126+0000","last_became_peered":"2024-01-22T10:13:41.597126+0000","last_unstale":"2024-01-22T10:13:42.640956+0000","last_undegraded":"2024-01-22T10:13:42.640956+0000","last_fullsized":"2024-01-22T10:13:42.640956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034664+0000","last_change":"2024-01-22T10:13:42.624684+0000","last_active":"2024-01-22T10:13:44.034664+0000","last_peered":"2024-01-22T10:13:44.034664+0000","last_clean":"2024-01-22T10:13:44.034664+0000","last_became_active":"2024-01-22T10:13:42.624431+0000","last_became_peered":"2024-01-22T10:13:42.624431+0000","last_unstale":"2024-01-22T10:13:44.034664+0000","last_undegraded":"2024-01-22T10:13:44.034664+0000","last_fullsized":"2024-01-22T10:13:44.034664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.612790+0000","last_change":"2024-01-22T10:13:41.603337+0000","last_active":"2024-01-22T10:13:43.612790+0000","last_peered":"2024-01-22T10:13:43.612790+0000","last_clean":"2024-01-22T10:13:43.612790+0000","last_became_active":"2024-01-22T10:13:41.602818+0000","last_became_peered":"2024-01-22T10:13:41.602818+0000","last_unstale":"2024-01-22T10:13:43.612790+0000","last_undegraded":"2024-01-22T10:13:43.612790+0000","last_fullsized":"2024-01-22T10:13:43.612790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033982+0000","last_change":"2024-01-22T10:13:42.626012+0000","last_active":"2024-01-22T10:13:44.033982+0000","last_peered":"2024-01-22T10:13:44.033982+0000","last_clean":"2024-01-22T10:13:44.033982+0000","last_became_active":"2024-01-22T10:13:42.625759+0000","last_became_peered":"2024-01-22T10:13:42.625759+0000","last_unstale":"2024-01-22T10:13:44.033982+0000","last_undegraded":"2024-01-22T10:13:44.033982+0000","last_fullsized":"2024-01-22T10:13:44.033982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.613216+0000","last_change":"2024-01-22T10:13:41.593779+0000","last_active":"2024-01-22T10:13:42.613216+0000","last_peered":"2024-01-22T10:13:42.613216+0000","last_clean":"2024-01-22T10:13:42.613216+0000","last_became_active":"2024-01-22T10:13:41.593469+0000","last_became_peered":"2024-01-22T10:13:41.593469+0000","last_unstale":"2024-01-22T10:13:42.613216+0000","last_undegraded":"2024-01-22T10:13:42.613216+0000","last_fullsized":"2024-01-22T10:13:42.613216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:52:13.557327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986594+0000","last_change":"2024-01-22T10:13:42.622705+0000","last_active":"2024-01-22T10:13:43.986594+0000","last_peered":"2024-01-22T10:13:43.986594+0000","last_clean":"2024-01-22T10:13:43.986594+0000","last_became_active":"2024-01-22T10:13:42.622464+0000","last_became_peered":"2024-01-22T10:13:42.622464+0000","last_unstale":"2024-01-22T10:13:43.986594+0000","last_undegraded":"2024-01-22T10:13:43.986594+0000","last_fullsized":"2024-01-22T10:13:43.986594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:22:34.853691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614866+0000","last_change":"2024-01-22T10:13:41.601304+0000","last_active":"2024-01-22T10:13:42.614866+0000","last_peered":"2024-01-22T10:13:42.614866+0000","last_clean":"2024-01-22T10:13:42.614866+0000","last_became_active":"2024-01-22T10:13:41.601010+0000","last_became_peered":"2024-01-22T10:13:41.601010+0000","last_unstale":"2024-01-22T10:13:42.614866+0000","last_undegraded":"2024-01-22T10:13:42.614866+0000","last_fullsized":"2024-01-22T10:13:42.614866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:33:12.832661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034206+0000","last_change":"2024-01-22T10:13:42.623113+0000","last_active":"2024-01-22T10:13:44.034206+0000","last_peered":"2024-01-22T10:13:44.034206+0000","last_clean":"2024-01-22T10:13:44.034206+0000","last_became_active":"2024-01-22T10:13:42.622855+0000","last_became_peered":"2024-01-22T10:13:42.622855+0000","last_unstale":"2024-01-22T10:13:44.034206+0000","last_undegraded":"2024-01-22T10:13:44.034206+0000","last_fullsized":"2024-01-22T10:13:44.034206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:21:10.389082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.612039+0000","last_change":"2024-01-22T10:13:41.597546+0000","last_active":"2024-01-22T10:13:42.612039+0000","last_peered":"2024-01-22T10:13:42.612039+0000","last_clean":"2024-01-22T10:13:42.612039+0000","last_became_active":"2024-01-22T10:13:41.597270+0000","last_became_peered":"2024-01-22T10:13:41.597270+0000","last_unstale":"2024-01-22T10:13:42.612039+0000","last_undegraded":"2024-01-22T10:13:42.612039+0000","last_fullsized":"2024-01-22T10:13:42.612039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:33:12.832661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624046+0000","last_change":"2024-01-22T10:13:42.623605+0000","last_active":"2024-01-22T10:13:43.624046+0000","last_peered":"2024-01-22T10:13:43.624046+0000","last_clean":"2024-01-22T10:13:43.624046+0000","last_became_active":"2024-01-22T10:13:42.623331+0000","last_became_peered":"2024-01-22T10:13:42.623331+0000","last_unstale":"2024-01-22T10:13:43.624046+0000","last_undegraded":"2024-01-22T10:13:43.624046+0000","last_fullsized":"2024-01-22T10:13:43.624046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621970+0000","last_change":"2024-01-22T10:13:41.596973+0000","last_active":"2024-01-22T10:13:42.621970+0000","last_peered":"2024-01-22T10:13:42.621970+0000","last_clean":"2024-01-22T10:13:42.621970+0000","last_became_active":"2024-01-22T10:13:41.596639+0000","last_became_peered":"2024-01-22T10:13:41.596639+0000","last_unstale":"2024-01-22T10:13:42.621970+0000","last_undegraded":"2024-01-22T10:13:42.621970+0000","last_fullsized":"2024-01-22T10:13:42.621970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:32:59.951892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034916+0000","last_change":"2024-01-22T10:13:42.637594+0000","last_active":"2024-01-22T10:13:44.034916+0000","last_peered":"2024-01-22T10:13:44.034916+0000","last_clean":"2024-01-22T10:13:44.034916+0000","last_became_active":"2024-01-22T10:13:42.637152+0000","last_became_peered":"2024-01-22T10:13:42.637152+0000","last_unstale":"2024-01-22T10:13:44.034916+0000","last_undegraded":"2024-01-22T10:13:44.034916+0000","last_fullsized":"2024-01-22T10:13:44.034916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.610626+0000","last_change":"2024-01-22T10:13:41.600670+0000","last_active":"2024-01-22T10:13:42.610626+0000","last_peered":"2024-01-22T10:13:42.610626+0000","last_clean":"2024-01-22T10:13:42.610626+0000","last_became_active":"2024-01-22T10:13:41.600181+0000","last_became_peered":"2024-01-22T10:13:41.600181+0000","last_unstale":"2024-01-22T10:13:42.610626+0000","last_undegraded":"2024-01-22T10:13:42.610626+0000","last_fullsized":"2024-01-22T10:13:42.610626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:23:17.918061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624601+0000","last_change":"2024-01-22T10:13:42.626739+0000","last_active":"2024-01-22T10:13:43.624601+0000","last_peered":"2024-01-22T10:13:43.624601+0000","last_clean":"2024-01-22T10:13:43.624601+0000","last_became_active":"2024-01-22T10:13:42.626445+0000","last_became_peered":"2024-01-22T10:13:42.626445+0000","last_unstale":"2024-01-22T10:13:43.624601+0000","last_undegraded":"2024-01-22T10:13:43.624601+0000","last_fullsized":"2024-01-22T10:13:43.624601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.613827+0000","last_change":"2024-01-22T10:13:41.600294+0000","last_active":"2024-01-22T10:13:42.613827+0000","last_peered":"2024-01-22T10:13:42.613827+0000","last_clean":"2024-01-22T10:13:42.613827+0000","last_became_active":"2024-01-22T10:13:41.599985+0000","last_became_peered":"2024-01-22T10:13:41.599985+0000","last_unstale":"2024-01-22T10:13:42.613827+0000","last_undegraded":"2024-01-22T10:13:42.613827+0000","last_fullsized":"2024-01-22T10:13:42.613827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:47.541129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.609823+0000","last_change":"2024-01-22T10:12:52.033359+0000","last_active":"2024-01-22T10:13:42.609823+0000","last_peered":"2024-01-22T10:13:42.609823+0000","last_clean":"2024-01-22T10:13:42.609823+0000","last_became_active":"2024-01-22T10:12:52.033101+0000","last_became_peered":"2024-01-22T10:12:52.033101+0000","last_unstale":"2024-01-22T10:13:42.609823+0000","last_undegraded":"2024-01-22T10:13:42.609823+0000","last_fullsized":"2024-01-22T10:13:42.609823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_clean_scrub_stamp":"2024-01-22T10:12:51.022957+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:45:37.023233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3651,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":719503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.61699999999999999}]},{"osd":1,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.497},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.66300000000000003}]},{"osd":2,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.441},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.46500000000000002}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59799999999999998}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.40500000000000003}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.371}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":130933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":129115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":130933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":719413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T10:13:55.781 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-22T10:13:55.781 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T10:13:55.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.932+0000 7fcee2a23640 1 Processor -- start 2024-01-22T10:13:55.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.933+0000 7fcee2a23640 1 -- start start 2024-01-22T10:13:55.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.933+0000 7fcee2a23640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcedc0b45d0 0x7fcedc06aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.933+0000 7fcee2a23640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc0bb830 con 0x7fcedc14bb60 2024-01-22T10:13:55.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.933+0000 7fcee2a23640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc0bba80 con 0x7fcedc149180 2024-01-22T10:13:55.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.933+0000 7fcee2a23640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc0bbd60 con 0x7fcedc0b45d0 2024-01-22T10:13:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.933+0000 7fcee0fc0640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcedc14bb60 0x7fcedc14bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46622/0 (socket says 172.21.15.88:46622) 2024-01-22T10:13:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.933+0000 7fcee0fc0640 1 -- 172.21.15.88:0/190861335 learned_addr learned my addr 172.21.15.88:0/190861335 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.933+0000 7fcedb7fe640 1 --2- 172.21.15.88:0/190861335 >> v2:172.21.15.119:3300/0 conn(0x7fcedc0b45d0 0x7fcedc06aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.934+0000 7fcedaffd640 1 -- 172.21.15.88:0/190861335 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010059032 0 0) 0x7fcedc0bb830 con 0x7fcedc14bb60 2024-01-22T10:13:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.934+0000 7fcedaffd640 1 -- 172.21.15.88:0/190861335 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec4003520 con 0x7fcedc14bb60 2024-01-22T10:13:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.934+0000 7fcedaffd640 1 -- 172.21.15.88:0/190861335 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463471557 0 0) 0x7fcedc0bba80 con 0x7fcedc149180 2024-01-22T10:13:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.934+0000 7fcedaffd640 1 -- 172.21.15.88:0/190861335 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcedc0bb830 con 0x7fcedc149180 2024-01-22T10:13:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.934+0000 7fcedb7fe640 1 -- 172.21.15.88:0/190861335 >> v1:172.21.15.119:6789/0 conn(0x7fcedc149180 legacy=0x7fcedc0bc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.934+0000 7fcedb7fe640 1 -- 172.21.15.88:0/190861335 >> v1:172.21.15.88:6789/0 conn(0x7fcedc14bb60 legacy=0x7fcedc14bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.934+0000 7fcedb7fe640 1 -- 172.21.15.88:0/190861335 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc0bc0d0 con 0x7fcedc0b45d0 2024-01-22T10:13:55.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.935+0000 7fcedb7fe640 1 --2- 172.21.15.88:0/190861335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcedc0b45d0 0x7fcedc06aa30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0097a0 tx=0x7fcecc02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a54fb56512dfd4f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:55.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.935+0000 7fcedaffd640 1 -- 172.21.15.88:0/190861335 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc02e070 con 0x7fcedc0b45d0 2024-01-22T10:13:55.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.935+0000 7fcedaffd640 1 -- 172.21.15.88:0/190861335 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc0315a0 con 0x7fcedc0b45d0 2024-01-22T10:13:55.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.935+0000 7fcedaffd640 1 -- 172.21.15.88:0/190861335 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc031930 con 0x7fcedc0b45d0 2024-01-22T10:13:55.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.935+0000 7fcee2a23640 1 -- 172.21.15.88:0/190861335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcedc0b45d0 msgr2=0x7fcedc06aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.935+0000 7fcee2a23640 1 --2- 172.21.15.88:0/190861335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcedc0b45d0 0x7fcedc06aa30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0097a0 tx=0x7fcecc02b840 comp rx=0 tx=0).stop 2024-01-22T10:13:55.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.936+0000 7fcee2a23640 1 -- 172.21.15.88:0/190861335 shutdown_connections 2024-01-22T10:13:55.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.936+0000 7fcee2a23640 1 --2- 172.21.15.88:0/190861335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcedc0b45d0 0x7fcedc06aa30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.936+0000 7fcee2a23640 1 -- 172.21.15.88:0/190861335 >> 172.21.15.88:0/190861335 conn(0x7fcedc0c0eb0 msgr2=0x7fcedc0c1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:55.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.936+0000 7fcee2a23640 1 -- 172.21.15.88:0/190861335 shutdown_connections 2024-01-22T10:13:55.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.936+0000 7fcee2a23640 1 -- 172.21.15.88:0/190861335 wait complete. 2024-01-22T10:13:55.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.937+0000 7fcee2a23640 1 Processor -- start 2024-01-22T10:13:55.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.937+0000 7fcee2a23640 1 -- start start 2024-01-22T10:13:55.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.937+0000 7fcee2a23640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcedc0b45d0 0x7fcedc13ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.937+0000 7fcee2a23640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcedc149180 0x7fcedc1e4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.937+0000 7fcee2a23640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcedc14bb60 0x7fcedc1e5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.937+0000 7fcee2a23640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc13d200 con 0x7fcedc0b45d0 2024-01-22T10:13:55.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.937+0000 7fcee2a23640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc13f2f0 con 0x7fcedc14bb60 2024-01-22T10:13:55.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.937+0000 7fcee2a23640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc1e4950 con 0x7fcedc149180 2024-01-22T10:13:55.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.937+0000 7fcedbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcedc0b45d0 0x7fcedc13ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.937+0000 7fcedbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcedc0b45d0 0x7fcedc13ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45584/0 (socket says 172.21.15.88:45584) 2024-01-22T10:13:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.937+0000 7fcedbfff640 1 -- 172.21.15.88:0/3804576208 learned_addr learned my addr 172.21.15.88:0/3804576208 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.938+0000 7fcedbfff640 1 -- 172.21.15.88:0/3804576208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcedc149180 msgr2=0x7fcedc1e4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.938+0000 7fcee0fc0640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcedc14bb60 0x7fcedc1e5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.938+0000 7fcedbfff640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcedc149180 0x7fcedc1e4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.938+0000 7fcedbfff640 1 -- 172.21.15.88:0/3804576208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcedc14bb60 msgr2=0x7fcedc1e5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.938+0000 7fcedbfff640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcedc14bb60 0x7fcedc1e5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.938+0000 7fcedbfff640 1 -- 172.21.15.88:0/3804576208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009400 con 0x7fcedc0b45d0 2024-01-22T10:13:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.938+0000 7fcedbfff640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcedc0b45d0 0x7fcedc13ccc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fced000c500 tx=0x7fced000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.938+0000 7fced8ff9640 1 -- 172.21.15.88:0/3804576208 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced00052d0 con 0x7fcedc0b45d0 2024-01-22T10:13:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.938+0000 7fced8ff9640 1 -- 172.21.15.88:0/3804576208 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0005450 con 0x7fcedc0b45d0 2024-01-22T10:13:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.938+0000 7fcee2a23640 1 -- 172.21.15.88:0/3804576208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc13ed50 con 0x7fcedc0b45d0 2024-01-22T10:13:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.938+0000 7fced8ff9640 1 -- 172.21.15.88:0/3804576208 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0012870 con 0x7fcedc0b45d0 2024-01-22T10:13:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.938+0000 7fcee2a23640 1 -- 172.21.15.88:0/3804576208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc1417d0 con 0x7fcedc0b45d0 2024-01-22T10:13:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.939+0000 7fcee2a23640 1 -- 172.21.15.88:0/3804576208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc04ea30 con 0x7fcedc0b45d0 2024-01-22T10:13:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.939+0000 7fced8ff9640 1 -- 172.21.15.88:0/3804576208 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fced00129d0 con 0x7fcedc0b45d0 2024-01-22T10:13:55.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.940+0000 7fced8ff9640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcec806b330 0x7fcec806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:55.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.940+0000 7fcedb7fe640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcec806b330 0x7fcec806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:55.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.940+0000 7fced8ff9640 1 -- 172.21.15.88:0/3804576208 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fced00897e0 con 0x7fcedc0b45d0 2024-01-22T10:13:55.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.940+0000 7fcedb7fe640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcec806b330 0x7fcec806d7f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcecc036000 tx=0x7fcecc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:55.944+0000 7fced8ff9640 1 -- 172.21.15.88:0/3804576208 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fced0054480 con 0x7fcedc0b45d0 2024-01-22T10:13:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.111+0000 7fcee2a23640 1 -- 172.21.15.88:0/3804576208 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcedc1570c0 con 0x7fcec806b330 2024-01-22T10:13:56.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.118+0000 7fced8ff9640 1 -- 172.21.15.88:0/3804576208 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267791 (secure 0 0 0) 0x7fcecc031a90 con 0x7fcec806b330 2024-01-22T10:13:56.103 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:56.104 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-01-22T10:13:56.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.121+0000 7fcee2a23640 1 -- 172.21.15.88:0/3804576208 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcec806b330 msgr2=0x7fcec806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:56.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.121+0000 7fcee2a23640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcec806b330 0x7fcec806d7f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcecc036000 tx=0x7fcecc030000 comp rx=0 tx=0).stop 2024-01-22T10:13:56.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.121+0000 7fcee2a23640 1 -- 172.21.15.88:0/3804576208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcedc0b45d0 msgr2=0x7fcedc13ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:56.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.121+0000 7fcee2a23640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcedc0b45d0 0x7fcedc13ccc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fced000c500 tx=0x7fced000c9c0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.121+0000 7fcee2a23640 1 -- 172.21.15.88:0/3804576208 shutdown_connections 2024-01-22T10:13:56.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.121+0000 7fcee2a23640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fcec806b330 0x7fcec806d7f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.121+0000 7fcee2a23640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcedc149180 0x7fcedc1e4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.121+0000 7fcee2a23640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcedc14bb60 0x7fcedc1e5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.121+0000 7fcee2a23640 1 --2- 172.21.15.88:0/3804576208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcedc0b45d0 0x7fcedc13ccc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.121+0000 7fcee2a23640 1 -- 172.21.15.88:0/3804576208 >> 172.21.15.88:0/3804576208 conn(0x7fcedc0c0eb0 msgr2=0x7fcedc0a1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:56.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.121+0000 7fcee2a23640 1 -- 172.21.15.88:0/3804576208 shutdown_connections 2024-01-22T10:13:56.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.121+0000 7fcee2a23640 1 -- 172.21.15.88:0/3804576208 wait complete. 2024-01-22T10:13:56.114 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-01-22T10:13:54.715586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594019,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220048,"kb_used_data":3848,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754672,"statfs":{"total":773094113280,"available":772868784128,"internally_reserved":0,"allocated":3940352,"data_stored":2218424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3651,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.094255"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986737+0000","last_change":"2024-01-22T10:13:42.628705+0000","last_active":"2024-01-22T10:13:43.986737+0000","last_peered":"2024-01-22T10:13:43.986737+0000","last_clean":"2024-01-22T10:13:43.986737+0000","last_became_active":"2024-01-22T10:13:42.627514+0000","last_became_peered":"2024-01-22T10:13:42.627514+0000","last_unstale":"2024-01-22T10:13:43.986737+0000","last_undegraded":"2024-01-22T10:13:43.986737+0000","last_fullsized":"2024-01-22T10:13:43.986737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624367+0000","last_change":"2024-01-22T10:13:42.623390+0000","last_active":"2024-01-22T10:13:43.624367+0000","last_peered":"2024-01-22T10:13:43.624367+0000","last_clean":"2024-01-22T10:13:43.624367+0000","last_became_active":"2024-01-22T10:13:42.623152+0000","last_became_peered":"2024-01-22T10:13:42.623152+0000","last_unstale":"2024-01-22T10:13:43.624367+0000","last_undegraded":"2024-01-22T10:13:43.624367+0000","last_fullsized":"2024-01-22T10:13:43.624367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:45:45.479717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034543+0000","last_change":"2024-01-22T10:13:42.627502+0000","last_active":"2024-01-22T10:13:44.034543+0000","last_peered":"2024-01-22T10:13:44.034543+0000","last_clean":"2024-01-22T10:13:44.034543+0000","last_became_active":"2024-01-22T10:13:42.627157+0000","last_became_peered":"2024-01-22T10:13:42.627157+0000","last_unstale":"2024-01-22T10:13:44.034543+0000","last_undegraded":"2024-01-22T10:13:44.034543+0000","last_fullsized":"2024-01-22T10:13:44.034543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622679+0000","last_change":"2024-01-22T10:13:42.631690+0000","last_active":"2024-01-22T10:13:43.622679+0000","last_peered":"2024-01-22T10:13:43.622679+0000","last_clean":"2024-01-22T10:13:43.622679+0000","last_became_active":"2024-01-22T10:13:42.630134+0000","last_became_peered":"2024-01-22T10:13:42.630134+0000","last_unstale":"2024-01-22T10:13:43.622679+0000","last_undegraded":"2024-01-22T10:13:43.622679+0000","last_fullsized":"2024-01-22T10:13:43.622679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:00:21.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034028+0000","last_change":"2024-01-22T10:13:42.636628+0000","last_active":"2024-01-22T10:13:44.034028+0000","last_peered":"2024-01-22T10:13:44.034028+0000","last_clean":"2024-01-22T10:13:44.034028+0000","last_became_active":"2024-01-22T10:13:42.636239+0000","last_became_peered":"2024-01-22T10:13:42.636239+0000","last_unstale":"2024-01-22T10:13:44.034028+0000","last_undegraded":"2024-01-22T10:13:44.034028+0000","last_fullsized":"2024-01-22T10:13:44.034028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:44:19.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624118+0000","last_change":"2024-01-22T10:13:42.621975+0000","last_active":"2024-01-22T10:13:43.624118+0000","last_peered":"2024-01-22T10:13:43.624118+0000","last_clean":"2024-01-22T10:13:43.624118+0000","last_became_active":"2024-01-22T10:13:42.621590+0000","last_became_peered":"2024-01-22T10:13:42.621590+0000","last_unstale":"2024-01-22T10:13:43.624118+0000","last_undegraded":"2024-01-22T10:13:43.624118+0000","last_fullsized":"2024-01-22T10:13:43.624118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624659+0000","last_change":"2024-01-22T10:13:42.617901+0000","last_active":"2024-01-22T10:13:43.624659+0000","last_peered":"2024-01-22T10:13:43.624659+0000","last_clean":"2024-01-22T10:13:43.624659+0000","last_became_active":"2024-01-22T10:13:42.617384+0000","last_became_peered":"2024-01-22T10:13:42.617384+0000","last_unstale":"2024-01-22T10:13:43.624659+0000","last_undegraded":"2024-01-22T10:13:43.624659+0000","last_fullsized":"2024-01-22T10:13:43.624659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624647+0000","last_change":"2024-01-22T10:13:42.622490+0000","last_active":"2024-01-22T10:13:43.624647+0000","last_peered":"2024-01-22T10:13:43.624647+0000","last_clean":"2024-01-22T10:13:43.624647+0000","last_became_active":"2024-01-22T10:13:42.622220+0000","last_became_peered":"2024-01-22T10:13:42.622220+0000","last_unstale":"2024-01-22T10:13:43.624647+0000","last_undegraded":"2024-01-22T10:13:43.624647+0000","last_fullsized":"2024-01-22T10:13:43.624647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035496+0000","last_change":"2024-01-22T10:13:42.635502+0000","last_active":"2024-01-22T10:13:44.035496+0000","last_peered":"2024-01-22T10:13:44.035496+0000","last_clean":"2024-01-22T10:13:44.035496+0000","last_became_active":"2024-01-22T10:13:42.635312+0000","last_became_peered":"2024-01-22T10:13:42.635312+0000","last_unstale":"2024-01-22T10:13:44.035496+0000","last_undegraded":"2024-01-22T10:13:44.035496+0000","last_fullsized":"2024-01-22T10:13:44.035496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:19:17.630353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622947+0000","last_change":"2024-01-22T10:13:42.635158+0000","last_active":"2024-01-22T10:13:43.622947+0000","last_peered":"2024-01-22T10:13:43.622947+0000","last_clean":"2024-01-22T10:13:43.622947+0000","last_became_active":"2024-01-22T10:13:42.634191+0000","last_became_peered":"2024-01-22T10:13:42.634191+0000","last_unstale":"2024-01-22T10:13:43.622947+0000","last_undegraded":"2024-01-22T10:13:43.622947+0000","last_fullsized":"2024-01-22T10:13:43.622947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:17.709645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624931+0000","last_change":"2024-01-22T10:13:42.621049+0000","last_active":"2024-01-22T10:13:43.624931+0000","last_peered":"2024-01-22T10:13:43.624931+0000","last_clean":"2024-01-22T10:13:43.624931+0000","last_became_active":"2024-01-22T10:13:42.620763+0000","last_became_peered":"2024-01-22T10:13:42.620763+0000","last_unstale":"2024-01-22T10:13:43.624931+0000","last_undegraded":"2024-01-22T10:13:43.624931+0000","last_fullsized":"2024-01-22T10:13:43.624931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:45:45.479717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034352+0000","last_change":"2024-01-22T10:13:42.634597+0000","last_active":"2024-01-22T10:13:44.034352+0000","last_peered":"2024-01-22T10:13:44.034352+0000","last_clean":"2024-01-22T10:13:44.034352+0000","last_became_active":"2024-01-22T10:13:42.634366+0000","last_became_peered":"2024-01-22T10:13:42.634366+0000","last_unstale":"2024-01-22T10:13:44.034352+0000","last_undegraded":"2024-01-22T10:13:44.034352+0000","last_fullsized":"2024-01-22T10:13:44.034352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034137+0000","last_change":"2024-01-22T10:13:42.624821+0000","last_active":"2024-01-22T10:13:44.034137+0000","last_peered":"2024-01-22T10:13:44.034137+0000","last_clean":"2024-01-22T10:13:44.034137+0000","last_became_active":"2024-01-22T10:13:42.624548+0000","last_became_peered":"2024-01-22T10:13:42.624548+0000","last_unstale":"2024-01-22T10:13:44.034137+0000","last_undegraded":"2024-01-22T10:13:44.034137+0000","last_fullsized":"2024-01-22T10:13:44.034137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:26.195084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624093+0000","last_change":"2024-01-22T10:13:42.625911+0000","last_active":"2024-01-22T10:13:43.624093+0000","last_peered":"2024-01-22T10:13:43.624093+0000","last_clean":"2024-01-22T10:13:43.624093+0000","last_became_active":"2024-01-22T10:13:42.625647+0000","last_became_peered":"2024-01-22T10:13:42.625647+0000","last_unstale":"2024-01-22T10:13:43.624093+0000","last_undegraded":"2024-01-22T10:13:43.624093+0000","last_fullsized":"2024-01-22T10:13:43.624093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034305+0000","last_change":"2024-01-22T10:13:42.621130+0000","last_active":"2024-01-22T10:13:44.034305+0000","last_peered":"2024-01-22T10:13:44.034305+0000","last_clean":"2024-01-22T10:13:44.034305+0000","last_became_active":"2024-01-22T10:13:42.620805+0000","last_became_peered":"2024-01-22T10:13:42.620805+0000","last_unstale":"2024-01-22T10:13:44.034305+0000","last_undegraded":"2024-01-22T10:13:44.034305+0000","last_fullsized":"2024-01-22T10:13:44.034305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:20.447342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624819+0000","last_change":"2024-01-22T10:13:42.624267+0000","last_active":"2024-01-22T10:13:43.624819+0000","last_peered":"2024-01-22T10:13:43.624819+0000","last_clean":"2024-01-22T10:13:43.624819+0000","last_became_active":"2024-01-22T10:13:42.623306+0000","last_became_peered":"2024-01-22T10:13:42.623306+0000","last_unstale":"2024-01-22T10:13:43.624819+0000","last_undegraded":"2024-01-22T10:13:43.624819+0000","last_fullsized":"2024-01-22T10:13:43.624819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:55.572047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.625077+0000","last_change":"2024-01-22T10:13:42.617345+0000","last_active":"2024-01-22T10:13:43.625077+0000","last_peered":"2024-01-22T10:13:43.625077+0000","last_clean":"2024-01-22T10:13:43.625077+0000","last_became_active":"2024-01-22T10:13:42.617072+0000","last_became_peered":"2024-01-22T10:13:42.617072+0000","last_unstale":"2024-01-22T10:13:43.625077+0000","last_undegraded":"2024-01-22T10:13:43.625077+0000","last_fullsized":"2024-01-22T10:13:43.625077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:08:00.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624439+0000","last_change":"2024-01-22T10:13:42.625193+0000","last_active":"2024-01-22T10:13:43.624439+0000","last_peered":"2024-01-22T10:13:43.624439+0000","last_clean":"2024-01-22T10:13:43.624439+0000","last_became_active":"2024-01-22T10:13:42.624862+0000","last_became_peered":"2024-01-22T10:13:42.624862+0000","last_unstale":"2024-01-22T10:13:43.624439+0000","last_undegraded":"2024-01-22T10:13:43.624439+0000","last_fullsized":"2024-01-22T10:13:43.624439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:08:00.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624133+0000","last_change":"2024-01-22T10:13:42.626004+0000","last_active":"2024-01-22T10:13:43.624133+0000","last_peered":"2024-01-22T10:13:43.624133+0000","last_clean":"2024-01-22T10:13:43.624133+0000","last_became_active":"2024-01-22T10:13:42.625078+0000","last_became_peered":"2024-01-22T10:13:42.625078+0000","last_unstale":"2024-01-22T10:13:43.624133+0000","last_undegraded":"2024-01-22T10:13:43.624133+0000","last_fullsized":"2024-01-22T10:13:43.624133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034290+0000","last_change":"2024-01-22T10:13:42.626913+0000","last_active":"2024-01-22T10:13:44.034290+0000","last_peered":"2024-01-22T10:13:44.034290+0000","last_clean":"2024-01-22T10:13:44.034290+0000","last_became_active":"2024-01-22T10:13:42.626641+0000","last_became_peered":"2024-01-22T10:13:42.626641+0000","last_unstale":"2024-01-22T10:13:44.034290+0000","last_undegraded":"2024-01-22T10:13:44.034290+0000","last_fullsized":"2024-01-22T10:13:44.034290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:48.542860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035305+0000","last_change":"2024-01-22T10:13:42.626420+0000","last_active":"2024-01-22T10:13:44.035305+0000","last_peered":"2024-01-22T10:13:44.035305+0000","last_clean":"2024-01-22T10:13:44.035305+0000","last_became_active":"2024-01-22T10:13:42.626133+0000","last_became_peered":"2024-01-22T10:13:42.626133+0000","last_unstale":"2024-01-22T10:13:44.035305+0000","last_undegraded":"2024-01-22T10:13:44.035305+0000","last_fullsized":"2024-01-22T10:13:44.035305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:33:09.287996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035119+0000","last_change":"2024-01-22T10:13:42.637449+0000","last_active":"2024-01-22T10:13:44.035119+0000","last_peered":"2024-01-22T10:13:44.035119+0000","last_clean":"2024-01-22T10:13:44.035119+0000","last_became_active":"2024-01-22T10:13:42.637144+0000","last_became_peered":"2024-01-22T10:13:42.637144+0000","last_unstale":"2024-01-22T10:13:44.035119+0000","last_undegraded":"2024-01-22T10:13:44.035119+0000","last_fullsized":"2024-01-22T10:13:44.035119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:09.341746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033847+0000","last_change":"2024-01-22T10:13:42.623905+0000","last_active":"2024-01-22T10:13:44.033847+0000","last_peered":"2024-01-22T10:13:44.033847+0000","last_clean":"2024-01-22T10:13:44.033847+0000","last_became_active":"2024-01-22T10:13:42.623652+0000","last_became_peered":"2024-01-22T10:13:42.623652+0000","last_unstale":"2024-01-22T10:13:44.033847+0000","last_undegraded":"2024-01-22T10:13:44.033847+0000","last_fullsized":"2024-01-22T10:13:44.033847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034166+0000","last_change":"2024-01-22T10:13:42.626456+0000","last_active":"2024-01-22T10:13:44.034166+0000","last_peered":"2024-01-22T10:13:44.034166+0000","last_clean":"2024-01-22T10:13:44.034166+0000","last_became_active":"2024-01-22T10:13:42.626193+0000","last_became_peered":"2024-01-22T10:13:42.626193+0000","last_unstale":"2024-01-22T10:13:44.034166+0000","last_undegraded":"2024-01-22T10:13:44.034166+0000","last_fullsized":"2024-01-22T10:13:44.034166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:17.709645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622986+0000","last_change":"2024-01-22T10:13:42.619961+0000","last_active":"2024-01-22T10:13:43.622986+0000","last_peered":"2024-01-22T10:13:43.622986+0000","last_clean":"2024-01-22T10:13:43.622986+0000","last_became_active":"2024-01-22T10:13:42.619484+0000","last_became_peered":"2024-01-22T10:13:42.619484+0000","last_unstale":"2024-01-22T10:13:43.622986+0000","last_undegraded":"2024-01-22T10:13:43.622986+0000","last_fullsized":"2024-01-22T10:13:43.622986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624437+0000","last_change":"2024-01-22T10:13:42.621000+0000","last_active":"2024-01-22T10:13:43.624437+0000","last_peered":"2024-01-22T10:13:43.624437+0000","last_clean":"2024-01-22T10:13:43.624437+0000","last_became_active":"2024-01-22T10:13:42.620624+0000","last_became_peered":"2024-01-22T10:13:42.620624+0000","last_unstale":"2024-01-22T10:13:43.624437+0000","last_undegraded":"2024-01-22T10:13:43.624437+0000","last_fullsized":"2024-01-22T10:13:43.624437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:13.693929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622855+0000","last_change":"2024-01-22T10:13:42.631519+0000","last_active":"2024-01-22T10:13:43.622855+0000","last_peered":"2024-01-22T10:13:43.622855+0000","last_clean":"2024-01-22T10:13:43.622855+0000","last_became_active":"2024-01-22T10:13:42.630812+0000","last_became_peered":"2024-01-22T10:13:42.630812+0000","last_unstale":"2024-01-22T10:13:43.622855+0000","last_undegraded":"2024-01-22T10:13:43.622855+0000","last_fullsized":"2024-01-22T10:13:43.622855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:30:17.081991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034519+0000","last_change":"2024-01-22T10:13:42.624797+0000","last_active":"2024-01-22T10:13:44.034519+0000","last_peered":"2024-01-22T10:13:44.034519+0000","last_clean":"2024-01-22T10:13:44.034519+0000","last_became_active":"2024-01-22T10:13:42.624529+0000","last_became_peered":"2024-01-22T10:13:42.624529+0000","last_unstale":"2024-01-22T10:13:44.034519+0000","last_undegraded":"2024-01-22T10:13:44.034519+0000","last_fullsized":"2024-01-22T10:13:44.034519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035160+0000","last_change":"2024-01-22T10:13:42.637426+0000","last_active":"2024-01-22T10:13:44.035160+0000","last_peered":"2024-01-22T10:13:44.035160+0000","last_clean":"2024-01-22T10:13:44.035160+0000","last_became_active":"2024-01-22T10:13:42.637077+0000","last_became_peered":"2024-01-22T10:13:42.637077+0000","last_unstale":"2024-01-22T10:13:44.035160+0000","last_undegraded":"2024-01-22T10:13:44.035160+0000","last_fullsized":"2024-01-22T10:13:44.035160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:21:10.389082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624648+0000","last_change":"2024-01-22T10:13:42.617414+0000","last_active":"2024-01-22T10:13:43.624648+0000","last_peered":"2024-01-22T10:13:43.624648+0000","last_clean":"2024-01-22T10:13:43.624648+0000","last_became_active":"2024-01-22T10:13:42.617110+0000","last_became_peered":"2024-01-22T10:13:42.617110+0000","last_unstale":"2024-01-22T10:13:43.624648+0000","last_undegraded":"2024-01-22T10:13:43.624648+0000","last_fullsized":"2024-01-22T10:13:43.624648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986570+0000","last_change":"2024-01-22T10:13:42.628627+0000","last_active":"2024-01-22T10:13:43.986570+0000","last_peered":"2024-01-22T10:13:43.986570+0000","last_clean":"2024-01-22T10:13:43.986570+0000","last_became_active":"2024-01-22T10:13:42.628259+0000","last_became_peered":"2024-01-22T10:13:42.628259+0000","last_unstale":"2024-01-22T10:13:43.986570+0000","last_undegraded":"2024-01-22T10:13:43.986570+0000","last_fullsized":"2024-01-22T10:13:43.986570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:49.014219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624513+0000","last_change":"2024-01-22T10:13:42.624473+0000","last_active":"2024-01-22T10:13:43.624513+0000","last_peered":"2024-01-22T10:13:43.624513+0000","last_clean":"2024-01-22T10:13:43.624513+0000","last_became_active":"2024-01-22T10:13:42.623675+0000","last_became_peered":"2024-01-22T10:13:42.623675+0000","last_unstale":"2024-01-22T10:13:43.624513+0000","last_undegraded":"2024-01-22T10:13:43.624513+0000","last_fullsized":"2024-01-22T10:13:43.624513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:00:42.245954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034197+0000","last_change":"2024-01-22T10:13:42.623919+0000","last_active":"2024-01-22T10:13:44.034197+0000","last_peered":"2024-01-22T10:13:44.034197+0000","last_clean":"2024-01-22T10:13:44.034197+0000","last_became_active":"2024-01-22T10:13:42.623680+0000","last_became_peered":"2024-01-22T10:13:42.623680+0000","last_unstale":"2024-01-22T10:13:44.034197+0000","last_undegraded":"2024-01-22T10:13:44.034197+0000","last_fullsized":"2024-01-22T10:13:44.034197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:09.341746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.638092+0000","last_change":"2024-01-22T10:13:41.601272+0000","last_active":"2024-01-22T10:13:42.638092+0000","last_peered":"2024-01-22T10:13:42.638092+0000","last_clean":"2024-01-22T10:13:42.638092+0000","last_became_active":"2024-01-22T10:13:41.600823+0000","last_became_peered":"2024-01-22T10:13:41.600823+0000","last_unstale":"2024-01-22T10:13:42.638092+0000","last_undegraded":"2024-01-22T10:13:42.638092+0000","last_fullsized":"2024-01-22T10:13:42.638092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:25.193353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986817+0000","last_change":"2024-01-22T10:13:42.628954+0000","last_active":"2024-01-22T10:13:43.986817+0000","last_peered":"2024-01-22T10:13:43.986817+0000","last_clean":"2024-01-22T10:13:43.986817+0000","last_became_active":"2024-01-22T10:13:42.626926+0000","last_became_peered":"2024-01-22T10:13:42.626926+0000","last_unstale":"2024-01-22T10:13:43.986817+0000","last_undegraded":"2024-01-22T10:13:43.986817+0000","last_fullsized":"2024-01-22T10:13:43.986817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.629143+0000","last_change":"2024-01-22T10:13:41.598256+0000","last_active":"2024-01-22T10:13:42.629143+0000","last_peered":"2024-01-22T10:13:42.629143+0000","last_clean":"2024-01-22T10:13:42.629143+0000","last_became_active":"2024-01-22T10:13:41.597853+0000","last_became_peered":"2024-01-22T10:13:41.597853+0000","last_unstale":"2024-01-22T10:13:42.629143+0000","last_undegraded":"2024-01-22T10:13:42.629143+0000","last_fullsized":"2024-01-22T10:13:42.629143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:49:40.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035276+0000","last_change":"2024-01-22T10:13:42.637399+0000","last_active":"2024-01-22T10:13:44.035276+0000","last_peered":"2024-01-22T10:13:44.035276+0000","last_clean":"2024-01-22T10:13:44.035276+0000","last_became_active":"2024-01-22T10:13:42.637040+0000","last_became_peered":"2024-01-22T10:13:42.637040+0000","last_unstale":"2024-01-22T10:13:44.035276+0000","last_undegraded":"2024-01-22T10:13:44.035276+0000","last_fullsized":"2024-01-22T10:13:44.035276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:24:30.281721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.636032+0000","last_change":"2024-01-22T10:13:41.594947+0000","last_active":"2024-01-22T10:13:42.636032+0000","last_peered":"2024-01-22T10:13:42.636032+0000","last_clean":"2024-01-22T10:13:42.636032+0000","last_became_active":"2024-01-22T10:13:41.594297+0000","last_became_peered":"2024-01-22T10:13:41.594297+0000","last_unstale":"2024-01-22T10:13:42.636032+0000","last_undegraded":"2024-01-22T10:13:42.636032+0000","last_fullsized":"2024-01-22T10:13:42.636032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:08.340015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622980+0000","last_change":"2024-01-22T10:13:42.631105+0000","last_active":"2024-01-22T10:13:43.622980+0000","last_peered":"2024-01-22T10:13:43.622980+0000","last_clean":"2024-01-22T10:13:43.622980+0000","last_became_active":"2024-01-22T10:13:42.630434+0000","last_became_peered":"2024-01-22T10:13:42.630434+0000","last_unstale":"2024-01-22T10:13:43.622980+0000","last_undegraded":"2024-01-22T10:13:43.622980+0000","last_fullsized":"2024-01-22T10:13:43.622980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:20.447342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635390+0000","last_change":"2024-01-22T10:13:41.595358+0000","last_active":"2024-01-22T10:13:42.635390+0000","last_peered":"2024-01-22T10:13:42.635390+0000","last_clean":"2024-01-22T10:13:42.635390+0000","last_became_active":"2024-01-22T10:13:41.595111+0000","last_became_peered":"2024-01-22T10:13:41.595111+0000","last_unstale":"2024-01-22T10:13:42.635390+0000","last_undegraded":"2024-01-22T10:13:42.635390+0000","last_fullsized":"2024-01-22T10:13:42.635390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:42:01.516366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624715+0000","last_change":"2024-01-22T10:13:42.623899+0000","last_active":"2024-01-22T10:13:43.624715+0000","last_peered":"2024-01-22T10:13:43.624715+0000","last_clean":"2024-01-22T10:13:43.624715+0000","last_became_active":"2024-01-22T10:13:42.623634+0000","last_became_peered":"2024-01-22T10:13:42.623634+0000","last_unstale":"2024-01-22T10:13:43.624715+0000","last_undegraded":"2024-01-22T10:13:43.624715+0000","last_fullsized":"2024-01-22T10:13:43.624715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640552+0000","last_change":"2024-01-22T10:13:41.598117+0000","last_active":"2024-01-22T10:13:42.640552+0000","last_peered":"2024-01-22T10:13:42.640552+0000","last_clean":"2024-01-22T10:13:42.640552+0000","last_became_active":"2024-01-22T10:13:41.597046+0000","last_became_peered":"2024-01-22T10:13:41.597046+0000","last_unstale":"2024-01-22T10:13:42.640552+0000","last_undegraded":"2024-01-22T10:13:42.640552+0000","last_fullsized":"2024-01-22T10:13:42.640552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:44.239736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034430+0000","last_change":"2024-01-22T10:13:42.624025+0000","last_active":"2024-01-22T10:13:44.034430+0000","last_peered":"2024-01-22T10:13:44.034430+0000","last_clean":"2024-01-22T10:13:44.034430+0000","last_became_active":"2024-01-22T10:13:42.623760+0000","last_became_peered":"2024-01-22T10:13:42.623760+0000","last_unstale":"2024-01-22T10:13:44.034430+0000","last_undegraded":"2024-01-22T10:13:44.034430+0000","last_fullsized":"2024-01-22T10:13:44.034430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637438+0000","last_change":"2024-01-22T10:13:41.597237+0000","last_active":"2024-01-22T10:13:42.637438+0000","last_peered":"2024-01-22T10:13:42.637438+0000","last_clean":"2024-01-22T10:13:42.637438+0000","last_became_active":"2024-01-22T10:13:41.596938+0000","last_became_peered":"2024-01-22T10:13:41.596938+0000","last_unstale":"2024-01-22T10:13:42.637438+0000","last_undegraded":"2024-01-22T10:13:42.637438+0000","last_fullsized":"2024-01-22T10:13:42.637438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:25.193353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034876+0000","last_change":"2024-01-22T10:13:42.622658+0000","last_active":"2024-01-22T10:13:44.034876+0000","last_peered":"2024-01-22T10:13:44.034876+0000","last_clean":"2024-01-22T10:13:44.034876+0000","last_became_active":"2024-01-22T10:13:42.622398+0000","last_became_peered":"2024-01-22T10:13:42.622398+0000","last_unstale":"2024-01-22T10:13:44.034876+0000","last_undegraded":"2024-01-22T10:13:44.034876+0000","last_fullsized":"2024-01-22T10:13:44.034876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.610874+0000","last_change":"2024-01-22T10:13:41.593515+0000","last_active":"2024-01-22T10:13:42.610874+0000","last_peered":"2024-01-22T10:13:42.610874+0000","last_clean":"2024-01-22T10:13:42.610874+0000","last_became_active":"2024-01-22T10:13:41.593248+0000","last_became_peered":"2024-01-22T10:13:41.593248+0000","last_unstale":"2024-01-22T10:13:42.610874+0000","last_undegraded":"2024-01-22T10:13:42.610874+0000","last_fullsized":"2024-01-22T10:13:42.610874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:48.475424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622556+0000","last_change":"2024-01-22T10:13:42.630318+0000","last_active":"2024-01-22T10:13:43.622556+0000","last_peered":"2024-01-22T10:13:43.622556+0000","last_clean":"2024-01-22T10:13:43.622556+0000","last_became_active":"2024-01-22T10:13:42.623690+0000","last_became_peered":"2024-01-22T10:13:42.623690+0000","last_unstale":"2024-01-22T10:13:43.622556+0000","last_undegraded":"2024-01-22T10:13:43.622556+0000","last_fullsized":"2024-01-22T10:13:43.622556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:33:09.287996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621953+0000","last_change":"2024-01-22T10:13:41.601278+0000","last_active":"2024-01-22T10:13:42.621953+0000","last_peered":"2024-01-22T10:13:42.621953+0000","last_clean":"2024-01-22T10:13:42.621953+0000","last_became_active":"2024-01-22T10:13:41.601016+0000","last_became_peered":"2024-01-22T10:13:41.601016+0000","last_unstale":"2024-01-22T10:13:42.621953+0000","last_undegraded":"2024-01-22T10:13:42.621953+0000","last_fullsized":"2024-01-22T10:13:42.621953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:44:18.938485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034523+0000","last_change":"2024-01-22T10:13:42.633673+0000","last_active":"2024-01-22T10:13:44.034523+0000","last_peered":"2024-01-22T10:13:44.034523+0000","last_clean":"2024-01-22T10:13:44.034523+0000","last_became_active":"2024-01-22T10:13:42.633419+0000","last_became_peered":"2024-01-22T10:13:42.633419+0000","last_unstale":"2024-01-22T10:13:44.034523+0000","last_undegraded":"2024-01-22T10:13:44.034523+0000","last_fullsized":"2024-01-22T10:13:44.034523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.609891+0000","last_change":"2024-01-22T10:13:41.599944+0000","last_active":"2024-01-22T10:13:42.609891+0000","last_peered":"2024-01-22T10:13:42.609891+0000","last_clean":"2024-01-22T10:13:42.609891+0000","last_became_active":"2024-01-22T10:13:41.599658+0000","last_became_peered":"2024-01-22T10:13:41.599658+0000","last_unstale":"2024-01-22T10:13:42.609891+0000","last_undegraded":"2024-01-22T10:13:42.609891+0000","last_fullsized":"2024-01-22T10:13:42.609891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:48.012488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624289+0000","last_change":"2024-01-22T10:13:42.624509+0000","last_active":"2024-01-22T10:13:43.624289+0000","last_peered":"2024-01-22T10:13:43.624289+0000","last_clean":"2024-01-22T10:13:43.624289+0000","last_became_active":"2024-01-22T10:13:42.624258+0000","last_became_peered":"2024-01-22T10:13:42.624258+0000","last_unstale":"2024-01-22T10:13:43.624289+0000","last_undegraded":"2024-01-22T10:13:43.624289+0000","last_fullsized":"2024-01-22T10:13:43.624289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614510+0000","last_change":"2024-01-22T10:13:41.603096+0000","last_active":"2024-01-22T10:13:42.614510+0000","last_peered":"2024-01-22T10:13:42.614510+0000","last_clean":"2024-01-22T10:13:42.614510+0000","last_became_active":"2024-01-22T10:13:41.602525+0000","last_became_peered":"2024-01-22T10:13:41.602525+0000","last_unstale":"2024-01-22T10:13:42.614510+0000","last_undegraded":"2024-01-22T10:13:42.614510+0000","last_fullsized":"2024-01-22T10:13:42.614510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624219+0000","last_change":"2024-01-22T10:13:42.615910+0000","last_active":"2024-01-22T10:13:43.624219+0000","last_peered":"2024-01-22T10:13:43.624219+0000","last_clean":"2024-01-22T10:13:43.624219+0000","last_became_active":"2024-01-22T10:13:42.615658+0000","last_became_peered":"2024-01-22T10:13:42.615658+0000","last_unstale":"2024-01-22T10:13:43.624219+0000","last_undegraded":"2024-01-22T10:13:43.624219+0000","last_fullsized":"2024-01-22T10:13:43.624219+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.632230+0000","last_change":"2024-01-22T10:13:41.599287+0000","last_active":"2024-01-22T10:13:42.632230+0000","last_peered":"2024-01-22T10:13:42.632230+0000","last_clean":"2024-01-22T10:13:42.632230+0000","last_became_active":"2024-01-22T10:13:41.598984+0000","last_became_peered":"2024-01-22T10:13:41.598984+0000","last_unstale":"2024-01-22T10:13:42.632230+0000","last_undegraded":"2024-01-22T10:13:42.632230+0000","last_fullsized":"2024-01-22T10:13:42.632230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:48.012488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034398+0000","last_change":"2024-01-22T10:13:42.627844+0000","last_active":"2024-01-22T10:13:44.034398+0000","last_peered":"2024-01-22T10:13:44.034398+0000","last_clean":"2024-01-22T10:13:44.034398+0000","last_became_active":"2024-01-22T10:13:42.626619+0000","last_became_peered":"2024-01-22T10:13:42.626619+0000","last_unstale":"2024-01-22T10:13:44.034398+0000","last_undegraded":"2024-01-22T10:13:44.034398+0000","last_fullsized":"2024-01-22T10:13:44.034398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:00:42.245954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:49.232274+0000","last_change":"2024-01-22T10:13:41.596903+0000","last_active":"2024-01-22T10:13:49.232274+0000","last_peered":"2024-01-22T10:13:49.232274+0000","last_clean":"2024-01-22T10:13:49.232274+0000","last_became_active":"2024-01-22T10:13:41.596658+0000","last_became_peered":"2024-01-22T10:13:41.596658+0000","last_unstale":"2024-01-22T10:13:49.232274+0000","last_undegraded":"2024-01-22T10:13:49.232274+0000","last_fullsized":"2024-01-22T10:13:49.232274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T22:02:40.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2853,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622560+0000","last_change":"2024-01-22T10:13:42.627496+0000","last_active":"2024-01-22T10:13:43.622560+0000","last_peered":"2024-01-22T10:13:43.622560+0000","last_clean":"2024-01-22T10:13:43.622560+0000","last_became_active":"2024-01-22T10:13:42.627194+0000","last_became_peered":"2024-01-22T10:13:42.627194+0000","last_unstale":"2024-01-22T10:13:43.622560+0000","last_undegraded":"2024-01-22T10:13:43.622560+0000","last_fullsized":"2024-01-22T10:13:43.622560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:24:30.281721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640785+0000","last_change":"2024-01-22T10:13:41.602468+0000","last_active":"2024-01-22T10:13:42.640785+0000","last_peered":"2024-01-22T10:13:42.640785+0000","last_clean":"2024-01-22T10:13:42.640785+0000","last_became_active":"2024-01-22T10:13:41.602166+0000","last_became_peered":"2024-01-22T10:13:41.602166+0000","last_unstale":"2024-01-22T10:13:42.640785+0000","last_undegraded":"2024-01-22T10:13:42.640785+0000","last_fullsized":"2024-01-22T10:13:42.640785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:47.541129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624319+0000","last_change":"2024-01-22T10:13:42.624284+0000","last_active":"2024-01-22T10:13:43.624319+0000","last_peered":"2024-01-22T10:13:43.624319+0000","last_clean":"2024-01-22T10:13:43.624319+0000","last_became_active":"2024-01-22T10:13:42.623996+0000","last_became_peered":"2024-01-22T10:13:42.623996+0000","last_unstale":"2024-01-22T10:13:43.624319+0000","last_undegraded":"2024-01-22T10:13:43.624319+0000","last_fullsized":"2024-01-22T10:13:43.624319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:55.572047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.611919+0000","last_change":"2024-01-22T10:13:41.596625+0000","last_active":"2024-01-22T10:13:42.611919+0000","last_peered":"2024-01-22T10:13:42.611919+0000","last_clean":"2024-01-22T10:13:42.611919+0000","last_became_active":"2024-01-22T10:13:41.596376+0000","last_became_peered":"2024-01-22T10:13:41.596376+0000","last_unstale":"2024-01-22T10:13:42.611919+0000","last_undegraded":"2024-01-22T10:13:42.611919+0000","last_fullsized":"2024-01-22T10:13:42.611919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:49:40.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624720+0000","last_change":"2024-01-22T10:13:42.624678+0000","last_active":"2024-01-22T10:13:43.624720+0000","last_peered":"2024-01-22T10:13:43.624720+0000","last_clean":"2024-01-22T10:13:43.624720+0000","last_became_active":"2024-01-22T10:13:42.624005+0000","last_became_peered":"2024-01-22T10:13:42.624005+0000","last_unstale":"2024-01-22T10:13:43.624720+0000","last_undegraded":"2024-01-22T10:13:43.624720+0000","last_fullsized":"2024-01-22T10:13:43.624720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.611000+0000","last_change":"2024-01-22T10:13:41.597383+0000","last_active":"2024-01-22T10:13:42.611000+0000","last_peered":"2024-01-22T10:13:42.611000+0000","last_clean":"2024-01-22T10:13:42.611000+0000","last_became_active":"2024-01-22T10:13:41.597155+0000","last_became_peered":"2024-01-22T10:13:41.597155+0000","last_unstale":"2024-01-22T10:13:42.611000+0000","last_undegraded":"2024-01-22T10:13:42.611000+0000","last_fullsized":"2024-01-22T10:13:42.611000+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:32.767529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986697+0000","last_change":"2024-01-22T10:13:42.625547+0000","last_active":"2024-01-22T10:13:43.986697+0000","last_peered":"2024-01-22T10:13:43.986697+0000","last_clean":"2024-01-22T10:13:43.986697+0000","last_became_active":"2024-01-22T10:13:42.625291+0000","last_became_peered":"2024-01-22T10:13:42.625291+0000","last_unstale":"2024-01-22T10:13:43.986697+0000","last_undegraded":"2024-01-22T10:13:43.986697+0000","last_fullsized":"2024-01-22T10:13:43.986697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:23:18.919792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635796+0000","last_change":"2024-01-22T10:13:41.595957+0000","last_active":"2024-01-22T10:13:42.635796+0000","last_peered":"2024-01-22T10:13:42.635796+0000","last_clean":"2024-01-22T10:13:42.635796+0000","last_became_active":"2024-01-22T10:13:41.594410+0000","last_became_peered":"2024-01-22T10:13:41.594410+0000","last_unstale":"2024-01-22T10:13:42.635796+0000","last_undegraded":"2024-01-22T10:13:42.635796+0000","last_fullsized":"2024-01-22T10:13:42.635796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:22:33.851960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035330+0000","last_change":"2024-01-22T10:13:42.633175+0000","last_active":"2024-01-22T10:13:44.035330+0000","last_peered":"2024-01-22T10:13:44.035330+0000","last_clean":"2024-01-22T10:13:44.035330+0000","last_became_active":"2024-01-22T10:13:42.632877+0000","last_became_peered":"2024-01-22T10:13:42.632877+0000","last_unstale":"2024-01-22T10:13:44.035330+0000","last_undegraded":"2024-01-22T10:13:44.035330+0000","last_fullsized":"2024-01-22T10:13:44.035330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:00:21.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637591+0000","last_change":"2024-01-22T10:13:41.595203+0000","last_active":"2024-01-22T10:13:42.637591+0000","last_peered":"2024-01-22T10:13:42.637591+0000","last_clean":"2024-01-22T10:13:42.637591+0000","last_became_active":"2024-01-22T10:13:41.594555+0000","last_became_peered":"2024-01-22T10:13:41.594555+0000","last_unstale":"2024-01-22T10:13:42.637591+0000","last_undegraded":"2024-01-22T10:13:42.637591+0000","last_fullsized":"2024-01-22T10:13:42.637591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034639+0000","last_change":"2024-01-22T10:13:42.630113+0000","last_active":"2024-01-22T10:13:44.034639+0000","last_peered":"2024-01-22T10:13:44.034639+0000","last_clean":"2024-01-22T10:13:44.034639+0000","last_became_active":"2024-01-22T10:13:42.629837+0000","last_became_peered":"2024-01-22T10:13:42.629837+0000","last_unstale":"2024-01-22T10:13:44.034639+0000","last_undegraded":"2024-01-22T10:13:44.034639+0000","last_fullsized":"2024-01-22T10:13:44.034639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635198+0000","last_change":"2024-01-22T10:13:41.602980+0000","last_active":"2024-01-22T10:13:42.635198+0000","last_peered":"2024-01-22T10:13:42.635198+0000","last_clean":"2024-01-22T10:13:42.635198+0000","last_became_active":"2024-01-22T10:13:41.602710+0000","last_became_peered":"2024-01-22T10:13:41.602710+0000","last_unstale":"2024-01-22T10:13:42.635198+0000","last_undegraded":"2024-01-22T10:13:42.635198+0000","last_fullsized":"2024-01-22T10:13:42.635198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622803+0000","last_change":"2024-01-22T10:13:42.629784+0000","last_active":"2024-01-22T10:13:43.622803+0000","last_peered":"2024-01-22T10:13:43.622803+0000","last_clean":"2024-01-22T10:13:43.622803+0000","last_became_active":"2024-01-22T10:13:42.629488+0000","last_became_peered":"2024-01-22T10:13:42.629488+0000","last_unstale":"2024-01-22T10:13:43.622803+0000","last_undegraded":"2024-01-22T10:13:43.622803+0000","last_fullsized":"2024-01-22T10:13:43.622803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:19:17.630353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637429+0000","last_change":"2024-01-22T10:13:41.599558+0000","last_active":"2024-01-22T10:13:42.637429+0000","last_peered":"2024-01-22T10:13:42.637429+0000","last_clean":"2024-01-22T10:13:42.637429+0000","last_became_active":"2024-01-22T10:13:41.599228+0000","last_became_peered":"2024-01-22T10:13:41.599228+0000","last_unstale":"2024-01-22T10:13:42.637429+0000","last_undegraded":"2024-01-22T10:13:42.637429+0000","last_fullsized":"2024-01-22T10:13:42.637429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034332+0000","last_change":"2024-01-22T10:13:42.626089+0000","last_active":"2024-01-22T10:13:44.034332+0000","last_peered":"2024-01-22T10:13:44.034332+0000","last_clean":"2024-01-22T10:13:44.034332+0000","last_became_active":"2024-01-22T10:13:42.625809+0000","last_became_peered":"2024-01-22T10:13:42.625809+0000","last_unstale":"2024-01-22T10:13:44.034332+0000","last_undegraded":"2024-01-22T10:13:44.034332+0000","last_fullsized":"2024-01-22T10:13:44.034332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:55.872670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.622441+0000","last_change":"2024-01-22T10:13:41.597556+0000","last_active":"2024-01-22T10:13:42.622441+0000","last_peered":"2024-01-22T10:13:42.622441+0000","last_clean":"2024-01-22T10:13:42.622441+0000","last_became_active":"2024-01-22T10:13:41.597157+0000","last_became_peered":"2024-01-22T10:13:41.597157+0000","last_unstale":"2024-01-22T10:13:42.622441+0000","last_undegraded":"2024-01-22T10:13:42.622441+0000","last_fullsized":"2024-01-22T10:13:42.622441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:54.870939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034040+0000","last_change":"2024-01-22T10:13:42.630577+0000","last_active":"2024-01-22T10:13:44.034040+0000","last_peered":"2024-01-22T10:13:44.034040+0000","last_clean":"2024-01-22T10:13:44.034040+0000","last_became_active":"2024-01-22T10:13:42.630345+0000","last_became_peered":"2024-01-22T10:13:42.630345+0000","last_unstale":"2024-01-22T10:13:44.034040+0000","last_undegraded":"2024-01-22T10:13:44.034040+0000","last_fullsized":"2024-01-22T10:13:44.034040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:33:00.953623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.633167+0000","last_change":"2024-01-22T10:13:41.603385+0000","last_active":"2024-01-22T10:13:42.633167+0000","last_peered":"2024-01-22T10:13:42.633167+0000","last_clean":"2024-01-22T10:13:42.633167+0000","last_became_active":"2024-01-22T10:13:41.603096+0000","last_became_peered":"2024-01-22T10:13:41.603096+0000","last_unstale":"2024-01-22T10:13:42.633167+0000","last_undegraded":"2024-01-22T10:13:42.633167+0000","last_fullsized":"2024-01-22T10:13:42.633167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:52:13.557327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034134+0000","last_change":"2024-01-22T10:13:42.625780+0000","last_active":"2024-01-22T10:13:44.034134+0000","last_peered":"2024-01-22T10:13:44.034134+0000","last_clean":"2024-01-22T10:13:44.034134+0000","last_became_active":"2024-01-22T10:13:42.625524+0000","last_became_peered":"2024-01-22T10:13:42.625524+0000","last_unstale":"2024-01-22T10:13:44.034134+0000","last_undegraded":"2024-01-22T10:13:44.034134+0000","last_fullsized":"2024-01-22T10:13:44.034134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:45.241467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614787+0000","last_change":"2024-01-22T10:13:41.600994+0000","last_active":"2024-01-22T10:13:42.614787+0000","last_peered":"2024-01-22T10:13:42.614787+0000","last_clean":"2024-01-22T10:13:42.614787+0000","last_became_active":"2024-01-22T10:13:41.600704+0000","last_became_peered":"2024-01-22T10:13:41.600704+0000","last_unstale":"2024-01-22T10:13:42.614787+0000","last_undegraded":"2024-01-22T10:13:42.614787+0000","last_fullsized":"2024-01-22T10:13:42.614787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:54.870939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033907+0000","last_change":"2024-01-22T10:13:42.622896+0000","last_active":"2024-01-22T10:13:44.033907+0000","last_peered":"2024-01-22T10:13:44.033907+0000","last_clean":"2024-01-22T10:13:44.033907+0000","last_became_active":"2024-01-22T10:13:42.622631+0000","last_became_peered":"2024-01-22T10:13:42.622631+0000","last_unstale":"2024-01-22T10:13:44.033907+0000","last_undegraded":"2024-01-22T10:13:44.033907+0000","last_fullsized":"2024-01-22T10:13:44.033907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:43:02.897571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621795+0000","last_change":"2024-01-22T10:13:41.597586+0000","last_active":"2024-01-22T10:13:42.621795+0000","last_peered":"2024-01-22T10:13:42.621795+0000","last_clean":"2024-01-22T10:13:42.621795+0000","last_became_active":"2024-01-22T10:13:41.597324+0000","last_became_peered":"2024-01-22T10:13:41.597324+0000","last_unstale":"2024-01-22T10:13:42.621795+0000","last_undegraded":"2024-01-22T10:13:42.621795+0000","last_fullsized":"2024-01-22T10:13:42.621795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:43:01.895840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624510+0000","last_change":"2024-01-22T10:13:42.617670+0000","last_active":"2024-01-22T10:13:43.624510+0000","last_peered":"2024-01-22T10:13:43.624510+0000","last_clean":"2024-01-22T10:13:43.624510+0000","last_became_active":"2024-01-22T10:13:42.616992+0000","last_became_peered":"2024-01-22T10:13:42.616992+0000","last_unstale":"2024-01-22T10:13:43.624510+0000","last_undegraded":"2024-01-22T10:13:43.624510+0000","last_fullsized":"2024-01-22T10:13:43.624510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614491+0000","last_change":"2024-01-22T10:13:41.599431+0000","last_active":"2024-01-22T10:13:42.614491+0000","last_peered":"2024-01-22T10:13:42.614491+0000","last_clean":"2024-01-22T10:13:42.614491+0000","last_became_active":"2024-01-22T10:13:41.599008+0000","last_became_peered":"2024-01-22T10:13:41.599008+0000","last_unstale":"2024-01-22T10:13:42.614491+0000","last_undegraded":"2024-01-22T10:13:42.614491+0000","last_fullsized":"2024-01-22T10:13:42.614491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T22:02:40.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034455+0000","last_change":"2024-01-22T10:13:42.626317+0000","last_active":"2024-01-22T10:13:44.034455+0000","last_peered":"2024-01-22T10:13:44.034455+0000","last_clean":"2024-01-22T10:13:44.034455+0000","last_became_active":"2024-01-22T10:13:42.626088+0000","last_became_peered":"2024-01-22T10:13:42.626088+0000","last_unstale":"2024-01-22T10:13:44.034455+0000","last_undegraded":"2024-01-22T10:13:44.034455+0000","last_fullsized":"2024-01-22T10:13:44.034455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:39:36.530327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640956+0000","last_change":"2024-01-22T10:13:41.597369+0000","last_active":"2024-01-22T10:13:42.640956+0000","last_peered":"2024-01-22T10:13:42.640956+0000","last_clean":"2024-01-22T10:13:42.640956+0000","last_became_active":"2024-01-22T10:13:41.597126+0000","last_became_peered":"2024-01-22T10:13:41.597126+0000","last_unstale":"2024-01-22T10:13:42.640956+0000","last_undegraded":"2024-01-22T10:13:42.640956+0000","last_fullsized":"2024-01-22T10:13:42.640956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034664+0000","last_change":"2024-01-22T10:13:42.624684+0000","last_active":"2024-01-22T10:13:44.034664+0000","last_peered":"2024-01-22T10:13:44.034664+0000","last_clean":"2024-01-22T10:13:44.034664+0000","last_became_active":"2024-01-22T10:13:42.624431+0000","last_became_peered":"2024-01-22T10:13:42.624431+0000","last_unstale":"2024-01-22T10:13:44.034664+0000","last_undegraded":"2024-01-22T10:13:44.034664+0000","last_fullsized":"2024-01-22T10:13:44.034664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.612790+0000","last_change":"2024-01-22T10:13:41.603337+0000","last_active":"2024-01-22T10:13:43.612790+0000","last_peered":"2024-01-22T10:13:43.612790+0000","last_clean":"2024-01-22T10:13:43.612790+0000","last_became_active":"2024-01-22T10:13:41.602818+0000","last_became_peered":"2024-01-22T10:13:41.602818+0000","last_unstale":"2024-01-22T10:13:43.612790+0000","last_undegraded":"2024-01-22T10:13:43.612790+0000","last_fullsized":"2024-01-22T10:13:43.612790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033982+0000","last_change":"2024-01-22T10:13:42.626012+0000","last_active":"2024-01-22T10:13:44.033982+0000","last_peered":"2024-01-22T10:13:44.033982+0000","last_clean":"2024-01-22T10:13:44.033982+0000","last_became_active":"2024-01-22T10:13:42.625759+0000","last_became_peered":"2024-01-22T10:13:42.625759+0000","last_unstale":"2024-01-22T10:13:44.033982+0000","last_undegraded":"2024-01-22T10:13:44.033982+0000","last_fullsized":"2024-01-22T10:13:44.033982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.613216+0000","last_change":"2024-01-22T10:13:41.593779+0000","last_active":"2024-01-22T10:13:42.613216+0000","last_peered":"2024-01-22T10:13:42.613216+0000","last_clean":"2024-01-22T10:13:42.613216+0000","last_became_active":"2024-01-22T10:13:41.593469+0000","last_became_peered":"2024-01-22T10:13:41.593469+0000","last_unstale":"2024-01-22T10:13:42.613216+0000","last_undegraded":"2024-01-22T10:13:42.613216+0000","last_fullsized":"2024-01-22T10:13:42.613216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:52:13.557327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986594+0000","last_change":"2024-01-22T10:13:42.622705+0000","last_active":"2024-01-22T10:13:43.986594+0000","last_peered":"2024-01-22T10:13:43.986594+0000","last_clean":"2024-01-22T10:13:43.986594+0000","last_became_active":"2024-01-22T10:13:42.622464+0000","last_became_peered":"2024-01-22T10:13:42.622464+0000","last_unstale":"2024-01-22T10:13:43.986594+0000","last_undegraded":"2024-01-22T10:13:43.986594+0000","last_fullsized":"2024-01-22T10:13:43.986594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:22:34.853691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614866+0000","last_change":"2024-01-22T10:13:41.601304+0000","last_active":"2024-01-22T10:13:42.614866+0000","last_peered":"2024-01-22T10:13:42.614866+0000","last_clean":"2024-01-22T10:13:42.614866+0000","last_became_active":"2024-01-22T10:13:41.601010+0000","last_became_peered":"2024-01-22T10:13:41.601010+0000","last_unstale":"2024-01-22T10:13:42.614866+0000","last_undegraded":"2024-01-22T10:13:42.614866+0000","last_fullsized":"2024-01-22T10:13:42.614866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:33:12.832661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034206+0000","last_change":"2024-01-22T10:13:42.623113+0000","last_active":"2024-01-22T10:13:44.034206+0000","last_peered":"2024-01-22T10:13:44.034206+0000","last_clean":"2024-01-22T10:13:44.034206+0000","last_became_active":"2024-01-22T10:13:42.622855+0000","last_became_peered":"2024-01-22T10:13:42.622855+0000","last_unstale":"2024-01-22T10:13:44.034206+0000","last_undegraded":"2024-01-22T10:13:44.034206+0000","last_fullsized":"2024-01-22T10:13:44.034206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:21:10.389082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.612039+0000","last_change":"2024-01-22T10:13:41.597546+0000","last_active":"2024-01-22T10:13:42.612039+0000","last_peered":"2024-01-22T10:13:42.612039+0000","last_clean":"2024-01-22T10:13:42.612039+0000","last_became_active":"2024-01-22T10:13:41.597270+0000","last_became_peered":"2024-01-22T10:13:41.597270+0000","last_unstale":"2024-01-22T10:13:42.612039+0000","last_undegraded":"2024-01-22T10:13:42.612039+0000","last_fullsized":"2024-01-22T10:13:42.612039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:33:12.832661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624046+0000","last_change":"2024-01-22T10:13:42.623605+0000","last_active":"2024-01-22T10:13:43.624046+0000","last_peered":"2024-01-22T10:13:43.624046+0000","last_clean":"2024-01-22T10:13:43.624046+0000","last_became_active":"2024-01-22T10:13:42.623331+0000","last_became_peered":"2024-01-22T10:13:42.623331+0000","last_unstale":"2024-01-22T10:13:43.624046+0000","last_undegraded":"2024-01-22T10:13:43.624046+0000","last_fullsized":"2024-01-22T10:13:43.624046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621970+0000","last_change":"2024-01-22T10:13:41.596973+0000","last_active":"2024-01-22T10:13:42.621970+0000","last_peered":"2024-01-22T10:13:42.621970+0000","last_clean":"2024-01-22T10:13:42.621970+0000","last_became_active":"2024-01-22T10:13:41.596639+0000","last_became_peered":"2024-01-22T10:13:41.596639+0000","last_unstale":"2024-01-22T10:13:42.621970+0000","last_undegraded":"2024-01-22T10:13:42.621970+0000","last_fullsized":"2024-01-22T10:13:42.621970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:32:59.951892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034916+0000","last_change":"2024-01-22T10:13:42.637594+0000","last_active":"2024-01-22T10:13:44.034916+0000","last_peered":"2024-01-22T10:13:44.034916+0000","last_clean":"2024-01-22T10:13:44.034916+0000","last_became_active":"2024-01-22T10:13:42.637152+0000","last_became_peered":"2024-01-22T10:13:42.637152+0000","last_unstale":"2024-01-22T10:13:44.034916+0000","last_undegraded":"2024-01-22T10:13:44.034916+0000","last_fullsized":"2024-01-22T10:13:44.034916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.610626+0000","last_change":"2024-01-22T10:13:41.600670+0000","last_active":"2024-01-22T10:13:42.610626+0000","last_peered":"2024-01-22T10:13:42.610626+0000","last_clean":"2024-01-22T10:13:42.610626+0000","last_became_active":"2024-01-22T10:13:41.600181+0000","last_became_peered":"2024-01-22T10:13:41.600181+0000","last_unstale":"2024-01-22T10:13:42.610626+0000","last_undegraded":"2024-01-22T10:13:42.610626+0000","last_fullsized":"2024-01-22T10:13:42.610626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:23:17.918061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624601+0000","last_change":"2024-01-22T10:13:42.626739+0000","last_active":"2024-01-22T10:13:43.624601+0000","last_peered":"2024-01-22T10:13:43.624601+0000","last_clean":"2024-01-22T10:13:43.624601+0000","last_became_active":"2024-01-22T10:13:42.626445+0000","last_became_peered":"2024-01-22T10:13:42.626445+0000","last_unstale":"2024-01-22T10:13:43.624601+0000","last_undegraded":"2024-01-22T10:13:43.624601+0000","last_fullsized":"2024-01-22T10:13:43.624601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.613827+0000","last_change":"2024-01-22T10:13:41.600294+0000","last_active":"2024-01-22T10:13:42.613827+0000","last_peered":"2024-01-22T10:13:42.613827+0000","last_clean":"2024-01-22T10:13:42.613827+0000","last_became_active":"2024-01-22T10:13:41.599985+0000","last_became_peered":"2024-01-22T10:13:41.599985+0000","last_unstale":"2024-01-22T10:13:42.613827+0000","last_undegraded":"2024-01-22T10:13:42.613827+0000","last_fullsized":"2024-01-22T10:13:42.613827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:47.541129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.609823+0000","last_change":"2024-01-22T10:12:52.033359+0000","last_active":"2024-01-22T10:13:42.609823+0000","last_peered":"2024-01-22T10:13:42.609823+0000","last_clean":"2024-01-22T10:13:42.609823+0000","last_became_active":"2024-01-22T10:12:52.033101+0000","last_became_peered":"2024-01-22T10:12:52.033101+0000","last_unstale":"2024-01-22T10:13:42.609823+0000","last_undegraded":"2024-01-22T10:13:42.609823+0000","last_fullsized":"2024-01-22T10:13:42.609823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_clean_scrub_stamp":"2024-01-22T10:12:51.022957+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:45:37.023233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3651,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":719503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.61699999999999999}]},{"osd":1,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.497},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.66300000000000003}]},{"osd":2,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.441},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.46500000000000002}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59799999999999998}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.40500000000000003}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.371}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":130933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":129115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":130933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":719413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T10:13:56.119 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-22T10:13:56.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.271+0000 7fd4eca15640 1 Processor -- start 2024-01-22T10:13:56.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.271+0000 7fd4eca15640 1 -- start start 2024-01-22T10:13:56.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4eca15640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4e8141920 0x7fd4e8148550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:56.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4eca15640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4e80b22c0 0x7fd4e80b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:56.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4eca15640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e81480c0 con 0x7fd4e80b3f70 2024-01-22T10:13:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4eca15640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e80b2750 con 0x7fd4e8141920 2024-01-22T10:13:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4eca15640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80b4500 con 0x7fd4e80b22c0 2024-01-22T10:13:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4e659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4e8141920 0x7fd4e8148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4e659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd4e8141920 0x7fd4e8148550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45594/0 (socket says 172.21.15.88:45594) 2024-01-22T10:13:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4e659c640 1 -- 172.21.15.88:0/2975849714 learned_addr learned my addr 172.21.15.88:0/2975849714 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4e5d9b640 1 --1- 172.21.15.88:0/2975849714 >> v1:172.21.15.88:6789/0 conn(0x7fd4e80b3f70 0x7fd4e80b69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46628/0 (socket says 172.21.15.88:46628) 2024-01-22T10:13:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4e6d9d640 1 --2- 172.21.15.88:0/2975849714 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4e80b22c0 0x7fd4e80b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4e659c640 1 -- 172.21.15.88:0/2975849714 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4e80b22c0 msgr2=0x7fd4e80b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4e659c640 1 --2- 172.21.15.88:0/2975849714 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4e80b22c0 0x7fd4e80b5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4e659c640 1 -- 172.21.15.88:0/2975849714 >> v1:172.21.15.88:6789/0 conn(0x7fd4e80b3f70 legacy=0x7fd4e80b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.272+0000 7fd4e659c640 1 -- 172.21.15.88:0/2975849714 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e8147a70 con 0x7fd4e8141920 2024-01-22T10:13:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.273+0000 7fd4e659c640 1 --2- 172.21.15.88:0/2975849714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e8141920 0x7fd4e8148550 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009870 tx=0x7fd4d802ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e46efaa2d602e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.273+0000 7fd4e559a640 1 -- 172.21.15.88:0/2975849714 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d802e850 con 0x7fd4e8141920 2024-01-22T10:13:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.273+0000 7fd4e559a640 1 -- 172.21.15.88:0/2975849714 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d802e9b0 con 0x7fd4e8141920 2024-01-22T10:13:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.273+0000 7fd4e559a640 1 -- 172.21.15.88:0/2975849714 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d802ed40 con 0x7fd4e8141920 2024-01-22T10:13:56.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.274+0000 7fd4eca15640 1 -- 172.21.15.88:0/2975849714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e8141920 msgr2=0x7fd4e8148550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:56.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.274+0000 7fd4eca15640 1 --2- 172.21.15.88:0/2975849714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e8141920 0x7fd4e8148550 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009870 tx=0x7fd4d802ca90 comp rx=0 tx=0).stop 2024-01-22T10:13:56.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.274+0000 7fd4eca15640 1 -- 172.21.15.88:0/2975849714 shutdown_connections 2024-01-22T10:13:56.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.274+0000 7fd4eca15640 1 --2- 172.21.15.88:0/2975849714 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4e80b22c0 0x7fd4e80b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.274+0000 7fd4eca15640 1 --2- 172.21.15.88:0/2975849714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e8141920 0x7fd4e8148550 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.274+0000 7fd4eca15640 1 -- 172.21.15.88:0/2975849714 >> 172.21.15.88:0/2975849714 conn(0x7fd4e806acf0 msgr2=0x7fd4e80bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:56.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.274+0000 7fd4eca15640 1 -- 172.21.15.88:0/2975849714 shutdown_connections 2024-01-22T10:13:56.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.274+0000 7fd4eca15640 1 -- 172.21.15.88:0/2975849714 wait complete. 2024-01-22T10:13:56.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.275+0000 7fd4eca15640 1 Processor -- start 2024-01-22T10:13:56.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.275+0000 7fd4eca15640 1 -- start start 2024-01-22T10:13:56.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4eca15640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4e80b22c0 0x7fd4e81e4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:56.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4eca15640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e80b3f70 0x7fd4e81d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:56.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4eca15640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4e8141920 0x7fd4e8146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:56.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4eca15640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8146ca0 con 0x7fd4e80b3f70 2024-01-22T10:13:56.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4eca15640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e81d4b50 con 0x7fd4e8141920 2024-01-22T10:13:56.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4eca15640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80bbb80 con 0x7fd4e80b22c0 2024-01-22T10:13:56.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4e5d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e80b3f70 0x7fd4e81d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:56.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4e5d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e80b3f70 0x7fd4e81d38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45610/0 (socket says 172.21.15.88:45610) 2024-01-22T10:13:56.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4e5d9b640 1 -- 172.21.15.88:0/4093372075 learned_addr learned my addr 172.21.15.88:0/4093372075 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:56.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4e6d9d640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4e8141920 0x7fd4e8146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:56.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4e659c640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4e80b22c0 0x7fd4e81e4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:56.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4e5d9b640 1 -- 172.21.15.88:0/4093372075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4e80b22c0 msgr2=0x7fd4e81e4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:56.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4e5d9b640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4e80b22c0 0x7fd4e81e4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4e5d9b640 1 -- 172.21.15.88:0/4093372075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4e8141920 msgr2=0x7fd4e8146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:56.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4e5d9b640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4e8141920 0x7fd4e8146760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4e5d9b640 1 -- 172.21.15.88:0/4093372075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d80094d0 con 0x7fd4e80b3f70 2024-01-22T10:13:56.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4e659c640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4e80b22c0 0x7fd4e81e4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:56.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4e5d9b640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e80b3f70 0x7fd4e81d38a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c4d0 tx=0x7fd4dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:56.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4d6ffd640 1 -- 172.21.15.88:0/4093372075 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc007480 con 0x7fd4e80b3f70 2024-01-22T10:13:56.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4d6ffd640 1 -- 172.21.15.88:0/4093372075 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc0075e0 con 0x7fd4e80b3f70 2024-01-22T10:13:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4eca15640 1 -- 172.21.15.88:0/4093372075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e81d25f0 con 0x7fd4e80b3f70 2024-01-22T10:13:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4d6ffd640 1 -- 172.21.15.88:0/4093372075 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0049e0 con 0x7fd4e80b3f70 2024-01-22T10:13:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.276+0000 7fd4eca15640 1 -- 172.21.15.88:0/4093372075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e81d2c40 con 0x7fd4e80b3f70 2024-01-22T10:13:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.277+0000 7fd4eca15640 1 -- 172.21.15.88:0/4093372075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e81d3620 con 0x7fd4e80b3f70 2024-01-22T10:13:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.278+0000 7fd4d6ffd640 1 -- 172.21.15.88:0/4093372075 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fd4dc004b40 con 0x7fd4e80b3f70 2024-01-22T10:13:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.278+0000 7fd4d6ffd640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd4c806b360 0x7fd4c806d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.278+0000 7fd4d6ffd640 1 -- 172.21.15.88:0/4093372075 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4dc089000 con 0x7fd4e80b3f70 2024-01-22T10:13:56.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.278+0000 7fd4e659c640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd4c806b360 0x7fd4c806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.278+0000 7fd4e659c640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd4c806b360 0x7fd4c806d820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8037000 tx=0x7fd4d803a040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:56.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.282+0000 7fd4d6ffd640 1 -- 172.21.15.88:0/4093372075 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd4dc053d20 con 0x7fd4e80b3f70 2024-01-22T10:13:56.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.450+0000 7fd4eca15640 1 -- 172.21.15.88:0/4093372075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4e804ea30 con 0x7fd4e80b3f70 2024-01-22T10:13:56.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.451+0000 7fd4d6ffd640 1 -- 172.21.15.88:0/4093372075 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16546 (secure 0 0 0) 0x7fd4dc018090 con 0x7fd4e80b3f70 2024-01-22T10:13:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:13:56.434 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":30,"fsid":"f2d9b200-f96e-479f-bf7c-16080c3af8a6","created":"2024-01-22T10:12:38.731242+0000","modified":"2024-01-22T10:13:43.614634+0000","last_up_change":"2024-01-22T10:12:49.785857+0000","last_in_change":"2024-01-22T10:12:40.981632+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-22T10:12:50.745945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-22T10:13:40.282454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-22T10:13:40.901002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"02049f9d-7ab6-4005-a006-c5dc79c82983","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6801","nonce":3205918640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6803","nonce":3205918640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6807","nonce":3205918640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3205918640},{"type":"v1","addr":"172.21.15.88:6805","nonce":3205918640}]},"public_addr":"172.21.15.88:6801/3205918640","cluster_addr":"172.21.15.88:6803/3205918640","heartbeat_back_addr":"172.21.15.88:6807/3205918640","heartbeat_front_addr":"172.21.15.88:6805/3205918640","state":["exists","up"]},{"osd":1,"uuid":"dd14b1ba-d048-4a3c-b3ce-788dba5a4771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6809","nonce":398753072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6812","nonce":398753072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6820","nonce":398753072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":398753072},{"type":"v1","addr":"172.21.15.88:6816","nonce":398753072}]},"public_addr":"172.21.15.88:6809/398753072","cluster_addr":"172.21.15.88:6812/398753072","heartbeat_back_addr":"172.21.15.88:6820/398753072","heartbeat_front_addr":"172.21.15.88:6816/398753072","state":["exists","up"]},{"osd":2,"uuid":"d4ad137b-6e61-475a-a670-7e83088441a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6825","nonce":1293056926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6827","nonce":1293056926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6831","nonce":1293056926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1293056926},{"type":"v1","addr":"172.21.15.88:6829","nonce":1293056926}]},"public_addr":"172.21.15.88:6825/1293056926","cluster_addr":"172.21.15.88:6827/1293056926","heartbeat_back_addr":"172.21.15.88:6831/1293056926","heartbeat_front_addr":"172.21.15.88:6829/1293056926","state":["exists","up"]},{"osd":3,"uuid":"f4df3d72-db57-4750-95d8-815dc00450df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6811","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6813","nonce":1947300237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6815","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6817","nonce":1947300237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6823","nonce":1947300237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6819","nonce":1947300237},{"type":"v1","addr":"172.21.15.88:6821","nonce":1947300237}]},"public_addr":"172.21.15.88:6813/1947300237","cluster_addr":"172.21.15.88:6817/1947300237","heartbeat_back_addr":"172.21.15.88:6823/1947300237","heartbeat_front_addr":"172.21.15.88:6821/1947300237","state":["exists","up"]},{"osd":4,"uuid":"713e1bcc-7b75-4a4f-b7a5-355d66a50d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6801","nonce":4248437697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6803","nonce":4248437697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6807","nonce":4248437697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":4248437697},{"type":"v1","addr":"172.21.15.119:6805","nonce":4248437697}]},"public_addr":"172.21.15.119:6801/4248437697","cluster_addr":"172.21.15.119:6803/4248437697","heartbeat_back_addr":"172.21.15.119:6807/4248437697","heartbeat_front_addr":"172.21.15.119:6805/4248437697","state":["exists","up"]},{"osd":5,"uuid":"697c6b66-3193-4096-bb71-3b9c084ef899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6809","nonce":24229537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6811","nonce":24229537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6815","nonce":24229537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24229537},{"type":"v1","addr":"172.21.15.119:6813","nonce":24229537}]},"public_addr":"172.21.15.119:6809/24229537","cluster_addr":"172.21.15.119:6811/24229537","heartbeat_back_addr":"172.21.15.119:6815/24229537","heartbeat_front_addr":"172.21.15.119:6813/24229537","state":["exists","up"]},{"osd":6,"uuid":"ff1eade6-459c-4eb2-87fc-ce162bdd81a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6819","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6821","nonce":3033097923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6823","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6825","nonce":3033097923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6831","nonce":3033097923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6827","nonce":3033097923},{"type":"v1","addr":"172.21.15.119:6829","nonce":3033097923}]},"public_addr":"172.21.15.119:6821/3033097923","cluster_addr":"172.21.15.119:6825/3033097923","heartbeat_back_addr":"172.21.15.119:6831/3033097923","heartbeat_front_addr":"172.21.15.119:6829/3033097923","state":["exists","up"]},{"osd":7,"uuid":"371cc98f-aadb-4367-bf00-a05c1c9e0a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6817","nonce":3533070748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6820","nonce":3533070748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6828","nonce":3533070748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3533070748},{"type":"v1","addr":"172.21.15.119:6824","nonce":3533070748}]},"public_addr":"172.21.15.119:6817/3533070748","cluster_addr":"172.21.15.119:6820/3533070748","heartbeat_back_addr":"172.21.15.119:6828/3533070748","heartbeat_front_addr":"172.21.15.119:6824/3533070748","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.097342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.115225+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.112082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.093361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.011453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.057718+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.222805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-22T10:12:46.147549+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-22T10:13:56.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.453+0000 7fd4eca15640 1 -- 172.21.15.88:0/4093372075 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd4c806b360 msgr2=0x7fd4c806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:56.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.453+0000 7fd4eca15640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd4c806b360 0x7fd4c806d820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8037000 tx=0x7fd4d803a040 comp rx=0 tx=0).stop 2024-01-22T10:13:56.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.453+0000 7fd4eca15640 1 -- 172.21.15.88:0/4093372075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e80b3f70 msgr2=0x7fd4e81d38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:56.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.453+0000 7fd4eca15640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e80b3f70 0x7fd4e81d38a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c4d0 tx=0x7fd4dc00c990 comp rx=0 tx=0).stop 2024-01-22T10:13:56.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.453+0000 7fd4eca15640 1 -- 172.21.15.88:0/4093372075 shutdown_connections 2024-01-22T10:13:56.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.453+0000 7fd4eca15640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fd4c806b360 0x7fd4c806d820 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.453+0000 7fd4eca15640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd4e8141920 0x7fd4e8146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.453+0000 7fd4eca15640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e80b3f70 0x7fd4e81d38a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.453+0000 7fd4eca15640 1 --2- 172.21.15.88:0/4093372075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd4e80b22c0 0x7fd4e81e4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:56.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.453+0000 7fd4eca15640 1 -- 172.21.15.88:0/4093372075 >> 172.21.15.88:0/4093372075 conn(0x7fd4e806acf0 msgr2=0x7fd4e81d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:56.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.453+0000 7fd4eca15640 1 -- 172.21.15.88:0/4093372075 shutdown_connections 2024-01-22T10:13:56.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:56.453+0000 7fd4eca15640 1 -- 172.21.15.88:0/4093372075 wait complete. 2024-01-22T10:13:57.447 INFO:tasks.ceph:Scrubbing osd.0 2024-01-22T10:13:57.447 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-22T10:13:57.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.579+0000 7f9b5e5a9640 1 Processor -- start 2024-01-22T10:13:57.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.579+0000 7f9b5e5a9640 1 -- start start 2024-01-22T10:13:57.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b5e5a9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b580c06c0 0x7f9b5806a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b5e5a9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b580b4590 0x7f9b58148c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b5e5a9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b580bd720 con 0x7f9b58149160 2024-01-22T10:13:57.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b5e5a9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b580bbbd0 con 0x7f9b580c06c0 2024-01-22T10:13:57.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b5e5a9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b580be080 con 0x7f9b580b4590 2024-01-22T10:13:57.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b57fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b580c06c0 0x7f9b5806a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b57fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b580c06c0 0x7f9b5806a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46284/0 (socket says 172.21.15.88:46284) 2024-01-22T10:13:57.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b57fff640 1 -- 172.21.15.88:0/3861536570 learned_addr learned my addr 172.21.15.88:0/3861536570 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:57.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b57fff640 1 -- 172.21.15.88:0/3861536570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b580b4590 msgr2=0x7f9b58148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:57.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b577fe640 1 --2- 172.21.15.88:0/3861536570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b580b4590 0x7f9b58148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b57fff640 1 --2- 172.21.15.88:0/3861536570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b580b4590 0x7f9b58148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b57fff640 1 -- 172.21.15.88:0/3861536570 >> v1:172.21.15.119:6789/0 conn(0x7f9b58149160 legacy=0x7f9b5814ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:57.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b57fff640 1 -- 172.21.15.88:0/3861536570 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b580be360 con 0x7f9b580c06c0 2024-01-22T10:13:57.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.580+0000 7f9b577fe640 1 --2- 172.21.15.88:0/3861536570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b580b4590 0x7f9b58148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:57.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.581+0000 7f9b57fff640 1 --2- 172.21.15.88:0/3861536570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b580c06c0 0x7f9b5806a9e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009850 tx=0x7f9b4802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4125faad452a9c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:57.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.581+0000 7f9b56ffd640 1 -- 172.21.15.88:0/3861536570 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48004230 con 0x7f9b580c06c0 2024-01-22T10:13:57.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.581+0000 7f9b56ffd640 1 -- 172.21.15.88:0/3861536570 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b48004390 con 0x7f9b580c06c0 2024-01-22T10:13:57.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.581+0000 7f9b56ffd640 1 -- 172.21.15.88:0/3861536570 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48031830 con 0x7f9b580c06c0 2024-01-22T10:13:57.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.581+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/3861536570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b580c06c0 msgr2=0x7f9b5806a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:57.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.581+0000 7f9b5e5a9640 1 --2- 172.21.15.88:0/3861536570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b580c06c0 0x7f9b5806a9e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009850 tx=0x7f9b4802b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.581+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/3861536570 shutdown_connections 2024-01-22T10:13:57.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.581+0000 7f9b5e5a9640 1 --2- 172.21.15.88:0/3861536570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b580b4590 0x7f9b58148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.581+0000 7f9b5e5a9640 1 --2- 172.21.15.88:0/3861536570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b580c06c0 0x7f9b5806a9e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.581+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/3861536570 >> 172.21.15.88:0/3861536570 conn(0x7f9b580a2d70 msgr2=0x7f9b580a3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:57.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.582+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/3861536570 shutdown_connections 2024-01-22T10:13:57.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.582+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/3861536570 wait complete. 2024-01-22T10:13:57.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.582+0000 7f9b5e5a9640 1 Processor -- start 2024-01-22T10:13:57.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.583+0000 7f9b5e5a9640 1 -- start start 2024-01-22T10:13:57.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.583+0000 7f9b5e5a9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b580b4590 0x7f9b580b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.583+0000 7f9b5e5a9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b580c06c0 0x7f9b5814ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.583+0000 7f9b5e5a9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b58149160 0x7f9b581e4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.583+0000 7f9b5e5a9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5814f2a0 con 0x7f9b58149160 2024-01-22T10:13:57.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.583+0000 7f9b5e5a9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b581e22d0 con 0x7f9b580b4590 2024-01-22T10:13:57.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.583+0000 7f9b5e5a9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b581e2760 con 0x7f9b580c06c0 2024-01-22T10:13:57.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.583+0000 7f9b5cb46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b58149160 0x7f9b581e4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.583+0000 7f9b5cb46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b58149160 0x7f9b581e4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46300/0 (socket says 172.21.15.88:46300) 2024-01-22T10:13:57.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.583+0000 7f9b5cb46640 1 -- 172.21.15.88:0/2234860055 learned_addr learned my addr 172.21.15.88:0/2234860055 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:57.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b57fff640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b580b4590 0x7f9b580b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b577fe640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b580c06c0 0x7f9b5814ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b5cb46640 1 -- 172.21.15.88:0/2234860055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b580c06c0 msgr2=0x7f9b5814ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:57.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b5cb46640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b580c06c0 0x7f9b5814ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b5cb46640 1 -- 172.21.15.88:0/2234860055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b580b4590 msgr2=0x7f9b580b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:57.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b5cb46640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b580b4590 0x7f9b580b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b5cb46640 1 -- 172.21.15.88:0/2234860055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b48009460 con 0x7f9b58149160 2024-01-22T10:13:57.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b5cb46640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b58149160 0x7f9b581e4d70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000b970 tx=0x7f9b5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:57.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b54ff9640 1 -- 172.21.15.88:0/2234860055 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5000cb40 con 0x7f9b58149160 2024-01-22T10:13:57.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b54ff9640 1 -- 172.21.15.88:0/2234860055 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5000cca0 con 0x7f9b58149160 2024-01-22T10:13:57.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/2234860055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b581e19a0 con 0x7f9b58149160 2024-01-22T10:13:57.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b54ff9640 1 -- 172.21.15.88:0/2234860055 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b50014680 con 0x7f9b58149160 2024-01-22T10:13:57.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.584+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/2234860055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b581e1f60 con 0x7f9b58149160 2024-01-22T10:13:57.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.585+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/2234860055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b580a3ae0 con 0x7f9b58149160 2024-01-22T10:13:57.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.586+0000 7f9b54ff9640 1 -- 172.21.15.88:0/2234860055 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f9b5001d3b0 con 0x7f9b58149160 2024-01-22T10:13:57.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.586+0000 7f9b54ff9640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9b4406b330 0x7f9b4406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.586+0000 7f9b54ff9640 1 -- 172.21.15.88:0/2234860055 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b50089970 con 0x7f9b58149160 2024-01-22T10:13:57.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.586+0000 7f9b57fff640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9b4406b330 0x7f9b4406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.586+0000 7f9b54ff9640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] conn(0x7f9b440734d0 0x7f9b440758f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.586+0000 7f9b54ff9640 1 -- 172.21.15.88:0/2234860055 --> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b44075fa0 con 0x7f9b440734d0 2024-01-22T10:13:57.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.586+0000 7f9b54ff9640 1 -- 172.21.15.88:0/2234860055 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b5008e2a0 con 0x7f9b58149160 2024-01-22T10:13:57.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.586+0000 7f9b577fe640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] conn(0x7f9b440734d0 0x7f9b440758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.586+0000 7f9b57fff640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9b4406b330 0x7f9b4406d7f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b48035000 tx=0x7f9b48008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:57.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.587+0000 7f9b577fe640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] conn(0x7f9b440734d0 0x7f9b440758f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:57.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.587+0000 7f9b54ff9640 1 -- 172.21.15.88:0/2234860055 <== osd.0 v2:172.21.15.88:6800/3205918640 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9b44075fa0 con 0x7f9b440734d0 2024-01-22T10:13:57.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.601+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/2234860055 --> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9b580c0aa0 con 0x7f9b440734d0 2024-01-22T10:13:57.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.602+0000 7f9b54ff9640 1 -- 172.21.15.88:0/2234860055 <== osd.0 v2:172.21.15.88:6800/3205918640 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9b4c00c040 con 0x7f9b440734d0 2024-01-22T10:13:57.585 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-01-22T10:13:57.585 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-22T10:13:57.585 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-01-22T10:13:57.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.602+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] conn(0x7f9b440734d0 msgr2=0x7f9b440758f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:57.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.602+0000 7f9b5e5a9640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:6800/3205918640,v1:172.21.15.88:6801/3205918640] conn(0x7f9b440734d0 0x7f9b440758f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.602+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9b4406b330 msgr2=0x7f9b4406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:57.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.602+0000 7f9b5e5a9640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9b4406b330 0x7f9b4406d7f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b48035000 tx=0x7f9b48008030 comp rx=0 tx=0).stop 2024-01-22T10:13:57.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.602+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b58149160 msgr2=0x7f9b581e4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:57.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.602+0000 7f9b5e5a9640 1 --2- 172.21.15.88:0/2234860055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b58149160 0x7f9b581e4d70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000b970 tx=0x7f9b5000be30 comp rx=0 tx=0).stop 2024-01-22T10:13:57.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.602+0000 7f9b5cb46640 1 -- 172.21.15.88:0/2234860055 reap_dead start 2024-01-22T10:13:57.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.602+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/2234860055 shutdown_connections 2024-01-22T10:13:57.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.602+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/2234860055 >> 172.21.15.88:0/2234860055 conn(0x7f9b580a2d70 msgr2=0x7f9b580a59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:57.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.602+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/2234860055 shutdown_connections 2024-01-22T10:13:57.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.602+0000 7f9b5e5a9640 1 -- 172.21.15.88:0/2234860055 wait complete. 2024-01-22T10:13:57.595 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-22T10:13:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.713+0000 7f21755a4640 1 Processor -- start 2024-01-22T10:13:57.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.713+0000 7f21755a4640 1 -- start start 2024-01-22T10:13:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f21755a4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21700b89f0 0x7f21700b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f21755a4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f217006f320 0x7f217006e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f21755a4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f217006e960 0x7f2170143280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f21755a4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217006fee0 con 0x7f21700b89f0 2024-01-22T10:13:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f21755a4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700b57a0 con 0x7f217006f320 2024-01-22T10:13:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f21755a4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21700b5380 con 0x7f217006e960 2024-01-22T10:13:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f216effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21700b89f0 0x7f21700b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f216effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21700b89f0 0x7f21700b8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46316/0 (socket says 172.21.15.88:46316) 2024-01-22T10:13:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f216effd640 1 -- 172.21.15.88:0/2879313708 learned_addr learned my addr 172.21.15.88:0/2879313708 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f216e7fc640 1 --2- 172.21.15.88:0/2879313708 >> v2:172.21.15.119:3300/0 conn(0x7f217006f320 0x7f217006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f216f7fe640 1 --2- 172.21.15.88:0/2879313708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f217006e960 0x7f2170143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f216effd640 1 -- 172.21.15.88:0/2879313708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f217006e960 msgr2=0x7f2170143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f216effd640 1 --2- 172.21.15.88:0/2879313708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f217006e960 0x7f2170143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f216effd640 1 -- 172.21.15.88:0/2879313708 >> v2:172.21.15.119:3300/0 conn(0x7f217006f320 msgr2=0x7f217006e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f216effd640 1 --2- 172.21.15.88:0/2879313708 >> v2:172.21.15.119:3300/0 conn(0x7f217006f320 0x7f217006e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.714+0000 7f216effd640 1 -- 172.21.15.88:0/2879313708 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700b5a20 con 0x7f21700b89f0 2024-01-22T10:13:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.715+0000 7f216effd640 1 --2- 172.21.15.88:0/2879313708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21700b89f0 0x7f21700b8dd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f21700b4fd0 tx=0x7f216002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b736b1a9f2c3507 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.715+0000 7f216dffb640 1 -- 172.21.15.88:0/2879313708 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160030860 con 0x7f21700b89f0 2024-01-22T10:13:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.715+0000 7f216dffb640 1 -- 172.21.15.88:0/2879313708 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21600309c0 con 0x7f21700b89f0 2024-01-22T10:13:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.715+0000 7f216dffb640 1 -- 172.21.15.88:0/2879313708 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160030d50 con 0x7f21700b89f0 2024-01-22T10:13:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.715+0000 7f21755a4640 1 -- 172.21.15.88:0/2879313708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21700b89f0 msgr2=0x7f21700b8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.715+0000 7f21755a4640 1 --2- 172.21.15.88:0/2879313708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21700b89f0 0x7f21700b8dd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f21700b4fd0 tx=0x7f216002b9a0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.716+0000 7f21755a4640 1 -- 172.21.15.88:0/2879313708 shutdown_connections 2024-01-22T10:13:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.716+0000 7f21755a4640 1 --2- 172.21.15.88:0/2879313708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f217006e960 0x7f2170143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.716+0000 7f21755a4640 1 --2- 172.21.15.88:0/2879313708 >> v2:172.21.15.119:3300/0 conn(0x7f217006f320 0x7f217006e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.716+0000 7f21755a4640 1 --2- 172.21.15.88:0/2879313708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21700b89f0 0x7f21700b8dd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.716+0000 7f21755a4640 1 -- 172.21.15.88:0/2879313708 >> 172.21.15.88:0/2879313708 conn(0x7f21700bb780 msgr2=0x7f21700bbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.716+0000 7f21755a4640 1 -- 172.21.15.88:0/2879313708 shutdown_connections 2024-01-22T10:13:57.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.716+0000 7f21755a4640 1 -- 172.21.15.88:0/2879313708 wait complete. 2024-01-22T10:13:57.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.717+0000 7f21755a4640 1 Processor -- start 2024-01-22T10:13:57.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.717+0000 7f21755a4640 1 -- start start 2024-01-22T10:13:57.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.717+0000 7f21755a4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f217006e960 0x7f21701462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.717+0000 7f21755a4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217006f320 0x7f2170143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.717+0000 7f21755a4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21700b89f0 0x7f21701e2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.717+0000 7f21755a4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217014a370 con 0x7f21700b89f0 2024-01-22T10:13:57.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.717+0000 7f21755a4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2170144090 con 0x7f217006f320 2024-01-22T10:13:57.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.717+0000 7f21755a4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21701445e0 con 0x7f217006e960 2024-01-22T10:13:57.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.717+0000 7f216f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21700b89f0 0x7f21701e2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.717+0000 7f216f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21700b89f0 0x7f21701e2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46332/0 (socket says 172.21.15.88:46332) 2024-01-22T10:13:57.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.717+0000 7f216f7fe640 1 -- 172.21.15.88:0/1647334399 learned_addr learned my addr 172.21.15.88:0/1647334399 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:57.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f216effd640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f217006e960 0x7f21701462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f216e7fc640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217006f320 0x7f2170143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f216f7fe640 1 -- 172.21.15.88:0/1647334399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f217006e960 msgr2=0x7f21701462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:57.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f216f7fe640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f217006e960 0x7f21701462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f216f7fe640 1 -- 172.21.15.88:0/1647334399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217006f320 msgr2=0x7f2170143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:57.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f216f7fe640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217006f320 0x7f2170143b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f216f7fe640 1 -- 172.21.15.88:0/1647334399 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21600094d0 con 0x7f21700b89f0 2024-01-22T10:13:57.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f216f7fe640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21700b89f0 0x7f21701e2680 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2168007d50 tx=0x7f216800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:57.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f21577fe640 1 -- 172.21.15.88:0/1647334399 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168014420 con 0x7f21700b89f0 2024-01-22T10:13:57.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f21577fe640 1 -- 172.21.15.88:0/1647334399 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21680145a0 con 0x7f21700b89f0 2024-01-22T10:13:57.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f21755a4640 1 -- 172.21.15.88:0/1647334399 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21700b7c30 con 0x7f21700b89f0 2024-01-22T10:13:57.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f21577fe640 1 -- 172.21.15.88:0/1647334399 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168014950 con 0x7f21700b89f0 2024-01-22T10:13:57.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.718+0000 7f21755a4640 1 -- 172.21.15.88:0/1647334399 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21701e2160 con 0x7f21700b89f0 2024-01-22T10:13:57.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.719+0000 7f21755a4640 1 -- 172.21.15.88:0/1647334399 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217004ea30 con 0x7f21700b89f0 2024-01-22T10:13:57.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.719+0000 7f21577fe640 1 -- 172.21.15.88:0/1647334399 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f2168014ab0 con 0x7f21700b89f0 2024-01-22T10:13:57.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.720+0000 7f21577fe640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f215c06b330 0x7f215c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.720+0000 7f21577fe640 1 -- 172.21.15.88:0/1647334399 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f216808a430 con 0x7f21700b89f0 2024-01-22T10:13:57.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.720+0000 7f216effd640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f215c06b330 0x7f215c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.720+0000 7f216effd640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f215c06b330 0x7f215c06d7f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2160036000 tx=0x7f2160008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:57.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.724+0000 7f21577fe640 1 -- 172.21.15.88:0/1647334399 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f21680550c0 con 0x7f21700b89f0 2024-01-22T10:13:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.892+0000 7f21755a4640 1 -- 172.21.15.88:0/1647334399 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f217006f9c0 con 0x7f215c06b330 2024-01-22T10:13:57.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.893+0000 7f21577fe640 1 -- 172.21.15.88:0/1647334399 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f217006f9c0 con 0x7f215c06b330 2024-01-22T10:13:57.876 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 0 to deep-scrub 2024-01-22T10:13:57.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.895+0000 7f21755a4640 1 -- 172.21.15.88:0/1647334399 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f215c06b330 msgr2=0x7f215c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.895+0000 7f21755a4640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f215c06b330 0x7f215c06d7f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2160036000 tx=0x7f2160008030 comp rx=0 tx=0).stop 2024-01-22T10:13:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.895+0000 7f21755a4640 1 -- 172.21.15.88:0/1647334399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21700b89f0 msgr2=0x7f21701e2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.895+0000 7f21755a4640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21700b89f0 0x7f21701e2680 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2168007d50 tx=0x7f216800e4b0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.895+0000 7f21755a4640 1 -- 172.21.15.88:0/1647334399 shutdown_connections 2024-01-22T10:13:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.895+0000 7f21755a4640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f215c06b330 0x7f215c06d7f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.895+0000 7f21755a4640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21700b89f0 0x7f21701e2680 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.895+0000 7f21755a4640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f217006f320 0x7f2170143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.895+0000 7f21755a4640 1 --2- 172.21.15.88:0/1647334399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f217006e960 0x7f21701462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.895+0000 7f21755a4640 1 -- 172.21.15.88:0/1647334399 >> 172.21.15.88:0/1647334399 conn(0x7f21700bb780 msgr2=0x7f21700bcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:57.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.895+0000 7f21755a4640 1 -- 172.21.15.88:0/1647334399 shutdown_connections 2024-01-22T10:13:57.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:57.895+0000 7f21755a4640 1 -- 172.21.15.88:0/1647334399 wait complete. 2024-01-22T10:13:57.888 INFO:tasks.ceph:Scrubbing osd.1 2024-01-22T10:13:57.888 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-22T10:13:57.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.008+0000 7f9ac3500640 1 Processor -- start 2024-01-22T10:13:57.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.008+0000 7f9ac3500640 1 -- start start 2024-01-22T10:13:57.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac3500640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9abc0ba9a0 0x7f9abc06a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac3500640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9abc0b44e0 0x7f9abc14bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac3500640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9abc14c410 0x7f9abc14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:57.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac3500640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9abc14c860 con 0x7f9abc0ba9a0 2024-01-22T10:13:57.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac3500640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9abc0c0bc0 con 0x7f9abc14c410 2024-01-22T10:13:57.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac3500640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc0bd1e0 con 0x7f9abc0b44e0 2024-01-22T10:13:57.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac129c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9abc0ba9a0 0x7f9abc06a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac129c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9abc0ba9a0 0x7f9abc06a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46336/0 (socket says 172.21.15.88:46336) 2024-01-22T10:13:57.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac129c640 1 -- 172.21.15.88:0/2267880803 learned_addr learned my addr 172.21.15.88:0/2267880803 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:57.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac0a9b640 1 --2- 172.21.15.88:0/2267880803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9abc0b44e0 0x7f9abc14bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac1a9d640 1 --2- 172.21.15.88:0/2267880803 >> v2:172.21.15.119:3300/0 conn(0x7f9abc14c410 0x7f9abc14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:57.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac129c640 1 -- 172.21.15.88:0/2267880803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9abc0b44e0 msgr2=0x7f9abc14bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:57.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac129c640 1 --2- 172.21.15.88:0/2267880803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9abc0b44e0 0x7f9abc14bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac129c640 1 -- 172.21.15.88:0/2267880803 >> v2:172.21.15.119:3300/0 conn(0x7f9abc14c410 msgr2=0x7f9abc14ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:57.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac129c640 1 --2- 172.21.15.88:0/2267880803 >> v2:172.21.15.119:3300/0 conn(0x7f9abc14c410 0x7f9abc14ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.009+0000 7f9ac129c640 1 -- 172.21.15.88:0/2267880803 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc14b9f0 con 0x7f9abc0ba9a0 2024-01-22T10:13:57.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.010+0000 7f9ac129c640 1 --2- 172.21.15.88:0/2267880803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9abc0ba9a0 0x7f9abc06a930 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9abc08b5a0 tx=0x7f9ab802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15897aeb93d7ac1 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:57.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.010+0000 7f9ab3fff640 1 -- 172.21.15.88:0/2267880803 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab802c9e0 con 0x7f9abc0ba9a0 2024-01-22T10:13:57.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.010+0000 7f9ab3fff640 1 -- 172.21.15.88:0/2267880803 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab802cb40 con 0x7f9abc0ba9a0 2024-01-22T10:13:57.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.010+0000 7f9ab3fff640 1 -- 172.21.15.88:0/2267880803 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab80343f0 con 0x7f9abc0ba9a0 2024-01-22T10:13:57.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.011+0000 7f9ac3500640 1 -- 172.21.15.88:0/2267880803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9abc0ba9a0 msgr2=0x7f9abc06a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:57.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.011+0000 7f9ac3500640 1 --2- 172.21.15.88:0/2267880803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9abc0ba9a0 0x7f9abc06a930 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9abc08b5a0 tx=0x7f9ab802be40 comp rx=0 tx=0).stop 2024-01-22T10:13:57.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.011+0000 7f9ac3500640 1 -- 172.21.15.88:0/2267880803 shutdown_connections 2024-01-22T10:13:57.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.011+0000 7f9ac3500640 1 --2- 172.21.15.88:0/2267880803 >> v2:172.21.15.119:3300/0 conn(0x7f9abc14c410 0x7f9abc14ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.011+0000 7f9ac3500640 1 --2- 172.21.15.88:0/2267880803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9abc0b44e0 0x7f9abc14bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.011+0000 7f9ac3500640 1 --2- 172.21.15.88:0/2267880803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9abc0ba9a0 0x7f9abc06a930 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:57.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.011+0000 7f9ac3500640 1 -- 172.21.15.88:0/2267880803 >> 172.21.15.88:0/2267880803 conn(0x7f9abc0bd8d0 msgr2=0x7f9abc0bdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:57.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.011+0000 7f9ac3500640 1 -- 172.21.15.88:0/2267880803 shutdown_connections 2024-01-22T10:13:57.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.011+0000 7f9ac3500640 1 -- 172.21.15.88:0/2267880803 wait complete. 2024-01-22T10:13:58.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.012+0000 7f9ac3500640 1 Processor -- start 2024-01-22T10:13:58.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.012+0000 7f9ac3500640 1 -- start start 2024-01-22T10:13:58.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.012+0000 7f9ac3500640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9abc0b44e0 0x7f9abc09e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.012+0000 7f9ac3500640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9abc0ba9a0 0x7f9abc0b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.012+0000 7f9ac3500640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9abc14c410 0x7f9abc09f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.012+0000 7f9ac3500640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc0b7240 con 0x7f9abc0ba9a0 2024-01-22T10:13:58.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.012+0000 7f9ac3500640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc1e4240 con 0x7f9abc14c410 2024-01-22T10:13:58.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.012+0000 7f9ac3500640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc09ed20 con 0x7f9abc0b44e0 2024-01-22T10:13:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac0a9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9abc0ba9a0 0x7f9abc0b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac0a9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9abc0ba9a0 0x7f9abc0b6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46338/0 (socket says 172.21.15.88:46338) 2024-01-22T10:13:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac0a9b640 1 -- 172.21.15.88:0/632847236 learned_addr learned my addr 172.21.15.88:0/632847236 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac1a9d640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9abc14c410 0x7f9abc09f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac129c640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9abc0b44e0 0x7f9abc09e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac0a9b640 1 -- 172.21.15.88:0/632847236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9abc0b44e0 msgr2=0x7f9abc09e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac0a9b640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9abc0b44e0 0x7f9abc09e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac0a9b640 1 -- 172.21.15.88:0/632847236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9abc14c410 msgr2=0x7f9abc09f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac0a9b640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9abc14c410 0x7f9abc09f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac0a9b640 1 -- 172.21.15.88:0/632847236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab8009b30 con 0x7f9abc0ba9a0 2024-01-22T10:13:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac0a9b640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9abc0ba9a0 0x7f9abc0b6d00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00d5f0 tx=0x7f9aac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ab1ffb640 1 -- 172.21.15.88:0/632847236 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0125f0 con 0x7f9abc0ba9a0 2024-01-22T10:13:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ab1ffb640 1 -- 172.21.15.88:0/632847236 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac012750 con 0x7f9abc0ba9a0 2024-01-22T10:13:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ab1ffb640 1 -- 172.21.15.88:0/632847236 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac012b00 con 0x7f9abc0ba9a0 2024-01-22T10:13:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac3500640 1 -- 172.21.15.88:0/632847236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9abc09d510 con 0x7f9abc0ba9a0 2024-01-22T10:13:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.013+0000 7f9ac3500640 1 -- 172.21.15.88:0/632847236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9abc09dad0 con 0x7f9abc0ba9a0 2024-01-22T10:13:58.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.014+0000 7f9ac3500640 1 -- 172.21.15.88:0/632847236 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9abc0a2c50 con 0x7f9abc0ba9a0 2024-01-22T10:13:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.014+0000 7f9ab1ffb640 1 -- 172.21.15.88:0/632847236 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f9aac012c60 con 0x7f9abc0ba9a0 2024-01-22T10:13:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.015+0000 7f9ab1ffb640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9aa006b330 0x7f9aa006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.015+0000 7f9ab1ffb640 1 -- 172.21.15.88:0/632847236 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9aac08a070 con 0x7f9abc0ba9a0 2024-01-22T10:13:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.015+0000 7f9ac129c640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9aa006b330 0x7f9aa006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.015+0000 7f9ab1ffb640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] conn(0x7f9aa00734d0 0x7f9aa00758f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.015+0000 7f9ab1ffb640 1 -- 172.21.15.88:0/632847236 --> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9aa0075fa0 con 0x7f9aa00734d0 2024-01-22T10:13:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.015+0000 7f9ab1ffb640 1 -- 172.21.15.88:0/632847236 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aac08c730 con 0x7f9abc0ba9a0 2024-01-22T10:13:58.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.015+0000 7f9ac1a9d640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] conn(0x7f9aa00734d0 0x7f9aa00758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.015+0000 7f9ac129c640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9aa006b330 0x7f9aa006d7f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8035000 tx=0x7f9ab8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.015+0000 7f9ac1a9d640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] conn(0x7f9aa00734d0 0x7f9aa00758f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.016+0000 7f9ab1ffb640 1 -- 172.21.15.88:0/632847236 <== osd.1 v2:172.21.15.88:6808/398753072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9aa0075fa0 con 0x7f9aa00734d0 2024-01-22T10:13:58.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.029+0000 7f9ac3500640 1 -- 172.21.15.88:0/632847236 --> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9abc0bbe10 con 0x7f9aa00734d0 2024-01-22T10:13:58.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.029+0000 7f9ab1ffb640 1 -- 172.21.15.88:0/632847236 <== osd.1 v2:172.21.15.88:6808/398753072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9ab400ba20 con 0x7f9aa00734d0 2024-01-22T10:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-01-22T10:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-22T10:13:58.012 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-01-22T10:13:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.029+0000 7f9ac3500640 1 -- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] conn(0x7f9aa00734d0 msgr2=0x7f9aa00758f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.029+0000 7f9ac3500640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:6808/398753072,v1:172.21.15.88:6809/398753072] conn(0x7f9aa00734d0 0x7f9aa00758f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.030+0000 7f9ac3500640 1 -- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9aa006b330 msgr2=0x7f9aa006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.030+0000 7f9ac3500640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9aa006b330 0x7f9aa006d7f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8035000 tx=0x7f9ab8030000 comp rx=0 tx=0).stop 2024-01-22T10:13:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.030+0000 7f9ac3500640 1 -- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9abc0ba9a0 msgr2=0x7f9abc0b6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.030+0000 7f9ac3500640 1 --2- 172.21.15.88:0/632847236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9abc0ba9a0 0x7f9abc0b6d00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00d5f0 tx=0x7f9aac00dab0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.030+0000 7f9ac1a9d640 1 -- 172.21.15.88:0/632847236 reap_dead start 2024-01-22T10:13:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.030+0000 7f9ac3500640 1 -- 172.21.15.88:0/632847236 shutdown_connections 2024-01-22T10:13:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.030+0000 7f9ac3500640 1 -- 172.21.15.88:0/632847236 >> 172.21.15.88:0/632847236 conn(0x7f9abc0bd8d0 msgr2=0x7f9abc0a0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.030+0000 7f9ac3500640 1 -- 172.21.15.88:0/632847236 shutdown_connections 2024-01-22T10:13:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.030+0000 7f9ac3500640 1 -- 172.21.15.88:0/632847236 wait complete. 2024-01-22T10:13:58.022 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-22T10:13:58.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.140+0000 7f9f8a897640 1 Processor -- start 2024-01-22T10:13:58.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.140+0000 7f9f8a897640 1 -- start start 2024-01-22T10:13:58.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f8a897640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f840ba260 0x7f9f84070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f8a897640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f84070db0 0x7f9f84155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f8a897640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f840b9e40 con 0x7f9f840ba9d0 2024-01-22T10:13:58.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f8a897640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f840b91f0 con 0x7f9f84070db0 2024-01-22T10:13:58.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f8a897640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84071920 con 0x7f9f840ba260 2024-01-22T10:13:58.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f83fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9f840ba9d0 0x7f9f84145690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60710/0 (socket says 172.21.15.88:60710) 2024-01-22T10:13:58.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f83fff640 1 -- 172.21.15.88:0/2701220451 learned_addr learned my addr 172.21.15.88:0/2701220451 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:58.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f88e34640 1 --2- 172.21.15.88:0/2701220451 >> v2:172.21.15.88:3300/0 conn(0x7f9f84070db0 0x7f9f84155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f837fe640 1 --2- 172.21.15.88:0/2701220451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f840ba260 0x7f9f84070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f88e34640 1 -- 172.21.15.88:0/2701220451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f840ba260 msgr2=0x7f9f84070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:58.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f88e34640 1 --2- 172.21.15.88:0/2701220451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f840ba260 0x7f9f84070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f88e34640 1 -- 172.21.15.88:0/2701220451 >> v1:172.21.15.88:6789/0 conn(0x7f9f840ba9d0 legacy=0x7f9f84145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f88e34640 1 -- 172.21.15.88:0/2701220451 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f84071b30 con 0x7f9f84070db0 2024-01-22T10:13:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.141+0000 7f9f82ffd640 1 -- 172.21.15.88:0/2701220451 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453225766 0 0) 0x7f9f840b9e40 con 0x7f9f840ba9d0 2024-01-22T10:13:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.142+0000 7f9f88e34640 1 --2- 172.21.15.88:0/2701220451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f84070db0 0x7f9f84155fd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009d90 tx=0x7f9f7c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873fb81ab3a31d6f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.142+0000 7f9f82ffd640 1 -- 172.21.15.88:0/2701220451 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c02cc50 con 0x7f9f84070db0 2024-01-22T10:13:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.142+0000 7f9f82ffd640 1 -- 172.21.15.88:0/2701220451 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c02cdb0 con 0x7f9f84070db0 2024-01-22T10:13:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.142+0000 7f9f82ffd640 1 -- 172.21.15.88:0/2701220451 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c034660 con 0x7f9f84070db0 2024-01-22T10:13:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.143+0000 7f9f8a897640 1 -- 172.21.15.88:0/2701220451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f84070db0 msgr2=0x7f9f84155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.143+0000 7f9f8a897640 1 --2- 172.21.15.88:0/2701220451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f84070db0 0x7f9f84155fd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009d90 tx=0x7f9f7c02bea0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.143+0000 7f9f8a897640 1 -- 172.21.15.88:0/2701220451 shutdown_connections 2024-01-22T10:13:58.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.143+0000 7f9f8a897640 1 --2- 172.21.15.88:0/2701220451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f84070db0 0x7f9f84155fd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.143+0000 7f9f8a897640 1 --2- 172.21.15.88:0/2701220451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f840ba260 0x7f9f84070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.143+0000 7f9f8a897640 1 -- 172.21.15.88:0/2701220451 >> 172.21.15.88:0/2701220451 conn(0x7f9f8406b800 msgr2=0x7f9f8406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:58.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.143+0000 7f9f8a897640 1 -- 172.21.15.88:0/2701220451 shutdown_connections 2024-01-22T10:13:58.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.143+0000 7f9f8a897640 1 -- 172.21.15.88:0/2701220451 wait complete. 2024-01-22T10:13:58.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.144+0000 7f9f8a897640 1 Processor -- start 2024-01-22T10:13:58.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.144+0000 7f9f8a897640 1 -- start start 2024-01-22T10:13:58.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.144+0000 7f9f8a897640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f84070db0 0x7f9f841466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.144+0000 7f9f8a897640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f840ba260 0x7f9f8414ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.144+0000 7f9f8a897640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f840ba9d0 0x7f9f84147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.144+0000 7f9f8a897640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84146c50 con 0x7f9f84070db0 2024-01-22T10:13:58.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.144+0000 7f9f8a897640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f841424d0 con 0x7f9f840ba260 2024-01-22T10:13:58.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.144+0000 7f9f8a897640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84146e30 con 0x7f9f840ba9d0 2024-01-22T10:13:58.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.144+0000 7f9f83fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f84070db0 0x7f9f841466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.144+0000 7f9f83fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f84070db0 0x7f9f841466e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46356/0 (socket says 172.21.15.88:46356) 2024-01-22T10:13:58.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f83fff640 1 -- 172.21.15.88:0/1329707820 learned_addr learned my addr 172.21.15.88:0/1329707820 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:58.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f83fff640 1 -- 172.21.15.88:0/1329707820 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f840ba9d0 msgr2=0x7f9f84147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f83fff640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f840ba9d0 0x7f9f84147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f83fff640 1 -- 172.21.15.88:0/1329707820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f840ba260 msgr2=0x7f9f8414ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f837fe640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f840ba260 0x7f9f8414ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f83fff640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f840ba260 0x7f9f8414ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f83fff640 1 -- 172.21.15.88:0/1329707820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c009a70 con 0x7f9f84070db0 2024-01-22T10:13:58.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f837fe640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f840ba260 0x7f9f8414ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:58.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f83fff640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f84070db0 0x7f9f841466e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400c500 tx=0x7f9f7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f80ff9640 1 -- 172.21.15.88:0/1329707820 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74007560 con 0x7f9f84070db0 2024-01-22T10:13:58.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f80ff9640 1 -- 172.21.15.88:0/1329707820 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f740047e0 con 0x7f9f84070db0 2024-01-22T10:13:58.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f8a897640 1 -- 172.21.15.88:0/1329707820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f841457a0 con 0x7f9f84070db0 2024-01-22T10:13:58.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f80ff9640 1 -- 172.21.15.88:0/1329707820 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74004b90 con 0x7f9f84070db0 2024-01-22T10:13:58.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.145+0000 7f9f8a897640 1 -- 172.21.15.88:0/1329707820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f84145d60 con 0x7f9f84070db0 2024-01-22T10:13:58.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.146+0000 7f9f8a897640 1 -- 172.21.15.88:0/1329707820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f841476a0 con 0x7f9f84070db0 2024-01-22T10:13:58.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.146+0000 7f9f80ff9640 1 -- 172.21.15.88:0/1329707820 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f9f74004cf0 con 0x7f9f84070db0 2024-01-22T10:13:58.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.147+0000 7f9f80ff9640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9f7006b330 0x7f9f7006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.147+0000 7f9f80ff9640 1 -- 172.21.15.88:0/1329707820 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f74089090 con 0x7f9f84070db0 2024-01-22T10:13:58.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.147+0000 7f9f837fe640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9f7006b330 0x7f9f7006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.147+0000 7f9f837fe640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9f7006b330 0x7f9f7006d7f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9f840bea30 tx=0x7f9f78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.151+0000 7f9f80ff9640 1 -- 172.21.15.88:0/1329707820 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9f74053db0 con 0x7f9f84070db0 2024-01-22T10:13:58.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.318+0000 7f9f8a897640 1 -- 172.21.15.88:0/1329707820 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f84070510 con 0x7f9f7006b330 2024-01-22T10:13:58.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.319+0000 7f9f80ff9640 1 -- 172.21.15.88:0/1329707820 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9f78009e10 con 0x7f9f7006b330 2024-01-22T10:13:58.302 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 1 to deep-scrub 2024-01-22T10:13:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.321+0000 7f9f8a897640 1 -- 172.21.15.88:0/1329707820 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9f7006b330 msgr2=0x7f9f7006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.321+0000 7f9f8a897640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9f7006b330 0x7f9f7006d7f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9f840bea30 tx=0x7f9f78008040 comp rx=0 tx=0).stop 2024-01-22T10:13:58.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.321+0000 7f9f8a897640 1 -- 172.21.15.88:0/1329707820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f84070db0 msgr2=0x7f9f841466e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.321+0000 7f9f8a897640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f84070db0 0x7f9f841466e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400c500 tx=0x7f9f7400c9c0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.321+0000 7f9f8a897640 1 -- 172.21.15.88:0/1329707820 shutdown_connections 2024-01-22T10:13:58.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.321+0000 7f9f8a897640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f9f7006b330 0x7f9f7006d7f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.321+0000 7f9f8a897640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f840ba9d0 0x7f9f84147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.321+0000 7f9f8a897640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f840ba260 0x7f9f8414ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.321+0000 7f9f8a897640 1 --2- 172.21.15.88:0/1329707820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f84070db0 0x7f9f841466e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.321+0000 7f9f8a897640 1 -- 172.21.15.88:0/1329707820 >> 172.21.15.88:0/1329707820 conn(0x7f9f8406b800 msgr2=0x7f9f840bdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:58.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.321+0000 7f9f8a897640 1 -- 172.21.15.88:0/1329707820 shutdown_connections 2024-01-22T10:13:58.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.321+0000 7f9f8a897640 1 -- 172.21.15.88:0/1329707820 wait complete. 2024-01-22T10:13:58.314 INFO:tasks.ceph:Scrubbing osd.2 2024-01-22T10:13:58.314 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-22T10:13:58.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.434+0000 7f7cb3fd5640 1 Processor -- start 2024-01-22T10:13:58.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.434+0000 7f7cb3fd5640 1 -- start start 2024-01-22T10:13:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.434+0000 7f7cb3fd5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7cac0b6a20 0x7f7cac153440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb3fd5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac0b65b0 con 0x7f7cac0b3f70 2024-01-22T10:13:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb3fd5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac0b4400 con 0x7f7cac0b5e30 2024-01-22T10:13:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb3fd5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cac0b46e0 con 0x7f7cac0b6a20 2024-01-22T10:13:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb1570640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7cac0b3f70 0x7f7cac141960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60716/0 (socket says 172.21.15.88:60716) 2024-01-22T10:13:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb1570640 1 -- 172.21.15.88:0/1939063645 learned_addr learned my addr 172.21.15.88:0/1939063645 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094845683 0 0) 0x7f7cac0b65b0 con 0x7f7cac0b3f70 2024-01-22T10:13:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb2572640 1 --2- 172.21.15.88:0/1939063645 >> v2:172.21.15.119:3300/0 conn(0x7f7cac0b6a20 0x7f7cac153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c98003520 con 0x7f7cac0b3f70 2024-01-22T10:13:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1656641584 0 0) 0x7f7c98003520 con 0x7f7cac0b3f70 2024-01-22T10:13:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 >> v2:172.21.15.119:3300/0 conn(0x7f7cac0b6a20 msgr2=0x7f7cac153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 --2- 172.21.15.88:0/1939063645 >> v2:172.21.15.119:3300/0 conn(0x7f7cac0b6a20 0x7f7cac153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 >> v1:172.21.15.119:6789/0 conn(0x7f7cac0b5e30 legacy=0x7f7cac1484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac147cc0 con 0x7f7cac0b3f70 2024-01-22T10:13:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f7c9c001670 con 0x7f7cac0b3f70 2024-01-22T10:13:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 >> v1:172.21.15.88:6789/0 conn(0x7f7cac0b3f70 legacy=0x7f7cac141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 --2- 172.21.15.88:0/1939063645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c98003970 0x7f7c98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 --2- 172.21.15.88:0/1939063645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c980047c0 0x7f7c98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 --2- 172.21.15.88:0/1939063645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c98005180 0x7f7c9800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac0b46e0 con 0x7f7c980047c0 2024-01-22T10:13:58.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9800c030 con 0x7f7c98003970 2024-01-22T10:13:58.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9800c1f0 con 0x7f7c98005180 2024-01-22T10:13:58.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb1570640 1 --2- 172.21.15.88:0/1939063645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c980047c0 0x7f7c98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb1d71640 1 --2- 172.21.15.88:0/1939063645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c98003970 0x7f7c98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.435+0000 7f7cb2572640 1 --2- 172.21.15.88:0/1939063645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c98005180 0x7f7c9800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.436+0000 7f7cb1570640 1 -- 172.21.15.88:0/1939063645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c98005180 msgr2=0x7f7c9800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.436+0000 7f7cb1570640 1 --2- 172.21.15.88:0/1939063645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c98005180 0x7f7c9800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.436+0000 7f7cb1570640 1 -- 172.21.15.88:0/1939063645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c98003970 msgr2=0x7f7c98003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.436+0000 7f7cb1570640 1 --2- 172.21.15.88:0/1939063645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c98003970 0x7f7c98003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.436+0000 7f7cb2572640 1 -- 172.21.15.88:0/1939063645 reap_dead start 2024-01-22T10:13:58.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.436+0000 7f7cb1570640 1 -- 172.21.15.88:0/1939063645 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c98003520 con 0x7f7c980047c0 2024-01-22T10:13:58.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.436+0000 7f7cb1570640 1 --2- 172.21.15.88:0/1939063645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c980047c0 0x7f7c98004c40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00c190 tx=0x7f7c980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4159558a9a99e32a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.436+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c005ad0 con 0x7f7c980047c0 2024-01-22T10:13:58.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.436+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c005c30 con 0x7f7c980047c0 2024-01-22T10:13:58.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.436+0000 7f7cb0d6f640 1 -- 172.21.15.88:0/1939063645 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c02ca70 con 0x7f7c980047c0 2024-01-22T10:13:58.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.437+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/1939063645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c980047c0 msgr2=0x7f7c98004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.437+0000 7f7cb3fd5640 1 --2- 172.21.15.88:0/1939063645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c980047c0 0x7f7c98004c40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00c190 tx=0x7f7c980057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.437+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/1939063645 shutdown_connections 2024-01-22T10:13:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.437+0000 7f7cb3fd5640 1 --2- 172.21.15.88:0/1939063645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c980047c0 0x7f7c98004c40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.437+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/1939063645 >> 172.21.15.88:0/1939063645 conn(0x7f7cac06ad20 msgr2=0x7f7cac0bcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.437+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/1939063645 shutdown_connections 2024-01-22T10:13:58.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.437+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/1939063645 wait complete. 2024-01-22T10:13:58.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.438+0000 7f7cb3fd5640 1 Processor -- start 2024-01-22T10:13:58.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.438+0000 7f7cb3fd5640 1 -- start start 2024-01-22T10:13:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb3fd5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c980047c0 0x7f7cac1ddd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb3fd5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cac14a770 0x7f7cac071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb3fd5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cac14abd0 0x7f7cac1497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb3fd5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac1de380 con 0x7f7cac14abd0 2024-01-22T10:13:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb3fd5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac1de660 con 0x7f7cac14a770 2024-01-22T10:13:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb3fd5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac148fa0 con 0x7f7c980047c0 2024-01-22T10:13:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb2572640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cac14abd0 0x7f7cac1497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb2572640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cac14abd0 0x7f7cac1497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46378/0 (socket says 172.21.15.88:46378) 2024-01-22T10:13:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb2572640 1 -- 172.21.15.88:0/690443182 learned_addr learned my addr 172.21.15.88:0/690443182 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb1d71640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c980047c0 0x7f7cac1ddd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb1570640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cac14a770 0x7f7cac071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb2572640 1 -- 172.21.15.88:0/690443182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c980047c0 msgr2=0x7f7cac1ddd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb2572640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c980047c0 0x7f7cac1ddd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb2572640 1 -- 172.21.15.88:0/690443182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cac14a770 msgr2=0x7f7cac071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb2572640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cac14a770 0x7f7cac071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb2572640 1 -- 172.21.15.88:0/690443182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac149280 con 0x7f7cac14abd0 2024-01-22T10:13:58.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb1d71640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c980047c0 0x7f7cac1ddd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:58.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb2572640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cac14abd0 0x7f7cac1497a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0b9520 tx=0x7f7ca400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7ca27fc640 1 -- 172.21.15.88:0/690443182 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca400e040 con 0x7f7cac14abd0 2024-01-22T10:13:58.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7ca27fc640 1 -- 172.21.15.88:0/690443182 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca400f040 con 0x7f7cac14abd0 2024-01-22T10:13:58.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/690443182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cac0badb0 con 0x7f7cac14abd0 2024-01-22T10:13:58.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7ca27fc640 1 -- 172.21.15.88:0/690443182 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4015430 con 0x7f7cac14abd0 2024-01-22T10:13:58.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.439+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/690443182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cac14bbf0 con 0x7f7cac14abd0 2024-01-22T10:13:58.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.440+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/690443182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7cac1de4f0 con 0x7f7cac14abd0 2024-01-22T10:13:58.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.441+0000 7f7ca27fc640 1 -- 172.21.15.88:0/690443182 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f7ca4015590 con 0x7f7cac14abd0 2024-01-22T10:13:58.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.441+0000 7f7ca27fc640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7c9006b360 0x7f7c9006d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.441+0000 7f7cb1d71640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7c9006b360 0x7f7c9006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.441+0000 7f7ca27fc640 1 -- 172.21.15.88:0/690443182 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ca408ad00 con 0x7f7cac14abd0 2024-01-22T10:13:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.441+0000 7f7ca27fc640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] conn(0x7f7c90073500 0x7f7c90075920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.441+0000 7f7ca27fc640 1 -- 172.21.15.88:0/690443182 --> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c90075fd0 con 0x7f7c90073500 2024-01-22T10:13:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.441+0000 7f7ca27fc640 1 -- 172.21.15.88:0/690443182 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ca408b150 con 0x7f7cac14abd0 2024-01-22T10:13:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.442+0000 7f7cb1570640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] conn(0x7f7c90073500 0x7f7c90075920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.442+0000 7f7cb1d71640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7c9006b360 0x7f7c9006d820 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8000c00 tx=0x7f7ca8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.442+0000 7f7cb1570640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] conn(0x7f7c90073500 0x7f7c90075920 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.442+0000 7f7ca27fc640 1 -- 172.21.15.88:0/690443182 <== osd.2 v2:172.21.15.88:6824/1293056926 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7c90075fd0 con 0x7f7c90073500 2024-01-22T10:13:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.455+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/690443182 --> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7cac0b6e70 con 0x7f7c90073500 2024-01-22T10:13:58.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.456+0000 7f7ca27fc640 1 -- 172.21.15.88:0/690443182 <== osd.2 v2:172.21.15.88:6824/1293056926 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7c9c03d040 con 0x7f7c90073500 2024-01-22T10:13:58.439 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-01-22T10:13:58.439 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-22T10:13:58.440 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-01-22T10:13:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.456+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] conn(0x7f7c90073500 msgr2=0x7f7c90075920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.456+0000 7f7cb3fd5640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:6824/1293056926,v1:172.21.15.88:6825/1293056926] conn(0x7f7c90073500 0x7f7c90075920 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.456+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7c9006b360 msgr2=0x7f7c9006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.456+0000 7f7cb3fd5640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f7c9006b360 0x7f7c9006d820 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8000c00 tx=0x7f7ca8009040 comp rx=0 tx=0).stop 2024-01-22T10:13:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.456+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cac14abd0 msgr2=0x7f7cac1497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.456+0000 7f7cb3fd5640 1 --2- 172.21.15.88:0/690443182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cac14abd0 0x7f7cac1497a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0b9520 tx=0x7f7ca400f580 comp rx=0 tx=0).stop 2024-01-22T10:13:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.456+0000 7f7cb2572640 1 -- 172.21.15.88:0/690443182 reap_dead start 2024-01-22T10:13:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.456+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/690443182 shutdown_connections 2024-01-22T10:13:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.456+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/690443182 >> 172.21.15.88:0/690443182 conn(0x7f7cac06ad20 msgr2=0x7f7cac0b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:58.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.456+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/690443182 shutdown_connections 2024-01-22T10:13:58.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.456+0000 7f7cb3fd5640 1 -- 172.21.15.88:0/690443182 wait complete. 2024-01-22T10:13:58.449 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-22T10:13:58.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.566+0000 7fa3edeee640 1 Processor -- start 2024-01-22T10:13:58.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.566+0000 7fa3edeee640 1 -- start start 2024-01-22T10:13:58.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.567+0000 7fa3edeee640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa3e8155040 0x7fa3e8157430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.567+0000 7fa3edeee640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e806bf10 con 0x7fa3e80b5310 2024-01-22T10:13:58.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.567+0000 7fa3edeee640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e814c590 con 0x7fa3e806d4a0 2024-01-22T10:13:58.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.567+0000 7fa3edeee640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e806d080 con 0x7fa3e8155040 2024-01-22T10:13:58.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.567+0000 7fa3e77fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa3e80b5310 0x7fa3e806b800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60718/0 (socket says 172.21.15.88:60718) 2024-01-22T10:13:58.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.567+0000 7fa3e77fe640 1 -- 172.21.15.88:0/3134301215 learned_addr learned my addr 172.21.15.88:0/3134301215 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:58.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.567+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745728803 0 0) 0x7fa3e806bf10 con 0x7fa3e80b5310 2024-01-22T10:13:58.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d0003520 con 0x7fa3e80b5310 2024-01-22T10:13:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e7fff640 1 --2- 172.21.15.88:0/3134301215 >> v2:172.21.15.119:3300/0 conn(0x7fa3e8155040 0x7fa3e8157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3655874850 0 0) 0x7fa3d0003520 con 0x7fa3e80b5310 2024-01-22T10:13:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 >> v2:172.21.15.119:3300/0 conn(0x7fa3e8155040 msgr2=0x7fa3e8157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 --2- 172.21.15.88:0/3134301215 >> v2:172.21.15.119:3300/0 conn(0x7fa3e8155040 0x7fa3e8157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 >> v1:172.21.15.119:6789/0 conn(0x7fa3e806d4a0 legacy=0x7fa3e80b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e814b7d0 con 0x7fa3e80b5310 2024-01-22T10:13:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fa3d8001670 con 0x7fa3e80b5310 2024-01-22T10:13:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 >> v1:172.21.15.88:6789/0 conn(0x7fa3e80b5310 legacy=0x7fa3e806b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 --2- 172.21.15.88:0/3134301215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d0003a50 0x7fa3d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 --2- 172.21.15.88:0/3134301215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3d00047c0 0x7fa3d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 --2- 172.21.15.88:0/3134301215 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3d00051d0 0x7fa3d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e806d080 con 0x7fa3d0003a50 2024-01-22T10:13:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d000c0e0 con 0x7fa3d00047c0 2024-01-22T10:13:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d000c2a0 con 0x7fa3d00051d0 2024-01-22T10:13:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e77fe640 1 --2- 172.21.15.88:0/3134301215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d0003a50 0x7fa3d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e6ffd640 1 --2- 172.21.15.88:0/3134301215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3d00047c0 0x7fa3d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e7fff640 1 --2- 172.21.15.88:0/3134301215 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3d00051d0 0x7fa3d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e77fe640 1 -- 172.21.15.88:0/3134301215 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3d00051d0 msgr2=0x7fa3d000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e77fe640 1 --2- 172.21.15.88:0/3134301215 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3d00051d0 0x7fa3d000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e77fe640 1 -- 172.21.15.88:0/3134301215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3d00047c0 msgr2=0x7fa3d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e77fe640 1 --2- 172.21.15.88:0/3134301215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3d00047c0 0x7fa3d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e7fff640 1 -- 172.21.15.88:0/3134301215 reap_dead start 2024-01-22T10:13:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.568+0000 7fa3e77fe640 1 -- 172.21.15.88:0/3134301215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0003520 con 0x7fa3d0003a50 2024-01-22T10:13:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.569+0000 7fa3e77fe640 1 --2- 172.21.15.88:0/3134301215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d0003a50 0x7fa3d0003e70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800c240 tx=0x7fa3d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c26a372c8d02b4e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.569+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8005ad0 con 0x7fa3d0003a50 2024-01-22T10:13:58.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.569+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d8005c30 con 0x7fa3d0003a50 2024-01-22T10:13:58.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.569+0000 7fa3e67fc640 1 -- 172.21.15.88:0/3134301215 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d802ca90 con 0x7fa3d0003a50 2024-01-22T10:13:58.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.570+0000 7fa3edeee640 1 -- 172.21.15.88:0/3134301215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d0003a50 msgr2=0x7fa3d0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.570+0000 7fa3edeee640 1 --2- 172.21.15.88:0/3134301215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d0003a50 0x7fa3d0003e70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800c240 tx=0x7fa3d00057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.570+0000 7fa3edeee640 1 -- 172.21.15.88:0/3134301215 shutdown_connections 2024-01-22T10:13:58.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.570+0000 7fa3edeee640 1 --2- 172.21.15.88:0/3134301215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d0003a50 0x7fa3d0003e70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.570+0000 7fa3edeee640 1 -- 172.21.15.88:0/3134301215 >> 172.21.15.88:0/3134301215 conn(0x7fa3e80bec50 msgr2=0x7fa3e80bf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:58.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.570+0000 7fa3edeee640 1 -- 172.21.15.88:0/3134301215 shutdown_connections 2024-01-22T10:13:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.570+0000 7fa3edeee640 1 -- 172.21.15.88:0/3134301215 wait complete. 2024-01-22T10:13:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.571+0000 7fa3edeee640 1 Processor -- start 2024-01-22T10:13:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.571+0000 7fa3edeee640 1 -- start start 2024-01-22T10:13:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.571+0000 7fa3edeee640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3d0003a50 0x7fa3e813a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.571+0000 7fa3edeee640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e8143910 0x7fa3e813af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.571+0000 7fa3edeee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e813b460 0x7fa3e8136100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.571+0000 7fa3edeee640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e813a7b0 con 0x7fa3e8143910 2024-01-22T10:13:58.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.571+0000 7fa3edeee640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e8144140 con 0x7fa3e813b460 2024-01-22T10:13:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.571+0000 7fa3edeee640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e813c230 con 0x7fa3d0003a50 2024-01-22T10:13:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3e6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e8143910 0x7fa3e813af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3e6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e8143910 0x7fa3e813af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46388/0 (socket says 172.21.15.88:46388) 2024-01-22T10:13:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3e6ffd640 1 -- 172.21.15.88:0/2993458684 learned_addr learned my addr 172.21.15.88:0/2993458684 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3e6ffd640 1 -- 172.21.15.88:0/2993458684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3d0003a50 msgr2=0x7fa3e813a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3e6ffd640 1 --2- 172.21.15.88:0/2993458684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3d0003a50 0x7fa3e813a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3e6ffd640 1 -- 172.21.15.88:0/2993458684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e813b460 msgr2=0x7fa3e8136100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3e6ffd640 1 --2- 172.21.15.88:0/2993458684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e813b460 0x7fa3e8136100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3e6ffd640 1 -- 172.21.15.88:0/2993458684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e813ce20 con 0x7fa3e8143910 2024-01-22T10:13:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3e6ffd640 1 --2- 172.21.15.88:0/2993458684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e8143910 0x7fa3e813af20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc007810 tx=0x7fa3dc00fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3cffff640 1 -- 172.21.15.88:0/2993458684 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0050d0 con 0x7fa3e8143910 2024-01-22T10:13:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3cffff640 1 -- 172.21.15.88:0/2993458684 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc005230 con 0x7fa3e8143910 2024-01-22T10:13:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3cffff640 1 -- 172.21.15.88:0/2993458684 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00d6b0 con 0x7fa3e8143910 2024-01-22T10:13:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3edeee640 1 -- 172.21.15.88:0/2993458684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e81448b0 con 0x7fa3e8143910 2024-01-22T10:13:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.572+0000 7fa3edeee640 1 -- 172.21.15.88:0/2993458684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e81450b0 con 0x7fa3e8143910 2024-01-22T10:13:58.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.573+0000 7fa3edeee640 1 -- 172.21.15.88:0/2993458684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e804ea30 con 0x7fa3e8143910 2024-01-22T10:13:58.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.574+0000 7fa3cffff640 1 -- 172.21.15.88:0/2993458684 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fa3dc00d810 con 0x7fa3e8143910 2024-01-22T10:13:58.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.574+0000 7fa3cffff640 1 --2- 172.21.15.88:0/2993458684 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa3d406b360 0x7fa3d406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.574+0000 7fa3cffff640 1 -- 172.21.15.88:0/2993458684 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3dc089a80 con 0x7fa3e8143910 2024-01-22T10:13:58.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.574+0000 7fa3e77fe640 1 --2- 172.21.15.88:0/2993458684 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa3d406b360 0x7fa3d406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.574+0000 7fa3e77fe640 1 --2- 172.21.15.88:0/2993458684 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa3d406b360 0x7fa3d406d820 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8034000 tx=0x7fa3d8039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.578+0000 7fa3cffff640 1 -- 172.21.15.88:0/2993458684 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa3dc054680 con 0x7fa3e8143910 2024-01-22T10:13:58.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.750+0000 7fa3edeee640 1 -- 172.21.15.88:0/2993458684 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3e814c070 con 0x7fa3d406b360 2024-01-22T10:13:58.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.750+0000 7fa3cffff640 1 -- 172.21.15.88:0/2993458684 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa3d8001470 con 0x7fa3d406b360 2024-01-22T10:13:58.732 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 2 to deep-scrub 2024-01-22T10:13:58.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.752+0000 7fa3edeee640 1 -- 172.21.15.88:0/2993458684 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa3d406b360 msgr2=0x7fa3d406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.752+0000 7fa3edeee640 1 --2- 172.21.15.88:0/2993458684 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa3d406b360 0x7fa3d406d820 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8034000 tx=0x7fa3d8039040 comp rx=0 tx=0).stop 2024-01-22T10:13:58.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.752+0000 7fa3edeee640 1 -- 172.21.15.88:0/2993458684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e8143910 msgr2=0x7fa3e813af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.752+0000 7fa3edeee640 1 --2- 172.21.15.88:0/2993458684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e8143910 0x7fa3e813af20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc007810 tx=0x7fa3dc00fc00 comp rx=0 tx=0).stop 2024-01-22T10:13:58.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.752+0000 7fa3edeee640 1 -- 172.21.15.88:0/2993458684 shutdown_connections 2024-01-22T10:13:58.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.752+0000 7fa3edeee640 1 --2- 172.21.15.88:0/2993458684 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fa3d406b360 0x7fa3d406d820 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.752+0000 7fa3edeee640 1 --2- 172.21.15.88:0/2993458684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3e813b460 0x7fa3e8136100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.752+0000 7fa3edeee640 1 --2- 172.21.15.88:0/2993458684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e8143910 0x7fa3e813af20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.752+0000 7fa3edeee640 1 --2- 172.21.15.88:0/2993458684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3d0003a50 0x7fa3e813a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.752+0000 7fa3edeee640 1 -- 172.21.15.88:0/2993458684 >> 172.21.15.88:0/2993458684 conn(0x7fa3e80bec50 msgr2=0x7fa3e80b9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:58.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.752+0000 7fa3edeee640 1 -- 172.21.15.88:0/2993458684 shutdown_connections 2024-01-22T10:13:58.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.752+0000 7fa3edeee640 1 -- 172.21.15.88:0/2993458684 wait complete. 2024-01-22T10:13:58.745 INFO:tasks.ceph:Scrubbing osd.3 2024-01-22T10:13:58.745 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-22T10:13:58.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.865+0000 7fc0472da640 1 Processor -- start 2024-01-22T10:13:58.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.865+0000 7fc0472da640 1 -- start start 2024-01-22T10:13:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.866+0000 7fc0472da640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc04006dc90 0x7fc04006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.866+0000 7fc0472da640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04014f8f0 con 0x7fc04006be80 2024-01-22T10:13:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.866+0000 7fc0472da640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc040145d60 con 0x7fc04006f770 2024-01-22T10:13:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.866+0000 7fc0472da640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04006e670 con 0x7fc04006dc90 2024-01-22T10:13:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.866+0000 7fc045877640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc04006be80 0x7fc040155f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60732/0 (socket says 172.21.15.88:60732) 2024-01-22T10:13:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.866+0000 7fc045877640 1 -- 172.21.15.88:0/793400951 learned_addr learned my addr 172.21.15.88:0/793400951 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.866+0000 7fc044875640 1 --2- 172.21.15.88:0/793400951 >> v2:172.21.15.119:3300/0 conn(0x7fc04006dc90 0x7fc04006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.866+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715273394 0 0) 0x7fc04014f8f0 con 0x7fc04006be80 2024-01-22T10:13:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.866+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c003520 con 0x7fc04006be80 2024-01-22T10:13:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 776307841 0 0) 0x7fc02c003520 con 0x7fc04006be80 2024-01-22T10:13:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 >> v2:172.21.15.119:3300/0 conn(0x7fc04006dc90 msgr2=0x7fc04006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 --2- 172.21.15.88:0/793400951 >> v2:172.21.15.119:3300/0 conn(0x7fc04006dc90 0x7fc04006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 >> v1:172.21.15.119:6789/0 conn(0x7fc04006f770 legacy=0x7fc040145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400bb410 con 0x7fc04006be80 2024-01-22T10:13:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7fc038001670 con 0x7fc04006be80 2024-01-22T10:13:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 >> v1:172.21.15.88:6789/0 conn(0x7fc04006be80 legacy=0x7fc040155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 --2- 172.21.15.88:0/793400951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc02c003970 0x7fc02c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 --2- 172.21.15.88:0/793400951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc02c0047c0 0x7fc02c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 --2- 172.21.15.88:0/793400951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc02c005180 0x7fc02c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04006e670 con 0x7fc02c0047c0 2024-01-22T10:13:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c00c020 con 0x7fc02c005180 2024-01-22T10:13:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c00c1e0 con 0x7fc02c003970 2024-01-22T10:13:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc044875640 1 --2- 172.21.15.88:0/793400951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc02c0047c0 0x7fc02c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc045076640 1 --2- 172.21.15.88:0/793400951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc02c003970 0x7fc02c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc045877640 1 --2- 172.21.15.88:0/793400951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc02c005180 0x7fc02c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc044875640 1 -- 172.21.15.88:0/793400951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc02c003970 msgr2=0x7fc02c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc044875640 1 --2- 172.21.15.88:0/793400951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc02c003970 0x7fc02c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc044875640 1 -- 172.21.15.88:0/793400951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc02c005180 msgr2=0x7fc02c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc044875640 1 --2- 172.21.15.88:0/793400951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc02c005180 0x7fc02c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc044875640 1 -- 172.21.15.88:0/793400951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c003520 con 0x7fc02c0047c0 2024-01-22T10:13:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc045877640 1 -- 172.21.15.88:0/793400951 reap_dead start 2024-01-22T10:13:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.867+0000 7fc045076640 1 --2- 172.21.15.88:0/793400951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc02c003970 0x7fc02c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:13:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.868+0000 7fc044875640 1 --2- 172.21.15.88:0/793400951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc02c0047c0 0x7fc02c004c40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc030009ac0 tx=0x7fc02c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f8c1580cdab763 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.868+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03002c6b0 con 0x7fc02c0047c0 2024-01-22T10:13:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.868+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03002c810 con 0x7fc02c0047c0 2024-01-22T10:13:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.868+0000 7fc037fff640 1 -- 172.21.15.88:0/793400951 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03002cba0 con 0x7fc02c0047c0 2024-01-22T10:13:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.868+0000 7fc0472da640 1 -- 172.21.15.88:0/793400951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc02c0047c0 msgr2=0x7fc02c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.868+0000 7fc0472da640 1 --2- 172.21.15.88:0/793400951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc02c0047c0 0x7fc02c004c40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc030009ac0 tx=0x7fc02c0057f0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.868+0000 7fc0472da640 1 -- 172.21.15.88:0/793400951 shutdown_connections 2024-01-22T10:13:58.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.868+0000 7fc0472da640 1 --2- 172.21.15.88:0/793400951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc02c0047c0 0x7fc02c004c40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.868+0000 7fc0472da640 1 -- 172.21.15.88:0/793400951 >> 172.21.15.88:0/793400951 conn(0x7fc0400bb6f0 msgr2=0x7fc0400bbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:58.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.868+0000 7fc0472da640 1 -- 172.21.15.88:0/793400951 shutdown_connections 2024-01-22T10:13:58.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.869+0000 7fc0472da640 1 -- 172.21.15.88:0/793400951 wait complete. 2024-01-22T10:13:58.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.869+0000 7fc0472da640 1 Processor -- start 2024-01-22T10:13:58.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc0472da640 1 -- start start 2024-01-22T10:13:58.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc0472da640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc02c0047c0 0x7fc040146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc0472da640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0401d7640 0x7fc0401d7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc0472da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0401e24d0 0x7fc0401e2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc0472da640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04006bbd0 con 0x7fc0401e24d0 2024-01-22T10:13:58.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc0472da640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0401e2040 con 0x7fc02c0047c0 2024-01-22T10:13:58.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc0472da640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0401e2e70 con 0x7fc0401d7640 2024-01-22T10:13:58.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc045877640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0401e24d0 0x7fc0401e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc045877640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0401e24d0 0x7fc0401e2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46412/0 (socket says 172.21.15.88:46412) 2024-01-22T10:13:58.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc045877640 1 -- 172.21.15.88:0/3600404168 learned_addr learned my addr 172.21.15.88:0/3600404168 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:58.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc045076640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc02c0047c0 0x7fc040146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc045877640 1 -- 172.21.15.88:0/3600404168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0401d7640 msgr2=0x7fc0401d7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc044875640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0401d7640 0x7fc0401d7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc045877640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0401d7640 0x7fc0401d7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc045877640 1 -- 172.21.15.88:0/3600404168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc02c0047c0 msgr2=0x7fc040146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc045877640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc02c0047c0 0x7fc040146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc045877640 1 -- 172.21.15.88:0/3600404168 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0401465d0 con 0x7fc0401e24d0 2024-01-22T10:13:58.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.870+0000 7fc045076640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc02c0047c0 0x7fc040146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:58.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.871+0000 7fc044875640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0401d7640 0x7fc0401d7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:58.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.871+0000 7fc045877640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0401e24d0 0x7fc0401e2930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc04006b740 tx=0x7fc03800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.871+0000 7fc035ffb640 1 -- 172.21.15.88:0/3600404168 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03800eed0 con 0x7fc0401e24d0 2024-01-22T10:13:58.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.871+0000 7fc035ffb640 1 -- 172.21.15.88:0/3600404168 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800c630 con 0x7fc0401e24d0 2024-01-22T10:13:58.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.871+0000 7fc0472da640 1 -- 172.21.15.88:0/3600404168 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0401468a0 con 0x7fc0401e24d0 2024-01-22T10:13:58.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.871+0000 7fc035ffb640 1 -- 172.21.15.88:0/3600404168 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03800c9c0 con 0x7fc0401e24d0 2024-01-22T10:13:58.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.871+0000 7fc0472da640 1 -- 172.21.15.88:0/3600404168 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0401d8340 con 0x7fc0401e24d0 2024-01-22T10:13:58.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.872+0000 7fc0472da640 1 -- 172.21.15.88:0/3600404168 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc040146c40 con 0x7fc0401e24d0 2024-01-22T10:13:58.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.872+0000 7fc035ffb640 1 -- 172.21.15.88:0/3600404168 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fc03800cb20 con 0x7fc0401e24d0 2024-01-22T10:13:58.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.873+0000 7fc035ffb640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc02406b330 0x7fc02406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.873+0000 7fc035ffb640 1 -- 172.21.15.88:0/3600404168 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc038089280 con 0x7fc0401e24d0 2024-01-22T10:13:58.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.873+0000 7fc045076640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc02406b330 0x7fc02406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.873+0000 7fc035ffb640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] conn(0x7fc024073360 0x7fc024075780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.873+0000 7fc035ffb640 1 -- 172.21.15.88:0/3600404168 --> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc024075e30 con 0x7fc024073360 2024-01-22T10:13:58.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.873+0000 7fc035ffb640 1 -- 172.21.15.88:0/3600404168 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc03808b940 con 0x7fc0401e24d0 2024-01-22T10:13:58.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.873+0000 7fc044875640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] conn(0x7fc024073360 0x7fc024075780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.873+0000 7fc045076640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc02406b330 0x7fc02406d7f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc03c000f80 tx=0x7fc03c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.873+0000 7fc044875640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] conn(0x7fc024073360 0x7fc024075780 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.874+0000 7fc035ffb640 1 -- 172.21.15.88:0/3600404168 <== osd.3 v2:172.21.15.88:6811/1947300237 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc024075e30 con 0x7fc024073360 2024-01-22T10:13:58.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc0472da640 1 -- 172.21.15.88:0/3600404168 --> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc04014f580 con 0x7fc024073360 2024-01-22T10:13:58.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc035ffb640 1 -- 172.21.15.88:0/3600404168 <== osd.3 v2:172.21.15.88:6811/1947300237 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc030004260 con 0x7fc024073360 2024-01-22T10:13:58.869 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-01-22T10:13:58.870 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-22T10:13:58.870 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-01-22T10:13:58.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc0472da640 1 -- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] conn(0x7fc024073360 msgr2=0x7fc024075780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc0472da640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:6811/1947300237,v1:172.21.15.88:6813/1947300237] conn(0x7fc024073360 0x7fc024075780 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc0472da640 1 -- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc02406b330 msgr2=0x7fc02406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc0472da640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc02406b330 0x7fc02406d7f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc03c000f80 tx=0x7fc03c009040 comp rx=0 tx=0).stop 2024-01-22T10:13:58.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc0472da640 1 -- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0401e24d0 msgr2=0x7fc0401e2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc0472da640 1 --2- 172.21.15.88:0/3600404168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0401e24d0 0x7fc0401e2930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc04006b740 tx=0x7fc03800eb90 comp rx=0 tx=0).stop 2024-01-22T10:13:58.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc045877640 1 -- 172.21.15.88:0/3600404168 reap_dead start 2024-01-22T10:13:58.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc0472da640 1 -- 172.21.15.88:0/3600404168 shutdown_connections 2024-01-22T10:13:58.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc0472da640 1 -- 172.21.15.88:0/3600404168 >> 172.21.15.88:0/3600404168 conn(0x7fc0400bb6f0 msgr2=0x7fc0400bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:58.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc0472da640 1 -- 172.21.15.88:0/3600404168 shutdown_connections 2024-01-22T10:13:58.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.887+0000 7fc0472da640 1 -- 172.21.15.88:0/3600404168 wait complete. 2024-01-22T10:13:58.880 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-22T10:13:58.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.997+0000 7f1c23fd0640 1 Processor -- start 2024-01-22T10:13:58.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.997+0000 7f1c23fd0640 1 -- start start 2024-01-22T10:13:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.998+0000 7f1c23fd0640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1c1c06df70 0x7f1c1c0b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.998+0000 7f1c23fd0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c1c14a170 0x7f1c1c0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.998+0000 7f1c23fd0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c149ce0 con 0x7f1c1c0b5440 2024-01-22T10:13:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.998+0000 7f1c23fd0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c143bf0 con 0x7f1c1c14a170 2024-01-22T10:13:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.998+0000 7f1c23fd0640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c1494b0 con 0x7f1c1c06df70 2024-01-22T10:13:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.998+0000 7f1c2156b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c1c14a170 0x7f1c1c0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.998+0000 7f1c2156b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c1c14a170 0x7f1c1c0b4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46418/0 (socket says 172.21.15.88:46418) 2024-01-22T10:13:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.998+0000 7f1c2156b640 1 -- 172.21.15.88:0/4274822756 learned_addr learned my addr 172.21.15.88:0/4274822756 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.998+0000 7f1c21d6c640 1 --2- 172.21.15.88:0/4274822756 >> v2:172.21.15.119:3300/0 conn(0x7f1c1c06df70 0x7f1c1c0b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.998+0000 7f1c2156b640 1 -- 172.21.15.88:0/4274822756 >> v2:172.21.15.119:3300/0 conn(0x7f1c1c06df70 msgr2=0x7f1c1c0b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.998+0000 7f1c2156b640 1 --2- 172.21.15.88:0/4274822756 >> v2:172.21.15.119:3300/0 conn(0x7f1c1c06df70 0x7f1c1c0b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.999+0000 7f1c2156b640 1 -- 172.21.15.88:0/4274822756 >> v1:172.21.15.119:6789/0 conn(0x7f1c1c0b5440 legacy=0x7f1c1c14ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.999+0000 7f1c2156b640 1 -- 172.21.15.88:0/4274822756 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c0b4720 con 0x7f1c1c14a170 2024-01-22T10:13:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.999+0000 7f1c2156b640 1 --2- 172.21.15.88:0/4274822756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c1c14a170 0x7f1c1c0b4f00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c06fff0 tx=0x7f1c0c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcec2202f1ad3370 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.999+0000 7f1c20d6a640 1 -- 172.21.15.88:0/4274822756 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c030860 con 0x7f1c1c14a170 2024-01-22T10:13:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.999+0000 7f1c20d6a640 1 -- 172.21.15.88:0/4274822756 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c0309c0 con 0x7f1c1c14a170 2024-01-22T10:13:58.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:58.999+0000 7f1c20d6a640 1 -- 172.21.15.88:0/4274822756 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c030d50 con 0x7f1c1c14a170 2024-01-22T10:13:58.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.000+0000 7f1c23fd0640 1 -- 172.21.15.88:0/4274822756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c1c14a170 msgr2=0x7f1c1c0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.000+0000 7f1c23fd0640 1 --2- 172.21.15.88:0/4274822756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c1c14a170 0x7f1c1c0b4f00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c06fff0 tx=0x7f1c0c02b9a0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.000+0000 7f1c23fd0640 1 -- 172.21.15.88:0/4274822756 shutdown_connections 2024-01-22T10:13:58.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.000+0000 7f1c23fd0640 1 --2- 172.21.15.88:0/4274822756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c1c14a170 0x7f1c1c0b4f00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.000+0000 7f1c23fd0640 1 --2- 172.21.15.88:0/4274822756 >> v2:172.21.15.119:3300/0 conn(0x7f1c1c06df70 0x7f1c1c0b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.000+0000 7f1c23fd0640 1 -- 172.21.15.88:0/4274822756 >> 172.21.15.88:0/4274822756 conn(0x7f1c1c0bec50 msgr2=0x7f1c1c0bf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:58.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.000+0000 7f1c23fd0640 1 -- 172.21.15.88:0/4274822756 shutdown_connections 2024-01-22T10:13:58.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.000+0000 7f1c23fd0640 1 -- 172.21.15.88:0/4274822756 wait complete. 2024-01-22T10:13:58.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.001+0000 7f1c23fd0640 1 Processor -- start 2024-01-22T10:13:58.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.001+0000 7f1c23fd0640 1 -- start start 2024-01-22T10:13:58.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c23fd0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c1c06df70 0x7f1c1c13fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c23fd0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c1c14a170 0x7f1c1c1d4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c23fd0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c1c1e0da0 0x7f1c1c06cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c23fd0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1d4650 con 0x7f1c1c1e0da0 2024-01-22T10:13:58.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c23fd0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1d3930 con 0x7f1c1c06df70 2024-01-22T10:13:58.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c23fd0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1d3c10 con 0x7f1c1c14a170 2024-01-22T10:13:58.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c2256d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c1c1e0da0 0x7f1c1c06cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c2256d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c1c1e0da0 0x7f1c1c06cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46420/0 (socket says 172.21.15.88:46420) 2024-01-22T10:13:58.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c2256d640 1 -- 172.21.15.88:0/1255854143 learned_addr learned my addr 172.21.15.88:0/1255854143 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:58.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c2156b640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c1c14a170 0x7f1c1c1d4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c21d6c640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c1c06df70 0x7f1c1c13fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c2256d640 1 -- 172.21.15.88:0/1255854143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c1c14a170 msgr2=0x7f1c1c1d4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c2256d640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c1c14a170 0x7f1c1c1d4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c2256d640 1 -- 172.21.15.88:0/1255854143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c1c06df70 msgr2=0x7f1c1c13fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:58.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c2256d640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c1c06df70 0x7f1c1c13fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:58.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c2256d640 1 -- 172.21.15.88:0/1255854143 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c0094d0 con 0x7f1c1c1e0da0 2024-01-22T10:13:58.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c2256d640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c1c1e0da0 0x7f1c1c06cad0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400c3c0 tx=0x7f1c1400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c127fc640 1 -- 172.21.15.88:0/1255854143 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140052d0 con 0x7f1c1c1e0da0 2024-01-22T10:13:58.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c127fc640 1 -- 172.21.15.88:0/1255854143 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14005430 con 0x7f1c1c1e0da0 2024-01-22T10:13:58.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c127fc640 1 -- 172.21.15.88:0/1255854143 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14003830 con 0x7f1c1c1e0da0 2024-01-22T10:13:58.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c23fd0640 1 -- 172.21.15.88:0/1255854143 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c1d4fe0 con 0x7f1c1c1e0da0 2024-01-22T10:13:58.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.002+0000 7f1c23fd0640 1 -- 172.21.15.88:0/1255854143 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c1d55a0 con 0x7f1c1c1e0da0 2024-01-22T10:13:58.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.003+0000 7f1c23fd0640 1 -- 172.21.15.88:0/1255854143 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c1d57c0 con 0x7f1c1c1e0da0 2024-01-22T10:13:58.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.004+0000 7f1c127fc640 1 -- 172.21.15.88:0/1255854143 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f1c14003990 con 0x7f1c1c1e0da0 2024-01-22T10:13:58.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.004+0000 7f1c127fc640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1c0006b330 0x7f1c0006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:58.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.004+0000 7f1c127fc640 1 -- 172.21.15.88:0/1255854143 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c140890f0 con 0x7f1c1c1e0da0 2024-01-22T10:13:58.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.004+0000 7f1c21d6c640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1c0006b330 0x7f1c0006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:58.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.005+0000 7f1c21d6c640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1c0006b330 0x7f1c0006d7f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009a60 tx=0x7f1c18003990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:58.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.008+0000 7f1c127fc640 1 -- 172.21.15.88:0/1255854143 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1c14053d80 con 0x7f1c1c1e0da0 2024-01-22T10:13:59.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.178+0000 7f1c23fd0640 1 -- 172.21.15.88:0/1255854143 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c1c149970 con 0x7f1c0006b330 2024-01-22T10:13:59.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.178+0000 7f1c127fc640 1 -- 172.21.15.88:0/1255854143 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1c18004780 con 0x7f1c0006b330 2024-01-22T10:13:59.161 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 3 to deep-scrub 2024-01-22T10:13:59.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.180+0000 7f1c23fd0640 1 -- 172.21.15.88:0/1255854143 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1c0006b330 msgr2=0x7f1c0006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.180+0000 7f1c23fd0640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1c0006b330 0x7f1c0006d7f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009a60 tx=0x7f1c18003990 comp rx=0 tx=0).stop 2024-01-22T10:13:59.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.180+0000 7f1c23fd0640 1 -- 172.21.15.88:0/1255854143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c1c1e0da0 msgr2=0x7f1c1c06cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.180+0000 7f1c23fd0640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c1c1e0da0 0x7f1c1c06cad0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400c3c0 tx=0x7f1c1400c880 comp rx=0 tx=0).stop 2024-01-22T10:13:59.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.180+0000 7f1c23fd0640 1 -- 172.21.15.88:0/1255854143 shutdown_connections 2024-01-22T10:13:59.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.180+0000 7f1c23fd0640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f1c0006b330 0x7f1c0006d7f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.180+0000 7f1c23fd0640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c1c14a170 0x7f1c1c1d4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.180+0000 7f1c23fd0640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c1c1e0da0 0x7f1c1c06cad0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.180+0000 7f1c23fd0640 1 --2- 172.21.15.88:0/1255854143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c1c06df70 0x7f1c1c13fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.180+0000 7f1c23fd0640 1 -- 172.21.15.88:0/1255854143 >> 172.21.15.88:0/1255854143 conn(0x7f1c1c0bec50 msgr2=0x7f1c1c0b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:59.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.180+0000 7f1c23fd0640 1 -- 172.21.15.88:0/1255854143 shutdown_connections 2024-01-22T10:13:59.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.180+0000 7f1c23fd0640 1 -- 172.21.15.88:0/1255854143 wait complete. 2024-01-22T10:13:59.173 INFO:tasks.ceph:Scrubbing osd.4 2024-01-22T10:13:59.174 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-22T10:13:59.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.295+0000 7f660e056640 1 Processor -- start 2024-01-22T10:13:59.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.295+0000 7f660e056640 1 -- start start 2024-01-22T10:13:59.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f660e056640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6608072a40 0x7f6608148400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f660e056640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6608150d00 0x7f66081530f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f660e056640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66080b4f90 con 0x7f66080b6b90 2024-01-22T10:13:59.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f660e056640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66080b52c0 con 0x7f6608072a40 2024-01-22T10:13:59.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f660e056640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6608148940 con 0x7f6608150d00 2024-01-22T10:13:59.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f66077fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6608072a40 0x7f6608148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f6606ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f66080b6b90 0x7f66080bd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60740/0 (socket says 172.21.15.88:60740) 2024-01-22T10:13:59.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f66077fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6608072a40 0x7f6608148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46436/0 (socket says 172.21.15.88:46436) 2024-01-22T10:13:59.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f6606ffd640 1 -- 172.21.15.88:0/3282190553 learned_addr learned my addr 172.21.15.88:0/3282190553 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:59.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f6607fff640 1 --2- 172.21.15.88:0/3282190553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6608150d00 0x7f66081530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f66077fe640 1 -- 172.21.15.88:0/3282190553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6608150d00 msgr2=0x7f66081530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:59.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f66077fe640 1 --2- 172.21.15.88:0/3282190553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6608150d00 0x7f66081530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f66077fe640 1 -- 172.21.15.88:0/3282190553 >> v1:172.21.15.88:6789/0 conn(0x7f66080b6b90 legacy=0x7f66080bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f66077fe640 1 -- 172.21.15.88:0/3282190553 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66080b4a60 con 0x7f6608072a40 2024-01-22T10:13:59.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.296+0000 7f66067fc640 1 -- 172.21.15.88:0/3282190553 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125659880 0 0) 0x7f65fc001110 con 0x7f66080b6b90 2024-01-22T10:13:59.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.297+0000 7f66077fe640 1 --2- 172.21.15.88:0/3282190553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6608072a40 0x7f6608148400 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f65f80097a0 tx=0x7f65f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63fa2b6beac7ca0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.297+0000 7f66067fc640 1 -- 172.21.15.88:0/3282190553 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8031830 con 0x7f6608072a40 2024-01-22T10:13:59.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.297+0000 7f66067fc640 1 -- 172.21.15.88:0/3282190553 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f8031990 con 0x7f6608072a40 2024-01-22T10:13:59.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.297+0000 7f66067fc640 1 -- 172.21.15.88:0/3282190553 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8031d20 con 0x7f6608072a40 2024-01-22T10:13:59.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.298+0000 7f660e056640 1 -- 172.21.15.88:0/3282190553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6608072a40 msgr2=0x7f6608148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.298+0000 7f660e056640 1 --2- 172.21.15.88:0/3282190553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6608072a40 0x7f6608148400 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f65f80097a0 tx=0x7f65f802b8d0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.298+0000 7f660e056640 1 -- 172.21.15.88:0/3282190553 shutdown_connections 2024-01-22T10:13:59.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.298+0000 7f660e056640 1 --2- 172.21.15.88:0/3282190553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6608150d00 0x7f66081530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.298+0000 7f660e056640 1 --2- 172.21.15.88:0/3282190553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6608072a40 0x7f6608148400 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.298+0000 7f660e056640 1 -- 172.21.15.88:0/3282190553 >> 172.21.15.88:0/3282190553 conn(0x7f660806ad20 msgr2=0x7f66080bcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:59.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.298+0000 7f660e056640 1 -- 172.21.15.88:0/3282190553 shutdown_connections 2024-01-22T10:13:59.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.298+0000 7f660e056640 1 -- 172.21.15.88:0/3282190553 wait complete. 2024-01-22T10:13:59.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.299+0000 7f660e056640 1 Processor -- start 2024-01-22T10:13:59.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.299+0000 7f660e056640 1 -- start start 2024-01-22T10:13:59.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.299+0000 7f660e056640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6608072a40 0x7f660806f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.299+0000 7f660e056640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66080b6b90 0x7f66081444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.299+0000 7f660e056640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6608150d00 0x7f6608144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.299+0000 7f660e056640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6608155700 con 0x7f6608150d00 2024-01-22T10:13:59.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.299+0000 7f660e056640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66080bbd60 con 0x7f66080b6b90 2024-01-22T10:13:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.299+0000 7f660e056640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6608070a60 con 0x7f6608072a40 2024-01-22T10:13:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.299+0000 7f6607fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6608150d00 0x7f6608144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.299+0000 7f6607fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6608150d00 0x7f6608144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46440/0 (socket says 172.21.15.88:46440) 2024-01-22T10:13:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.299+0000 7f6607fff640 1 -- 172.21.15.88:0/3804111265 learned_addr learned my addr 172.21.15.88:0/3804111265 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.300+0000 7f6607fff640 1 -- 172.21.15.88:0/3804111265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6608072a40 msgr2=0x7f660806f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.300+0000 7f6607fff640 1 --2- 172.21.15.88:0/3804111265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6608072a40 0x7f660806f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.300+0000 7f6607fff640 1 -- 172.21.15.88:0/3804111265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66080b6b90 msgr2=0x7f66081444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.300+0000 7f6607fff640 1 --2- 172.21.15.88:0/3804111265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66080b6b90 0x7f66081444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.300+0000 7f6607fff640 1 -- 172.21.15.88:0/3804111265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f8009400 con 0x7f6608150d00 2024-01-22T10:13:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.300+0000 7f6607fff640 1 --2- 172.21.15.88:0/3804111265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6608150d00 0x7f6608144a10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6600007d80 tx=0x7f660000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.300+0000 7f65effff640 1 -- 172.21.15.88:0/3804111265 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600014420 con 0x7f6608150d00 2024-01-22T10:13:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.300+0000 7f65effff640 1 -- 172.21.15.88:0/3804111265 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66000145a0 con 0x7f6608150d00 2024-01-22T10:13:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.300+0000 7f65effff640 1 -- 172.21.15.88:0/3804111265 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600014950 con 0x7f6608150d00 2024-01-22T10:13:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.300+0000 7f660e056640 1 -- 172.21.15.88:0/3804111265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66080bb050 con 0x7f6608150d00 2024-01-22T10:13:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.300+0000 7f660e056640 1 -- 172.21.15.88:0/3804111265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6608155420 con 0x7f6608150d00 2024-01-22T10:13:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.301+0000 7f660e056640 1 -- 172.21.15.88:0/3804111265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66080bd970 con 0x7f6608150d00 2024-01-22T10:13:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.301+0000 7f65effff640 1 -- 172.21.15.88:0/3804111265 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f6600014ab0 con 0x7f6608150d00 2024-01-22T10:13:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.302+0000 7f65effff640 1 --2- 172.21.15.88:0/3804111265 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f65f406b360 0x7f65f406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.302+0000 7f65effff640 1 -- 172.21.15.88:0/3804111265 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f660008a4e0 con 0x7f6608150d00 2024-01-22T10:13:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.302+0000 7f66077fe640 1 --2- 172.21.15.88:0/3804111265 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f65f406b360 0x7f65f406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.302+0000 7f65effff640 1 --2- 172.21.15.88:0/3804111265 >> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] conn(0x7f65f4073500 0x7f65f4075920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.302+0000 7f65effff640 1 -- 172.21.15.88:0/3804111265 --> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65f4075fd0 con 0x7f65f4073500 2024-01-22T10:13:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.302+0000 7f65effff640 1 -- 172.21.15.88:0/3804111265 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f660008cba0 con 0x7f6608150d00 2024-01-22T10:13:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.302+0000 7f66077fe640 1 --2- 172.21.15.88:0/3804111265 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f65f406b360 0x7f65f406d820 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f65f8036000 tx=0x7f65f8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.302+0000 7f6606ffd640 1 --2- 172.21.15.88:0/3804111265 >> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] conn(0x7f65f4073500 0x7f65f4075920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.303+0000 7f6606ffd640 1 --2- 172.21.15.88:0/3804111265 >> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] conn(0x7f65f4073500 0x7f65f4075920 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.303+0000 7f65effff640 1 -- 172.21.15.88:0/3804111265 <== osd.4 v2:172.21.15.119:6800/4248437697 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f65f4075fd0 con 0x7f65f4073500 2024-01-22T10:13:59.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.316+0000 7f660e056640 1 -- 172.21.15.88:0/3804111265 --> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f66080b6700 con 0x7f65f4073500 2024-01-22T10:13:59.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.317+0000 7f65effff640 1 -- 172.21.15.88:0/3804111265 <== osd.4 v2:172.21.15.119:6800/4248437697 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f65fc0070e0 con 0x7f65f4073500 2024-01-22T10:13:59.299 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-01-22T10:13:59.300 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-22T10:13:59.300 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-01-22T10:13:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.317+0000 7f660e056640 1 -- 172.21.15.88:0/3804111265 >> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] conn(0x7f65f4073500 msgr2=0x7f65f4075920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.317+0000 7f660e056640 1 --2- 172.21.15.88:0/3804111265 >> [v2:172.21.15.119:6800/4248437697,v1:172.21.15.119:6801/4248437697] conn(0x7f65f4073500 0x7f65f4075920 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.317+0000 7f660e056640 1 -- 172.21.15.88:0/3804111265 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f65f406b360 msgr2=0x7f65f406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.317+0000 7f660e056640 1 --2- 172.21.15.88:0/3804111265 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f65f406b360 0x7f65f406d820 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f65f8036000 tx=0x7f65f8030000 comp rx=0 tx=0).stop 2024-01-22T10:13:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.317+0000 7f660e056640 1 -- 172.21.15.88:0/3804111265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6608150d00 msgr2=0x7f6608144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.317+0000 7f660e056640 1 --2- 172.21.15.88:0/3804111265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6608150d00 0x7f6608144a10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6600007d80 tx=0x7f660000e4b0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.317+0000 7f6607fff640 1 -- 172.21.15.88:0/3804111265 reap_dead start 2024-01-22T10:13:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.317+0000 7f660e056640 1 -- 172.21.15.88:0/3804111265 shutdown_connections 2024-01-22T10:13:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.317+0000 7f660e056640 1 -- 172.21.15.88:0/3804111265 >> 172.21.15.88:0/3804111265 conn(0x7f660806ad20 msgr2=0x7f6608142010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.317+0000 7f660e056640 1 -- 172.21.15.88:0/3804111265 shutdown_connections 2024-01-22T10:13:59.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.317+0000 7f660e056640 1 -- 172.21.15.88:0/3804111265 wait complete. 2024-01-22T10:13:59.310 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-22T10:13:59.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.428+0000 7f306ea87640 1 Processor -- start 2024-01-22T10:13:59.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.428+0000 7f306ea87640 1 -- start start 2024-01-22T10:13:59.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.429+0000 7f306ea87640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f306806aea0 0x7f306806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.429+0000 7f306ea87640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30680bec90 0x7f306814ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.429+0000 7f306ea87640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306814b8e0 con 0x7f30680bd520 2024-01-22T10:13:59.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.429+0000 7f306ea87640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306806be20 con 0x7f306806aea0 2024-01-22T10:13:59.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.429+0000 7f306ea87640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306806c650 con 0x7f30680bec90 2024-01-22T10:13:59.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.429+0000 7f306d024640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30680bec90 0x7f306814ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.429+0000 7f306c823640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f306806aea0 0x7f306806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.429+0000 7f3067fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f30680bd520 0x7f306814c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.88:58752/0 (socket says 172.21.15.88:58752) 2024-01-22T10:13:59.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.429+0000 7f3067fff640 1 -- 172.21.15.88:0/3408531922 learned_addr learned my addr 172.21.15.88:0/3408531922 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:13:59.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.429+0000 7f306d024640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30680bec90 0x7f306814ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.88:37826/0 (socket says 172.21.15.88:37826) 2024-01-22T10:13:59.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.430+0000 7f30677fe640 1 -- 172.21.15.88:0/3408531922 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359496681 0 0) 0x7f306814b8e0 con 0x7f30680bd520 2024-01-22T10:13:59.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.430+0000 7f30677fe640 1 -- 172.21.15.88:0/3408531922 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3050003520 con 0x7f30680bd520 2024-01-22T10:13:59.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.430+0000 7f306d024640 1 -- 172.21.15.88:0/3408531922 >> v2:172.21.15.119:3300/0 conn(0x7f306806aea0 msgr2=0x7f306806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:59.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.430+0000 7f306d024640 1 --2- 172.21.15.88:0/3408531922 >> v2:172.21.15.119:3300/0 conn(0x7f306806aea0 0x7f306806bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.430+0000 7f306d024640 1 -- 172.21.15.88:0/3408531922 >> v1:172.21.15.119:6789/0 conn(0x7f30680bd520 legacy=0x7f306814c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.430+0000 7f306d024640 1 -- 172.21.15.88:0/3408531922 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30680b45c0 con 0x7f30680bec90 2024-01-22T10:13:59.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.430+0000 7f306d024640 1 --2- 172.21.15.88:0/3408531922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30680bec90 0x7f306814ad80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3060009d90 tx=0x7f306002bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d84877599a14c83 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.431+0000 7f30677fe640 1 -- 172.21.15.88:0/3408531922 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306002cb30 con 0x7f30680bec90 2024-01-22T10:13:59.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.431+0000 7f30677fe640 1 -- 172.21.15.88:0/3408531922 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306002cc90 con 0x7f30680bec90 2024-01-22T10:13:59.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.431+0000 7f30677fe640 1 -- 172.21.15.88:0/3408531922 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060034440 con 0x7f30680bec90 2024-01-22T10:13:59.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.431+0000 7f306ea87640 1 -- 172.21.15.88:0/3408531922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30680bec90 msgr2=0x7f306814ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.431+0000 7f306ea87640 1 --2- 172.21.15.88:0/3408531922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30680bec90 0x7f306814ad80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3060009d90 tx=0x7f306002bd80 comp rx=0 tx=0).stop 2024-01-22T10:13:59.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.431+0000 7f306ea87640 1 -- 172.21.15.88:0/3408531922 shutdown_connections 2024-01-22T10:13:59.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.431+0000 7f306ea87640 1 --2- 172.21.15.88:0/3408531922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30680bec90 0x7f306814ad80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.431+0000 7f306ea87640 1 --2- 172.21.15.88:0/3408531922 >> v2:172.21.15.119:3300/0 conn(0x7f306806aea0 0x7f306806bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.431+0000 7f306ea87640 1 -- 172.21.15.88:0/3408531922 >> 172.21.15.88:0/3408531922 conn(0x7f30680c0e90 msgr2=0x7f30680c1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:59.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.431+0000 7f306ea87640 1 -- 172.21.15.88:0/3408531922 shutdown_connections 2024-01-22T10:13:59.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.431+0000 7f306ea87640 1 -- 172.21.15.88:0/3408531922 wait complete. 2024-01-22T10:13:59.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.432+0000 7f306ea87640 1 Processor -- start 2024-01-22T10:13:59.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.432+0000 7f306ea87640 1 -- start start 2024-01-22T10:13:59.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306ea87640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f306806aea0 0x7f30681e4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306ea87640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30680bec90 0x7f30680b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306ea87640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30680b62b0 0x7f30680a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306ea87640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30680b7700 con 0x7f30680b62b0 2024-01-22T10:13:59.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306ea87640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30680a5fb0 con 0x7f306806aea0 2024-01-22T10:13:59.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306ea87640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30680b4db0 con 0x7f30680bec90 2024-01-22T10:13:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306d024640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30680b62b0 0x7f30680a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306d024640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30680b62b0 0x7f30680a5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46452/0 (socket says 172.21.15.88:46452) 2024-01-22T10:13:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306d024640 1 -- 172.21.15.88:0/241472902 learned_addr learned my addr 172.21.15.88:0/241472902 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f3067fff640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30680bec90 0x7f30680b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306c823640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f306806aea0 0x7f30681e4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306d024640 1 -- 172.21.15.88:0/241472902 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30680bec90 msgr2=0x7f30680b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306d024640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30680bec90 0x7f30680b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306d024640 1 -- 172.21.15.88:0/241472902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f306806aea0 msgr2=0x7f30681e4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306d024640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f306806aea0 0x7f30681e4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.433+0000 7f306d024640 1 -- 172.21.15.88:0/241472902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3060009a70 con 0x7f30680b62b0 2024-01-22T10:13:59.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.434+0000 7f306d024640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30680b62b0 0x7f30680a5a70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3060009eb0 tx=0x7f3060004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.434+0000 7f30657fa640 1 -- 172.21.15.88:0/241472902 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060009450 con 0x7f30680b62b0 2024-01-22T10:13:59.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.434+0000 7f30657fa640 1 -- 172.21.15.88:0/241472902 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3060003e10 con 0x7f30680b62b0 2024-01-22T10:13:59.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.434+0000 7f306ea87640 1 -- 172.21.15.88:0/241472902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30680b6790 con 0x7f30680b62b0 2024-01-22T10:13:59.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.434+0000 7f30657fa640 1 -- 172.21.15.88:0/241472902 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600048a0 con 0x7f30680b62b0 2024-01-22T10:13:59.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.434+0000 7f306ea87640 1 -- 172.21.15.88:0/241472902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30680b7420 con 0x7f30680b62b0 2024-01-22T10:13:59.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.435+0000 7f306ea87640 1 -- 172.21.15.88:0/241472902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306804ea30 con 0x7f30680b62b0 2024-01-22T10:13:59.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.435+0000 7f30657fa640 1 -- 172.21.15.88:0/241472902 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f3060034440 con 0x7f30680b62b0 2024-01-22T10:13:59.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.435+0000 7f30657fa640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f305406b360 0x7f305406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.435+0000 7f30657fa640 1 -- 172.21.15.88:0/241472902 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30600abd60 con 0x7f30680b62b0 2024-01-22T10:13:59.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.435+0000 7f306c823640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f305406b360 0x7f305406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.436+0000 7f306c823640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f305406b360 0x7f305406d820 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3058009b40 tx=0x7f3058009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.440+0000 7f30657fa640 1 -- 172.21.15.88:0/241472902 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3060076ad0 con 0x7f30680b62b0 2024-01-22T10:13:59.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.609+0000 7f306ea87640 1 -- 172.21.15.88:0/241472902 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f30680b4b80 con 0x7f305406b360 2024-01-22T10:13:59.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.609+0000 7f30657fa640 1 -- 172.21.15.88:0/241472902 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f30680b4b80 con 0x7f305406b360 2024-01-22T10:13:59.592 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 4 to deep-scrub 2024-01-22T10:13:59.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.611+0000 7f306ea87640 1 -- 172.21.15.88:0/241472902 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f305406b360 msgr2=0x7f305406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.611+0000 7f306ea87640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f305406b360 0x7f305406d820 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3058009b40 tx=0x7f3058009190 comp rx=0 tx=0).stop 2024-01-22T10:13:59.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.611+0000 7f306ea87640 1 -- 172.21.15.88:0/241472902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30680b62b0 msgr2=0x7f30680a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.611+0000 7f306ea87640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30680b62b0 0x7f30680a5a70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3060009eb0 tx=0x7f3060004a40 comp rx=0 tx=0).stop 2024-01-22T10:13:59.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.611+0000 7f306ea87640 1 -- 172.21.15.88:0/241472902 shutdown_connections 2024-01-22T10:13:59.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.611+0000 7f306ea87640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f305406b360 0x7f305406d820 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.611+0000 7f306ea87640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30680bec90 0x7f30680b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.611+0000 7f306ea87640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30680b62b0 0x7f30680a5a70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.611+0000 7f306ea87640 1 --2- 172.21.15.88:0/241472902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f306806aea0 0x7f30681e4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.611+0000 7f306ea87640 1 -- 172.21.15.88:0/241472902 >> 172.21.15.88:0/241472902 conn(0x7f30680c0e90 msgr2=0x7f30680bfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:59.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.611+0000 7f306ea87640 1 -- 172.21.15.88:0/241472902 shutdown_connections 2024-01-22T10:13:59.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.611+0000 7f306ea87640 1 -- 172.21.15.88:0/241472902 wait complete. 2024-01-22T10:13:59.604 INFO:tasks.ceph:Scrubbing osd.5 2024-01-22T10:13:59.604 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-22T10:13:59.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.725+0000 7f096e173640 1 Processor -- start 2024-01-22T10:13:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.725+0000 7f096e173640 1 -- start start 2024-01-22T10:13:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f096e173640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f096806f770 0x7f0968145650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f096e173640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096806dc90 0x7f096806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f096e173640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f096806be80 0x7f096814b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f096e173640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f096806e670 con 0x7f096806f770 2024-01-22T10:13:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f096e173640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f096814f8f0 con 0x7f096806be80 2024-01-22T10:13:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f096e173640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096806c2f0 con 0x7f096806dc90 2024-01-22T10:13:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f09677fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f096806f770 0x7f0968145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f09677fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f096806f770 0x7f0968145650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46464/0 (socket says 172.21.15.88:46464) 2024-01-22T10:13:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f09677fe640 1 -- 172.21.15.88:0/1371268174 learned_addr learned my addr 172.21.15.88:0/1371268174 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f0967fff640 1 --2- 172.21.15.88:0/1371268174 >> v2:172.21.15.119:3300/0 conn(0x7f096806be80 0x7f096814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f09677fe640 1 -- 172.21.15.88:0/1371268174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096806dc90 msgr2=0x7f096806b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f0966ffd640 1 --2- 172.21.15.88:0/1371268174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096806dc90 0x7f096806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f09677fe640 1 --2- 172.21.15.88:0/1371268174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096806dc90 0x7f096806b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f09677fe640 1 -- 172.21.15.88:0/1371268174 >> v2:172.21.15.119:3300/0 conn(0x7f096806be80 msgr2=0x7f096814b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f09677fe640 1 --2- 172.21.15.88:0/1371268174 >> v2:172.21.15.119:3300/0 conn(0x7f096806be80 0x7f096814b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f09677fe640 1 -- 172.21.15.88:0/1371268174 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09680bb410 con 0x7f096806f770 2024-01-22T10:13:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f0966ffd640 1 --2- 172.21.15.88:0/1371268174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096806dc90 0x7f096806b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.726+0000 7f0967fff640 1 --2- 172.21.15.88:0/1371268174 >> v2:172.21.15.119:3300/0 conn(0x7f096806be80 0x7f096814b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.727+0000 7f09677fe640 1 --2- 172.21.15.88:0/1371268174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096806f770 0x7f0968145650 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0968072460 tx=0x7f095802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d96def2a1d67e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.727+0000 7f09667fc640 1 -- 172.21.15.88:0/1371268174 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0958031870 con 0x7f096806f770 2024-01-22T10:13:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.727+0000 7f09667fc640 1 -- 172.21.15.88:0/1371268174 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09580319d0 con 0x7f096806f770 2024-01-22T10:13:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.727+0000 7f09667fc640 1 -- 172.21.15.88:0/1371268174 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0958031d60 con 0x7f096806f770 2024-01-22T10:13:59.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.728+0000 7f096e173640 1 -- 172.21.15.88:0/1371268174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096806f770 msgr2=0x7f0968145650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.728+0000 7f096e173640 1 --2- 172.21.15.88:0/1371268174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096806f770 0x7f0968145650 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0968072460 tx=0x7f095802b910 comp rx=0 tx=0).stop 2024-01-22T10:13:59.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.728+0000 7f096e173640 1 -- 172.21.15.88:0/1371268174 shutdown_connections 2024-01-22T10:13:59.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.728+0000 7f096e173640 1 --2- 172.21.15.88:0/1371268174 >> v2:172.21.15.119:3300/0 conn(0x7f096806be80 0x7f096814b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.728+0000 7f096e173640 1 --2- 172.21.15.88:0/1371268174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096806dc90 0x7f096806b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.728+0000 7f096e173640 1 --2- 172.21.15.88:0/1371268174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096806f770 0x7f0968145650 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.728+0000 7f096e173640 1 -- 172.21.15.88:0/1371268174 >> 172.21.15.88:0/1371268174 conn(0x7f09680bb6f0 msgr2=0x7f09680bbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:59.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.728+0000 7f096e173640 1 -- 172.21.15.88:0/1371268174 shutdown_connections 2024-01-22T10:13:59.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.728+0000 7f096e173640 1 -- 172.21.15.88:0/1371268174 wait complete. 2024-01-22T10:13:59.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.729+0000 7f096e173640 1 Processor -- start 2024-01-22T10:13:59.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.729+0000 7f096e173640 1 -- start start 2024-01-22T10:13:59.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f096e173640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096806be80 0x7f0968146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f096e173640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096806dc90 0x7f09680b83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f096e173640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f096806f770 0x7f09681e0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f096e173640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09680b88f0 con 0x7f096806dc90 2024-01-22T10:13:59.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f096e173640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09681461d0 con 0x7f096806f770 2024-01-22T10:13:59.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f096e173640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09680b2860 con 0x7f096806be80 2024-01-22T10:13:59.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f0966ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096806dc90 0x7f09680b83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f0966ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096806dc90 0x7f09680b83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46472/0 (socket says 172.21.15.88:46472) 2024-01-22T10:13:59.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f0966ffd640 1 -- 172.21.15.88:0/3978407541 learned_addr learned my addr 172.21.15.88:0/3978407541 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:59.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f09677fe640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096806be80 0x7f0968146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f0967fff640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f096806f770 0x7f09681e0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f0966ffd640 1 -- 172.21.15.88:0/3978407541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096806be80 msgr2=0x7f0968146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f0966ffd640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096806be80 0x7f0968146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f0966ffd640 1 -- 172.21.15.88:0/3978407541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f096806f770 msgr2=0x7f09681e0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f0966ffd640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f096806f770 0x7f09681e0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f0966ffd640 1 -- 172.21.15.88:0/3978407541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580094d0 con 0x7f096806dc90 2024-01-22T10:13:59.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f0966ffd640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096806dc90 0x7f09680b83b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f095c00c7f0 tx=0x7f095c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f094ffff640 1 -- 172.21.15.88:0/3978407541 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c007a30 con 0x7f096806dc90 2024-01-22T10:13:59.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f094ffff640 1 -- 172.21.15.88:0/3978407541 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c007b90 con 0x7f096806dc90 2024-01-22T10:13:59.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f096e173640 1 -- 172.21.15.88:0/3978407541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09680b8ac0 con 0x7f096806dc90 2024-01-22T10:13:59.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f094ffff640 1 -- 172.21.15.88:0/3978407541 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c00ce40 con 0x7f096806dc90 2024-01-22T10:13:59.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.730+0000 7f096e173640 1 -- 172.21.15.88:0/3978407541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0968145e60 con 0x7f096806dc90 2024-01-22T10:13:59.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.731+0000 7f096e173640 1 -- 172.21.15.88:0/3978407541 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f096814f580 con 0x7f096806dc90 2024-01-22T10:13:59.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.731+0000 7f094ffff640 1 -- 172.21.15.88:0/3978407541 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f095c0113f0 con 0x7f096806dc90 2024-01-22T10:13:59.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.732+0000 7f094ffff640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f095406b360 0x7f095406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.732+0000 7f094ffff640 1 -- 172.21.15.88:0/3978407541 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f095c089d20 con 0x7f096806dc90 2024-01-22T10:13:59.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.732+0000 7f09677fe640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f095406b360 0x7f095406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.732+0000 7f094ffff640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] conn(0x7f0954073500 0x7f0954075920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.732+0000 7f094ffff640 1 -- 172.21.15.88:0/3978407541 --> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0954075fd0 con 0x7f0954073500 2024-01-22T10:13:59.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.732+0000 7f094ffff640 1 -- 172.21.15.88:0/3978407541 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f095c08f070 con 0x7f096806dc90 2024-01-22T10:13:59.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.732+0000 7f09677fe640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f095406b360 0x7f095406d820 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0958036000 tx=0x7f095803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.732+0000 7f0967fff640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] conn(0x7f0954073500 0x7f0954075920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.733+0000 7f0967fff640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] conn(0x7f0954073500 0x7f0954075920 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.733+0000 7f094ffff640 1 -- 172.21.15.88:0/3978407541 <== osd.5 v2:172.21.15.119:6808/24229537 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0954075fd0 con 0x7f0954073500 2024-01-22T10:13:59.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.746+0000 7f096e173640 1 -- 172.21.15.88:0/3978407541 --> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f096814f2a0 con 0x7f0954073500 2024-01-22T10:13:59.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.747+0000 7f094ffff640 1 -- 172.21.15.88:0/3978407541 <== osd.5 v2:172.21.15.119:6808/24229537 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f096000e520 con 0x7f0954073500 2024-01-22T10:13:59.729 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-01-22T10:13:59.730 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-22T10:13:59.730 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-01-22T10:13:59.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.747+0000 7f096e173640 1 -- 172.21.15.88:0/3978407541 >> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] conn(0x7f0954073500 msgr2=0x7f0954075920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.747+0000 7f096e173640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.119:6808/24229537,v1:172.21.15.119:6809/24229537] conn(0x7f0954073500 0x7f0954075920 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.747+0000 7f096e173640 1 -- 172.21.15.88:0/3978407541 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f095406b360 msgr2=0x7f095406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.747+0000 7f096e173640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f095406b360 0x7f095406d820 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0958036000 tx=0x7f095803c040 comp rx=0 tx=0).stop 2024-01-22T10:13:59.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.747+0000 7f096e173640 1 -- 172.21.15.88:0/3978407541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096806dc90 msgr2=0x7f09680b83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.747+0000 7f096e173640 1 --2- 172.21.15.88:0/3978407541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096806dc90 0x7f09680b83b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f095c00c7f0 tx=0x7f095c00cbf0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.747+0000 7f0967fff640 1 -- 172.21.15.88:0/3978407541 reap_dead start 2024-01-22T10:13:59.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.747+0000 7f096e173640 1 -- 172.21.15.88:0/3978407541 shutdown_connections 2024-01-22T10:13:59.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.747+0000 7f096e173640 1 -- 172.21.15.88:0/3978407541 >> 172.21.15.88:0/3978407541 conn(0x7f09680bb6f0 msgr2=0x7f096806cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:59.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.747+0000 7f096e173640 1 -- 172.21.15.88:0/3978407541 shutdown_connections 2024-01-22T10:13:59.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.747+0000 7f096e173640 1 -- 172.21.15.88:0/3978407541 wait complete. 2024-01-22T10:13:59.740 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-22T10:13:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc66e0c9640 1 Processor -- start 2024-01-22T10:13:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc66e0c9640 1 -- start start 2024-01-22T10:13:59.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc66e0c9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc66814c1d0 0x7fc66806f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc66e0c9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc66806fc00 0x7fc6680b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc66e0c9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc66806e700 0x7fc66814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc66e0c9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66806c140 con 0x7fc66806e700 2024-01-22T10:13:59.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc66e0c9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66806cd90 con 0x7fc66806fc00 2024-01-22T10:13:59.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc66e0c9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66806d1b0 con 0x7fc66814c1d0 2024-01-22T10:13:59.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc667fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc66806e700 0x7fc66814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc667fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc66806e700 0x7fc66814ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46480/0 (socket says 172.21.15.88:46480) 2024-01-22T10:13:59.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc667fff640 1 -- 172.21.15.88:0/2520239385 learned_addr learned my addr 172.21.15.88:0/2520239385 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:59.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc6677fe640 1 --2- 172.21.15.88:0/2520239385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc66814c1d0 0x7fc66806f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.858+0000 7fc666ffd640 1 --2- 172.21.15.88:0/2520239385 >> v2:172.21.15.119:3300/0 conn(0x7fc66806fc00 0x7fc6680b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.859+0000 7fc667fff640 1 -- 172.21.15.88:0/2520239385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc66814c1d0 msgr2=0x7fc66806f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:59.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.859+0000 7fc667fff640 1 --2- 172.21.15.88:0/2520239385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc66814c1d0 0x7fc66806f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.859+0000 7fc667fff640 1 -- 172.21.15.88:0/2520239385 >> v2:172.21.15.119:3300/0 conn(0x7fc66806fc00 msgr2=0x7fc6680b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:13:59.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.859+0000 7fc667fff640 1 --2- 172.21.15.88:0/2520239385 >> v2:172.21.15.119:3300/0 conn(0x7fc66806fc00 0x7fc6680b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.859+0000 7fc667fff640 1 -- 172.21.15.88:0/2520239385 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66806d470 con 0x7fc66806e700 2024-01-22T10:13:59.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.859+0000 7fc6677fe640 1 --2- 172.21.15.88:0/2520239385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc66814c1d0 0x7fc66806f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:13:59.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.859+0000 7fc667fff640 1 --2- 172.21.15.88:0/2520239385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc66806e700 0x7fc66814ece0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc6680708b0 tx=0x7fc66002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcf633411b95c9e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.859+0000 7fc6667fc640 1 -- 172.21.15.88:0/2520239385 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66002ca70 con 0x7fc66806e700 2024-01-22T10:13:59.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.859+0000 7fc6667fc640 1 -- 172.21.15.88:0/2520239385 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66002cbd0 con 0x7fc66806e700 2024-01-22T10:13:59.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.859+0000 7fc6667fc640 1 -- 172.21.15.88:0/2520239385 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6600343f0 con 0x7fc66806e700 2024-01-22T10:13:59.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.860+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2520239385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc66806e700 msgr2=0x7fc66814ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.860+0000 7fc66e0c9640 1 --2- 172.21.15.88:0/2520239385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc66806e700 0x7fc66814ece0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc6680708b0 tx=0x7fc66002bed0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.860+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2520239385 shutdown_connections 2024-01-22T10:13:59.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.860+0000 7fc66e0c9640 1 --2- 172.21.15.88:0/2520239385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc66806e700 0x7fc66814ece0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.860+0000 7fc66e0c9640 1 --2- 172.21.15.88:0/2520239385 >> v2:172.21.15.119:3300/0 conn(0x7fc66806fc00 0x7fc6680b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.860+0000 7fc66e0c9640 1 --2- 172.21.15.88:0/2520239385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc66814c1d0 0x7fc66806f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.860+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2520239385 >> 172.21.15.88:0/2520239385 conn(0x7fc6680bb780 msgr2=0x7fc6680bbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:13:59.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.860+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2520239385 shutdown_connections 2024-01-22T10:13:59.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.860+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2520239385 wait complete. 2024-01-22T10:13:59.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.861+0000 7fc66e0c9640 1 Processor -- start 2024-01-22T10:13:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.861+0000 7fc66e0c9640 1 -- start start 2024-01-22T10:13:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc66e0c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc66806e700 0x7fc6680b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc66e0c9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc66806fc00 0x7fc668148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc66e0c9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc66814c1d0 0x7fc668146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc66e0c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680b8690 con 0x7fc66806e700 2024-01-22T10:13:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc66e0c9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6681464c0 con 0x7fc66806fc00 2024-01-22T10:13:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc66e0c9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680b82f0 con 0x7fc66814c1d0 2024-01-22T10:13:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc6677fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc66806e700 0x7fc6680b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc6677fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc66806e700 0x7fc6680b4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46492/0 (socket says 172.21.15.88:46492) 2024-01-22T10:13:59.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc6677fe640 1 -- 172.21.15.88:0/2100035993 learned_addr learned my addr 172.21.15.88:0/2100035993 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:13:59.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc666ffd640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc66806fc00 0x7fc668148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc667fff640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc66814c1d0 0x7fc668146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc6677fe640 1 -- 172.21.15.88:0/2100035993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc66814c1d0 msgr2=0x7fc668146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc6677fe640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc66814c1d0 0x7fc668146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc6677fe640 1 -- 172.21.15.88:0/2100035993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc66806fc00 msgr2=0x7fc668148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:13:59.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc6677fe640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc66806fc00 0x7fc668148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:13:59.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc6677fe640 1 -- 172.21.15.88:0/2100035993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009b30 con 0x7fc66806e700 2024-01-22T10:13:59.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc6677fe640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc66806e700 0x7fc6680b4cb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc65800c820 tx=0x7fc65800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc64ffff640 1 -- 172.21.15.88:0/2100035993 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658007a30 con 0x7fc66806e700 2024-01-22T10:13:59.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc64ffff640 1 -- 172.21.15.88:0/2100035993 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc658007b90 con 0x7fc66806e700 2024-01-22T10:13:59.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc64ffff640 1 -- 172.21.15.88:0/2100035993 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65800ce10 con 0x7fc66806e700 2024-01-22T10:13:59.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.862+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2100035993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc668146760 con 0x7fc66806e700 2024-01-22T10:13:59.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.863+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2100035993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc668148b40 con 0x7fc66806e700 2024-01-22T10:13:59.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.863+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2100035993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6680bb2d0 con 0x7fc66806e700 2024-01-22T10:13:59.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.864+0000 7fc64ffff640 1 -- 172.21.15.88:0/2100035993 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fc6580113f0 con 0x7fc66806e700 2024-01-22T10:13:59.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.864+0000 7fc64ffff640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc65406b360 0x7fc65406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:13:59.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.864+0000 7fc666ffd640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc65406b360 0x7fc65406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:13:59.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.864+0000 7fc64ffff640 1 -- 172.21.15.88:0/2100035993 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc658089bd0 con 0x7fc66806e700 2024-01-22T10:13:59.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.865+0000 7fc666ffd640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc65406b360 0x7fc65406d820 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc668145d90 tx=0x7fc65c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:13:59.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:13:59.869+0000 7fc64ffff640 1 -- 172.21.15.88:0/2100035993 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc658054910 con 0x7fc66806e700 2024-01-22T10:14:00.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.036+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2100035993 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc66814c5b0 con 0x7fc65406b360 2024-01-22T10:14:00.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.037+0000 7fc64ffff640 1 -- 172.21.15.88:0/2100035993 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc65c00b740 con 0x7fc65406b360 2024-01-22T10:14:00.020 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 5 to deep-scrub 2024-01-22T10:14:00.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.039+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2100035993 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc65406b360 msgr2=0x7fc65406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.039+0000 7fc66e0c9640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc65406b360 0x7fc65406d820 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc668145d90 tx=0x7fc65c008040 comp rx=0 tx=0).stop 2024-01-22T10:14:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.039+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2100035993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc66806e700 msgr2=0x7fc6680b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.039+0000 7fc66e0c9640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc66806e700 0x7fc6680b4cb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc65800c820 tx=0x7fc65800cce0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.039+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2100035993 shutdown_connections 2024-01-22T10:14:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.039+0000 7fc66e0c9640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc65406b360 0x7fc65406d820 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.039+0000 7fc66e0c9640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc66814c1d0 0x7fc668146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.039+0000 7fc66e0c9640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc66806fc00 0x7fc668148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.039+0000 7fc66e0c9640 1 --2- 172.21.15.88:0/2100035993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc66806e700 0x7fc6680b4cb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.039+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2100035993 >> 172.21.15.88:0/2100035993 conn(0x7fc6680bb780 msgr2=0x7fc6680b9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.039+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2100035993 shutdown_connections 2024-01-22T10:14:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.039+0000 7fc66e0c9640 1 -- 172.21.15.88:0/2100035993 wait complete. 2024-01-22T10:14:00.032 INFO:tasks.ceph:Scrubbing osd.6 2024-01-22T10:14:00.032 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-22T10:14:00.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.153+0000 7f17ac95a640 1 Processor -- start 2024-01-22T10:14:00.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.153+0000 7f17ac95a640 1 -- start start 2024-01-22T10:14:00.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17ac95a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8072a40 0x7f17a8148400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17ac95a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f17a80b6b90 0x7f17a80bd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17ac95a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a80b4f90 con 0x7f17a814b980 2024-01-22T10:14:00.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17ac95a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a80b52c0 con 0x7f17a80b6b90 2024-01-22T10:14:00.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17ac95a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a8148940 con 0x7f17a8072a40 2024-01-22T10:14:00.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a6d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f17a814b980 0x7f17a814bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60746/0 (socket says 172.21.15.88:60746) 2024-01-22T10:14:00.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a6d9d640 1 -- 172.21.15.88:0/4281576580 learned_addr learned my addr 172.21.15.88:0/4281576580 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:14:00.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169092892 0 0) 0x7f17a0001490 con 0x7f17a814b980 2024-01-22T10:14:00.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f179ffff640 1 --2- 172.21.15.88:0/4281576580 >> v2:172.21.15.119:3300/0 conn(0x7f17a80b6b90 0x7f17a80bd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1794003520 con 0x7f17a814b980 2024-01-22T10:14:00.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a659c640 1 --2- 172.21.15.88:0/4281576580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8072a40 0x7f17a8148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1243441828 0 0) 0x7f1794003520 con 0x7f17a814b980 2024-01-22T10:14:00.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8072a40 msgr2=0x7f17a8148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:00.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 --2- 172.21.15.88:0/4281576580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8072a40 0x7f17a8148400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 >> v2:172.21.15.119:3300/0 conn(0x7f17a80b6b90 msgr2=0x7f17a80bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:00.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 --2- 172.21.15.88:0/4281576580 >> v2:172.21.15.119:3300/0 conn(0x7f17a80b6b90 0x7f17a80bd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a80b4a60 con 0x7f17a814b980 2024-01-22T10:14:00.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f17a0001b80 con 0x7f17a814b980 2024-01-22T10:14:00.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 >> v1:172.21.15.88:6789/0 conn(0x7f17a814b980 legacy=0x7f17a814bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 --2- 172.21.15.88:0/4281576580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794003970 0x7f1794003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 --2- 172.21.15.88:0/4281576580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8072a40 0x7f17940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 --2- 172.21.15.88:0/4281576580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1794004d00 0x7f1794005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a8148940 con 0x7f1794003970 2024-01-22T10:14:00.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179400ba30 con 0x7f1794004d00 2024-01-22T10:14:00.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179400bb70 con 0x7f17a8072a40 2024-01-22T10:14:00.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f17a659c640 1 --2- 172.21.15.88:0/4281576580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794003970 0x7f1794003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.154+0000 7f179ffff640 1 --2- 172.21.15.88:0/4281576580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8072a40 0x7f17940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.155+0000 7f17a6d9d640 1 --2- 172.21.15.88:0/4281576580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1794004d00 0x7f1794005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.155+0000 7f17a659c640 1 -- 172.21.15.88:0/4281576580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8072a40 msgr2=0x7f17940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:00.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.155+0000 7f17a659c640 1 --2- 172.21.15.88:0/4281576580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8072a40 0x7f17940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.155+0000 7f17a659c640 1 -- 172.21.15.88:0/4281576580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1794004d00 msgr2=0x7f1794005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:00.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.155+0000 7f17a659c640 1 --2- 172.21.15.88:0/4281576580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1794004d00 0x7f1794005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.155+0000 7f17a659c640 1 -- 172.21.15.88:0/4281576580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1794003520 con 0x7f1794003970 2024-01-22T10:14:00.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.156+0000 7f17a659c640 1 --2- 172.21.15.88:0/4281576580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794003970 0x7f1794003d90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f179800ba60 tx=0x7f17940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea7259b0492f6bd server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.156+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798032630 con 0x7f1794003970 2024-01-22T10:14:00.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.156+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1798032790 con 0x7f1794003970 2024-01-22T10:14:00.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.156+0000 7f17a5d9b640 1 -- 172.21.15.88:0/4281576580 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798032b20 con 0x7f1794003970 2024-01-22T10:14:00.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.156+0000 7f17ac95a640 1 -- 172.21.15.88:0/4281576580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794003970 msgr2=0x7f1794003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.156+0000 7f17ac95a640 1 --2- 172.21.15.88:0/4281576580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794003970 0x7f1794003d90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f179800ba60 tx=0x7f17940057f0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.156+0000 7f17a6d9d640 1 -- 172.21.15.88:0/4281576580 reap_dead start 2024-01-22T10:14:00.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.156+0000 7f17ac95a640 1 -- 172.21.15.88:0/4281576580 shutdown_connections 2024-01-22T10:14:00.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.156+0000 7f17ac95a640 1 -- 172.21.15.88:0/4281576580 >> 172.21.15.88:0/4281576580 conn(0x7f17a806ad20 msgr2=0x7f17a80bcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:00.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.157+0000 7f17ac95a640 1 -- 172.21.15.88:0/4281576580 shutdown_connections 2024-01-22T10:14:00.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.157+0000 7f17ac95a640 1 -- 172.21.15.88:0/4281576580 wait complete. 2024-01-22T10:14:00.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.158+0000 7f17ac95a640 1 Processor -- start 2024-01-22T10:14:00.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.158+0000 7f17ac95a640 1 -- start start 2024-01-22T10:14:00.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.158+0000 7f17ac95a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794003970 0x7f17a8142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.158+0000 7f17ac95a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17a81dfa10 0x7f17a8144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.158+0000 7f17ac95a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8145050 0x7f17a81454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.158+0000 7f17ac95a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a8071e90 con 0x7f1794003970 2024-01-22T10:14:00.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.158+0000 7f17ac95a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a813ecf0 con 0x7f17a81dfa10 2024-01-22T10:14:00.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.158+0000 7f17ac95a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a8142d70 con 0x7f17a8145050 2024-01-22T10:14:00.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17a659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794003970 0x7f17a8142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17a659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794003970 0x7f17a8142830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46514/0 (socket says 172.21.15.88:46514) 2024-01-22T10:14:00.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17a659c640 1 -- 172.21.15.88:0/2504705943 learned_addr learned my addr 172.21.15.88:0/2504705943 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:14:00.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f179ffff640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17a81dfa10 0x7f17a8144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17a659c640 1 -- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8145050 msgr2=0x7f17a81454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17a6d9d640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8145050 0x7f17a81454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17a659c640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8145050 0x7f17a81454d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17a659c640 1 -- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17a81dfa10 msgr2=0x7f17a8144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17a659c640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17a81dfa10 0x7f17a8144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17a659c640 1 -- 172.21.15.88:0/2504705943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8145b40 con 0x7f1794003970 2024-01-22T10:14:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17a6d9d640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17a8145050 0x7f17a81454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:14:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f179ffff640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17a81dfa10 0x7f17a8144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:14:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17a659c640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794003970 0x7f17a8142830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f179800ba60 tx=0x7f1798004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f179effd640 1 -- 172.21.15.88:0/2504705943 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798004220 con 0x7f1794003970 2024-01-22T10:14:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f179effd640 1 -- 172.21.15.88:0/2504705943 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17980043a0 con 0x7f1794003970 2024-01-22T10:14:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17ac95a640 1 -- 172.21.15.88:0/2504705943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a81def30 con 0x7f1794003970 2024-01-22T10:14:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f179effd640 1 -- 172.21.15.88:0/2504705943 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798003850 con 0x7f1794003970 2024-01-22T10:14:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.159+0000 7f17ac95a640 1 -- 172.21.15.88:0/2504705943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a81df4f0 con 0x7f1794003970 2024-01-22T10:14:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.160+0000 7f17ac95a640 1 -- 172.21.15.88:0/2504705943 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f17a80b4cb0 con 0x7f1794003970 2024-01-22T10:14:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.160+0000 7f179effd640 1 -- 172.21.15.88:0/2504705943 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f1798043070 con 0x7f1794003970 2024-01-22T10:14:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.161+0000 7f179effd640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f178806b330 0x7f178806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.161+0000 7f179ffff640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f178806b330 0x7f178806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.161+0000 7f179effd640 1 -- 172.21.15.88:0/2504705943 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17980ac080 con 0x7f1794003970 2024-01-22T10:14:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.161+0000 7f179effd640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] conn(0x7f17880734d0 0x7f17880758f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.161+0000 7f179effd640 1 -- 172.21.15.88:0/2504705943 --> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1788075fa0 con 0x7f17880734d0 2024-01-22T10:14:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.161+0000 7f179effd640 1 -- 172.21.15.88:0/2504705943 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17980ae710 con 0x7f1794003970 2024-01-22T10:14:00.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.161+0000 7f17a6d9d640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] conn(0x7f17880734d0 0x7f17880758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.161+0000 7f179ffff640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f178806b330 0x7f178806d7f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f17a8146180 tx=0x7f1790008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.162+0000 7f17a6d9d640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] conn(0x7f17880734d0 0x7f17880758f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.162+0000 7f179effd640 1 -- 172.21.15.88:0/2504705943 <== osd.6 v2:172.21.15.119:6819/3033097923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1788075fa0 con 0x7f17880734d0 2024-01-22T10:14:00.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.175+0000 7f17ac95a640 1 -- 172.21.15.88:0/2504705943 --> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f17a80b6700 con 0x7f17880734d0 2024-01-22T10:14:00.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.176+0000 7f179effd640 1 -- 172.21.15.88:0/2504705943 <== osd.6 v2:172.21.15.119:6819/3033097923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f17a0001a60 con 0x7f17880734d0 2024-01-22T10:14:00.158 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-01-22T10:14:00.158 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-22T10:14:00.158 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-01-22T10:14:00.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.176+0000 7f17ac95a640 1 -- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] conn(0x7f17880734d0 msgr2=0x7f17880758f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.176+0000 7f17ac95a640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.119:6819/3033097923,v1:172.21.15.119:6821/3033097923] conn(0x7f17880734d0 0x7f17880758f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.176+0000 7f17ac95a640 1 -- 172.21.15.88:0/2504705943 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f178806b330 msgr2=0x7f178806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.176+0000 7f17ac95a640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f178806b330 0x7f178806d7f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f17a8146180 tx=0x7f1790008040 comp rx=0 tx=0).stop 2024-01-22T10:14:00.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.176+0000 7f17ac95a640 1 -- 172.21.15.88:0/2504705943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794003970 msgr2=0x7f17a8142830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.176+0000 7f17ac95a640 1 --2- 172.21.15.88:0/2504705943 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794003970 0x7f17a8142830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f179800ba60 tx=0x7f1798004730 comp rx=0 tx=0).stop 2024-01-22T10:14:00.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.176+0000 7f17a6d9d640 1 -- 172.21.15.88:0/2504705943 reap_dead start 2024-01-22T10:14:00.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.176+0000 7f17ac95a640 1 -- 172.21.15.88:0/2504705943 shutdown_connections 2024-01-22T10:14:00.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.176+0000 7f17ac95a640 1 -- 172.21.15.88:0/2504705943 >> 172.21.15.88:0/2504705943 conn(0x7f17a806ad20 msgr2=0x7f17a8148a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:00.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.176+0000 7f17ac95a640 1 -- 172.21.15.88:0/2504705943 shutdown_connections 2024-01-22T10:14:00.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.176+0000 7f17ac95a640 1 -- 172.21.15.88:0/2504705943 wait complete. 2024-01-22T10:14:00.169 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-22T10:14:00.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.287+0000 7fbf32e9b640 1 Processor -- start 2024-01-22T10:14:00.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.287+0000 7fbf32e9b640 1 -- start start 2024-01-22T10:14:00.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.288+0000 7fbf32e9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbf2c0bdd90 0x7fbf2c070030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.288+0000 7fbf32e9b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2c14cb00 con 0x7fbf2c13fc00 2024-01-22T10:14:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.288+0000 7fbf32e9b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2c14d680 con 0x7fbf2c149c90 2024-01-22T10:14:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.288+0000 7fbf32e9b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2c070940 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.288+0000 7fbf2bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbf2c13fc00 0x7fbf2c149580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60754/0 (socket says 172.21.15.88:60754) 2024-01-22T10:14:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.288+0000 7fbf2bfff640 1 -- 172.21.15.88:0/3656338517 learned_addr learned my addr 172.21.15.88:0/3656338517 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:14:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.288+0000 7fbf30c37640 1 --2- 172.21.15.88:0/3656338517 >> v2:172.21.15.119:3300/0 conn(0x7fbf2c0bdd90 0x7fbf2c070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.288+0000 7fbf2b7fe640 1 -- 172.21.15.88:0/3656338517 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585444255 0 0) 0x7fbf2c14cb00 con 0x7fbf2c13fc00 2024-01-22T10:14:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.288+0000 7fbf2b7fe640 1 -- 172.21.15.88:0/3656338517 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf14003520 con 0x7fbf2c13fc00 2024-01-22T10:14:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.288+0000 7fbf30c37640 1 -- 172.21.15.88:0/3656338517 >> v1:172.21.15.119:6789/0 conn(0x7fbf2c149c90 legacy=0x7fbf2c153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.288+0000 7fbf30c37640 1 -- 172.21.15.88:0/3656338517 >> v1:172.21.15.88:6789/0 conn(0x7fbf2c13fc00 legacy=0x7fbf2c149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.288+0000 7fbf30c37640 1 -- 172.21.15.88:0/3656338517 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c071590 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.289+0000 7fbf30c37640 1 --2- 172.21.15.88:0/3656338517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf2c0bdd90 0x7fbf2c070030 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0097a0 tx=0x7fbf1c02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d099ac7cefc7bd8 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.289+0000 7fbf2b7fe640 1 -- 172.21.15.88:0/3656338517 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c02f810 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.289+0000 7fbf2b7fe640 1 -- 172.21.15.88:0/3656338517 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c02f970 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.289+0000 7fbf2b7fe640 1 -- 172.21.15.88:0/3656338517 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c02fd00 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.290+0000 7fbf32e9b640 1 -- 172.21.15.88:0/3656338517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf2c0bdd90 msgr2=0x7fbf2c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.290+0000 7fbf32e9b640 1 --2- 172.21.15.88:0/3656338517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf2c0bdd90 0x7fbf2c070030 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0097a0 tx=0x7fbf1c02b9f0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.290+0000 7fbf32e9b640 1 -- 172.21.15.88:0/3656338517 shutdown_connections 2024-01-22T10:14:00.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.290+0000 7fbf32e9b640 1 --2- 172.21.15.88:0/3656338517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf2c0bdd90 0x7fbf2c070030 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.290+0000 7fbf32e9b640 1 -- 172.21.15.88:0/3656338517 >> 172.21.15.88:0/3656338517 conn(0x7fbf2c06ad20 msgr2=0x7fbf2c0bd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:00.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.290+0000 7fbf32e9b640 1 -- 172.21.15.88:0/3656338517 shutdown_connections 2024-01-22T10:14:00.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.290+0000 7fbf32e9b640 1 -- 172.21.15.88:0/3656338517 wait complete. 2024-01-22T10:14:00.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.291+0000 7fbf32e9b640 1 Processor -- start 2024-01-22T10:14:00.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.291+0000 7fbf32e9b640 1 -- start start 2024-01-22T10:14:00.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf32e9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2c0bdd90 0x7fbf2c140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf32e9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf2c13fc00 0x7fbf2c1e2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf32e9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf2c149c90 0x7fbf2c1411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf32e9b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c14cb00 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf32e9b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c1e20f0 con 0x7fbf2c149c90 2024-01-22T10:14:00.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf32e9b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c140790 con 0x7fbf2c13fc00 2024-01-22T10:14:00.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf30c37640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2c0bdd90 0x7fbf2c140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf30c37640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2c0bdd90 0x7fbf2c140250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46530/0 (socket says 172.21.15.88:46530) 2024-01-22T10:14:00.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf30c37640 1 -- 172.21.15.88:0/267643272 learned_addr learned my addr 172.21.15.88:0/267643272 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:14:00.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf2bfff640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf2c13fc00 0x7fbf2c1e2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf31438640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf2c149c90 0x7fbf2c1411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf30c37640 1 -- 172.21.15.88:0/267643272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf2c13fc00 msgr2=0x7fbf2c1e2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf30c37640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf2c13fc00 0x7fbf2c1e2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf30c37640 1 -- 172.21.15.88:0/267643272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf2c149c90 msgr2=0x7fbf2c1411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf30c37640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf2c149c90 0x7fbf2c1411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf30c37640 1 -- 172.21.15.88:0/267643272 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c009400 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf2bfff640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf2c13fc00 0x7fbf2c1e2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:14:00.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf30c37640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2c0bdd90 0x7fbf2c140250 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009890 tx=0x7fbf1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf297fa640 1 -- 172.21.15.88:0/267643272 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c03c040 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf297fa640 1 -- 172.21.15.88:0/267643272 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c037970 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf32e9b640 1 -- 172.21.15.88:0/267643272 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c14c860 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf297fa640 1 -- 172.21.15.88:0/267643272 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c037d20 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.292+0000 7fbf32e9b640 1 -- 172.21.15.88:0/267643272 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c13f5a0 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.293+0000 7fbf32e9b640 1 -- 172.21.15.88:0/267643272 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2c04ea30 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.294+0000 7fbf297fa640 1 -- 172.21.15.88:0/267643272 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fbf1c0403e0 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.294+0000 7fbf297fa640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbf1806b330 0x7fbf1806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.294+0000 7fbf297fa640 1 -- 172.21.15.88:0/267643272 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf1c0ab950 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.294+0000 7fbf2bfff640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbf1806b330 0x7fbf1806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.295+0000 7fbf2bfff640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbf1806b330 0x7fbf1806d7f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c14c4d0 tx=0x7fbf20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.300+0000 7fbf297fa640 1 -- 172.21.15.88:0/267643272 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fbf1c076670 con 0x7fbf2c0bdd90 2024-01-22T10:14:00.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.467+0000 7fbf32e9b640 1 -- 172.21.15.88:0/267643272 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf2c14d310 con 0x7fbf1806b330 2024-01-22T10:14:00.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.468+0000 7fbf297fa640 1 -- 172.21.15.88:0/267643272 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbf20001470 con 0x7fbf1806b330 2024-01-22T10:14:00.450 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 6 to deep-scrub 2024-01-22T10:14:00.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.471+0000 7fbf32e9b640 1 -- 172.21.15.88:0/267643272 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbf1806b330 msgr2=0x7fbf1806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.471+0000 7fbf32e9b640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbf1806b330 0x7fbf1806d7f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c14c4d0 tx=0x7fbf20009040 comp rx=0 tx=0).stop 2024-01-22T10:14:00.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.471+0000 7fbf32e9b640 1 -- 172.21.15.88:0/267643272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2c0bdd90 msgr2=0x7fbf2c140250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.471+0000 7fbf32e9b640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2c0bdd90 0x7fbf2c140250 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009890 tx=0x7fbf1c004730 comp rx=0 tx=0).stop 2024-01-22T10:14:00.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.471+0000 7fbf32e9b640 1 -- 172.21.15.88:0/267643272 shutdown_connections 2024-01-22T10:14:00.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.471+0000 7fbf32e9b640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fbf1806b330 0x7fbf1806d7f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.471+0000 7fbf32e9b640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf2c13fc00 0x7fbf2c1e2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.471+0000 7fbf32e9b640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf2c149c90 0x7fbf2c1411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.471+0000 7fbf32e9b640 1 --2- 172.21.15.88:0/267643272 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf2c0bdd90 0x7fbf2c140250 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.471+0000 7fbf32e9b640 1 -- 172.21.15.88:0/267643272 >> 172.21.15.88:0/267643272 conn(0x7fbf2c06ad20 msgr2=0x7fbf2c071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:00.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.471+0000 7fbf32e9b640 1 -- 172.21.15.88:0/267643272 shutdown_connections 2024-01-22T10:14:00.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.471+0000 7fbf32e9b640 1 -- 172.21.15.88:0/267643272 wait complete. 2024-01-22T10:14:00.463 INFO:tasks.ceph:Scrubbing osd.7 2024-01-22T10:14:00.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-22T10:14:00.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.583+0000 7fc82382b640 1 Processor -- start 2024-01-22T10:14:00.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.584+0000 7fc82382b640 1 -- start start 2024-01-22T10:14:00.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.584+0000 7fc82382b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc81c14b780 0x7fc81c0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.584+0000 7fc82382b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81c0b96f0 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.584+0000 7fc82382b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81c06d6a0 con 0x7fc81c06d2c0 2024-01-22T10:14:00.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.584+0000 7fc82382b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81c072690 con 0x7fc81c14b780 2024-01-22T10:14:00.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.584+0000 7fc821dc8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc81c14b780 0x7fc81c0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.584+0000 7fc821dc8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc81c14b780 0x7fc81c0b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46546/0 (socket says 172.21.15.88:46546) 2024-01-22T10:14:00.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.584+0000 7fc821dc8640 1 -- 172.21.15.88:0/906778694 learned_addr learned my addr 172.21.15.88:0/906778694 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:14:00.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.584+0000 7fc820dc6640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc81c0b8ea0 0x7fc81c153fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60762/0 (socket says 172.21.15.88:60762) 2024-01-22T10:14:00.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.585+0000 7fc821dc8640 1 -- 172.21.15.88:0/906778694 >> v1:172.21.15.119:6789/0 conn(0x7fc81c06d2c0 legacy=0x7fc81c145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:00.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.585+0000 7fc813fff640 1 -- 172.21.15.88:0/906778694 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276450204 0 0) 0x7fc81c0b96f0 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.585+0000 7fc821dc8640 1 -- 172.21.15.88:0/906778694 >> v1:172.21.15.88:6789/0 conn(0x7fc81c0b8ea0 legacy=0x7fc81c153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.585+0000 7fc821dc8640 1 -- 172.21.15.88:0/906778694 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0b9410 con 0x7fc81c14b780 2024-01-22T10:14:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.585+0000 7fc821dc8640 1 --2- 172.21.15.88:0/906778694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c14b780 0x7fc81c0b1f20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc814009e50 tx=0x7fc81402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6179d739865c4f5a server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.586+0000 7fc813fff640 1 -- 172.21.15.88:0/906778694 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81402cb20 con 0x7fc81c14b780 2024-01-22T10:14:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.586+0000 7fc813fff640 1 -- 172.21.15.88:0/906778694 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81402cc80 con 0x7fc81c14b780 2024-01-22T10:14:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.586+0000 7fc813fff640 1 -- 172.21.15.88:0/906778694 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8140343f0 con 0x7fc81c14b780 2024-01-22T10:14:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.586+0000 7fc82382b640 1 -- 172.21.15.88:0/906778694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c14b780 msgr2=0x7fc81c0b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.586+0000 7fc82382b640 1 --2- 172.21.15.88:0/906778694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c14b780 0x7fc81c0b1f20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc814009e50 tx=0x7fc81402bf80 comp rx=0 tx=0).stop 2024-01-22T10:14:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.586+0000 7fc82382b640 1 -- 172.21.15.88:0/906778694 shutdown_connections 2024-01-22T10:14:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.586+0000 7fc82382b640 1 --2- 172.21.15.88:0/906778694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c14b780 0x7fc81c0b1f20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.586+0000 7fc82382b640 1 -- 172.21.15.88:0/906778694 >> 172.21.15.88:0/906778694 conn(0x7fc81c0bcf40 msgr2=0x7fc81c0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.586+0000 7fc82382b640 1 -- 172.21.15.88:0/906778694 shutdown_connections 2024-01-22T10:14:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.586+0000 7fc82382b640 1 -- 172.21.15.88:0/906778694 wait complete. 2024-01-22T10:14:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.587+0000 7fc82382b640 1 Processor -- start 2024-01-22T10:14:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.587+0000 7fc82382b640 1 -- start start 2024-01-22T10:14:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc82382b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc81c06d2c0 0x7fc81c0b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc82382b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c0b8ea0 0x7fc81c1e49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc82382b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc81c14b780 0x7fc81c1e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc82382b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0b7f30 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc82382b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c1d1a70 con 0x7fc81c06d2c0 2024-01-22T10:14:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc82382b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c1d1790 con 0x7fc81c14b780 2024-01-22T10:14:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc820dc6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c0b8ea0 0x7fc81c1e49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc820dc6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c0b8ea0 0x7fc81c1e49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46562/0 (socket says 172.21.15.88:46562) 2024-01-22T10:14:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc820dc6640 1 -- 172.21.15.88:0/4176928100 learned_addr learned my addr 172.21.15.88:0/4176928100 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:14:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc820dc6640 1 -- 172.21.15.88:0/4176928100 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc81c14b780 msgr2=0x7fc81c1e4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc820dc6640 1 --2- 172.21.15.88:0/4176928100 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc81c14b780 0x7fc81c1e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc820dc6640 1 -- 172.21.15.88:0/4176928100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc81c06d2c0 msgr2=0x7fc81c0b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc820dc6640 1 --2- 172.21.15.88:0/4176928100 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc81c06d2c0 0x7fc81c0b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc820dc6640 1 -- 172.21.15.88:0/4176928100 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc814009b30 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc820dc6640 1 --2- 172.21.15.88:0/4176928100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c0b8ea0 0x7fc81c1e49f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00c4d0 tx=0x7fc80c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc811ffb640 1 -- 172.21.15.88:0/4176928100 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0074e0 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.588+0000 7fc811ffb640 1 -- 172.21.15.88:0/4176928100 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c007660 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.589+0000 7fc82382b640 1 -- 172.21.15.88:0/4176928100 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c1d7050 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.589+0000 7fc811ffb640 1 -- 172.21.15.88:0/4176928100 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c004a20 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.589+0000 7fc82382b640 1 -- 172.21.15.88:0/4176928100 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c1d2ac0 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.589+0000 7fc82382b640 1 -- 172.21.15.88:0/4176928100 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc81c143080 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.590+0000 7fc811ffb640 1 -- 172.21.15.88:0/4176928100 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fc80c004b80 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.590+0000 7fc811ffb640 1 --2- 172.21.15.88:0/4176928100 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc80006b330 0x7fc80006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.590+0000 7fc811ffb640 1 -- 172.21.15.88:0/4176928100 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc80c089090 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.590+0000 7fc8215c7640 1 --2- 172.21.15.88:0/4176928100 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc80006b330 0x7fc80006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.590+0000 7fc811ffb640 1 --2- 172.21.15.88:0/4176928100 >> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] conn(0x7fc8000734d0 0x7fc8000758f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.590+0000 7fc811ffb640 1 -- 172.21.15.88:0/4176928100 --> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc800075fa0 con 0x7fc8000734d0 2024-01-22T10:14:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.590+0000 7fc811ffb640 1 -- 172.21.15.88:0/4176928100 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc80c08b750 con 0x7fc81c0b8ea0 2024-01-22T10:14:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.591+0000 7fc8215c7640 1 --2- 172.21.15.88:0/4176928100 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc80006b330 0x7fc80006d7f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc818003cc0 tx=0x7fc8180079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.591+0000 7fc821dc8640 1 --2- 172.21.15.88:0/4176928100 >> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] conn(0x7fc8000734d0 0x7fc8000758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.591+0000 7fc821dc8640 1 --2- 172.21.15.88:0/4176928100 >> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] conn(0x7fc8000734d0 0x7fc8000758f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.592+0000 7fc811ffb640 1 -- 172.21.15.88:0/4176928100 <== osd.7 v2:172.21.15.119:6816/3533070748 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc800075fa0 con 0x7fc8000734d0 2024-01-22T10:14:00.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc82382b640 1 -- 172.21.15.88:0/4176928100 --> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc81c145da0 con 0x7fc8000734d0 2024-01-22T10:14:00.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc811ffb640 1 -- 172.21.15.88:0/4176928100 <== osd.7 v2:172.21.15.119:6816/3533070748 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc81402c9a0 con 0x7fc8000734d0 2024-01-22T10:14:00.588 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-01-22T10:14:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-22T10:14:00.588 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-01-22T10:14:00.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc82382b640 1 -- 172.21.15.88:0/4176928100 >> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] conn(0x7fc8000734d0 msgr2=0x7fc8000758f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc82382b640 1 --2- 172.21.15.88:0/4176928100 >> [v2:172.21.15.119:6816/3533070748,v1:172.21.15.119:6817/3533070748] conn(0x7fc8000734d0 0x7fc8000758f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc82382b640 1 -- 172.21.15.88:0/4176928100 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc80006b330 msgr2=0x7fc80006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc82382b640 1 --2- 172.21.15.88:0/4176928100 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc80006b330 0x7fc80006d7f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc818003cc0 tx=0x7fc8180079b0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc82382b640 1 -- 172.21.15.88:0/4176928100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c0b8ea0 msgr2=0x7fc81c1e49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc82382b640 1 --2- 172.21.15.88:0/4176928100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc81c0b8ea0 0x7fc81c1e49f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00c4d0 tx=0x7fc80c00c990 comp rx=0 tx=0).stop 2024-01-22T10:14:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc821dc8640 1 -- 172.21.15.88:0/4176928100 reap_dead start 2024-01-22T10:14:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc82382b640 1 -- 172.21.15.88:0/4176928100 shutdown_connections 2024-01-22T10:14:00.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc82382b640 1 -- 172.21.15.88:0/4176928100 >> 172.21.15.88:0/4176928100 conn(0x7fc81c0bcf40 msgr2=0x7fc81c1d7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:00.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc82382b640 1 -- 172.21.15.88:0/4176928100 shutdown_connections 2024-01-22T10:14:00.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.606+0000 7fc82382b640 1 -- 172.21.15.88:0/4176928100 wait complete. 2024-01-22T10:14:00.598 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-22T10:14:00.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.717+0000 7f0e8eb33640 1 Processor -- start 2024-01-22T10:14:00.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.717+0000 7f0e8eb33640 1 -- start start 2024-01-22T10:14:00.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.717+0000 7f0e8eb33640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0e880ba380 0x7f0e881433e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.717+0000 7f0e8eb33640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e880b8990 0x7f0e88153d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.717+0000 7f0e8eb33640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e88071650 con 0x7f0e880b7420 2024-01-22T10:14:00.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.717+0000 7f0e8eb33640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880b9540 con 0x7f0e880b8990 2024-01-22T10:14:00.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.717+0000 7f0e8eb33640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880b9240 con 0x7f0e880ba380 2024-01-22T10:14:00.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.717+0000 7f0e8c8cf640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0e880b7420 0x7f0e88070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60770/0 (socket says 172.21.15.88:60770) 2024-01-22T10:14:00.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.717+0000 7f0e8d0d0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e880b8990 0x7f0e88153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.717+0000 7f0e8c8cf640 1 -- 172.21.15.88:0/2039916409 learned_addr learned my addr 172.21.15.88:0/2039916409 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:14:00.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.718+0000 7f0e87fff640 1 --2- 172.21.15.88:0/2039916409 >> v2:172.21.15.119:3300/0 conn(0x7f0e880ba380 0x7f0e881433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.718+0000 7f0e8d0d0640 1 -- 172.21.15.88:0/2039916409 >> v2:172.21.15.119:3300/0 conn(0x7f0e880ba380 msgr2=0x7f0e881433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:00.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.718+0000 7f0e8d0d0640 1 --2- 172.21.15.88:0/2039916409 >> v2:172.21.15.119:3300/0 conn(0x7f0e880ba380 0x7f0e881433e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.718+0000 7f0e8d0d0640 1 -- 172.21.15.88:0/2039916409 >> v1:172.21.15.88:6789/0 conn(0x7f0e880b7420 legacy=0x7f0e88070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.718+0000 7f0e8d0d0640 1 -- 172.21.15.88:0/2039916409 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e880badb0 con 0x7f0e880b8990 2024-01-22T10:14:00.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.718+0000 7f0e877fe640 1 -- 172.21.15.88:0/2039916409 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300280516 0 0) 0x7f0e80001110 con 0x7f0e880b7420 2024-01-22T10:14:00.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.718+0000 7f0e8d0d0640 1 --2- 172.21.15.88:0/2039916409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e880b8990 0x7f0e88153d50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0e8806b730 tx=0x7f0e7002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1490061024bc475e server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.718+0000 7f0e877fe640 1 -- 172.21.15.88:0/2039916409 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7002e070 con 0x7f0e880b8990 2024-01-22T10:14:00.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.719+0000 7f0e877fe640 1 -- 172.21.15.88:0/2039916409 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e700315a0 con 0x7f0e880b8990 2024-01-22T10:14:00.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.719+0000 7f0e877fe640 1 -- 172.21.15.88:0/2039916409 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70031930 con 0x7f0e880b8990 2024-01-22T10:14:00.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.719+0000 7f0e8eb33640 1 -- 172.21.15.88:0/2039916409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e880b8990 msgr2=0x7f0e88153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.719+0000 7f0e8eb33640 1 --2- 172.21.15.88:0/2039916409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e880b8990 0x7f0e88153d50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0e8806b730 tx=0x7f0e7002b840 comp rx=0 tx=0).stop 2024-01-22T10:14:00.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.719+0000 7f0e8eb33640 1 -- 172.21.15.88:0/2039916409 shutdown_connections 2024-01-22T10:14:00.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.719+0000 7f0e8eb33640 1 --2- 172.21.15.88:0/2039916409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e880b8990 0x7f0e88153d50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.719+0000 7f0e8eb33640 1 --2- 172.21.15.88:0/2039916409 >> v2:172.21.15.119:3300/0 conn(0x7f0e880ba380 0x7f0e881433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.719+0000 7f0e8eb33640 1 -- 172.21.15.88:0/2039916409 >> 172.21.15.88:0/2039916409 conn(0x7f0e8806e970 msgr2=0x7f0e8806b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:00.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.719+0000 7f0e8eb33640 1 -- 172.21.15.88:0/2039916409 shutdown_connections 2024-01-22T10:14:00.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.719+0000 7f0e8eb33640 1 -- 172.21.15.88:0/2039916409 wait complete. 2024-01-22T10:14:00.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.720+0000 7f0e8eb33640 1 Processor -- start 2024-01-22T10:14:00.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.720+0000 7f0e8eb33640 1 -- start start 2024-01-22T10:14:00.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8eb33640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e880b7420 0x7f0e881dec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8eb33640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e880b8990 0x7f0e88146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8eb33640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e880ba380 0x7f0e88149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8eb33640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88138f40 con 0x7f0e880ba380 2024-01-22T10:14:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8eb33640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e881488d0 con 0x7f0e880b7420 2024-01-22T10:14:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8eb33640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88144e40 con 0x7f0e880b8990 2024-01-22T10:14:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8d0d0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e880ba380 0x7f0e88149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8d0d0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e880ba380 0x7f0e88149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46580/0 (socket says 172.21.15.88:46580) 2024-01-22T10:14:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8d0d0640 1 -- 172.21.15.88:0/1969944653 learned_addr learned my addr 172.21.15.88:0/1969944653 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:14:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e87fff640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e880b8990 0x7f0e88146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8c8cf640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e880b7420 0x7f0e881dec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8d0d0640 1 -- 172.21.15.88:0/1969944653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e880b8990 msgr2=0x7f0e88146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8d0d0640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e880b8990 0x7f0e88146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8d0d0640 1 -- 172.21.15.88:0/1969944653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e880b7420 msgr2=0x7f0e881dec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8d0d0640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e880b7420 0x7f0e881dec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8d0d0640 1 -- 172.21.15.88:0/1969944653 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e70009400 con 0x7f0e880ba380 2024-01-22T10:14:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.721+0000 7f0e8d0d0640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e880ba380 0x7f0e88149b40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009890 tx=0x7f0e700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.722+0000 7f0e857fa640 1 -- 172.21.15.88:0/1969944653 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70032840 con 0x7f0e880ba380 2024-01-22T10:14:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.722+0000 7f0e857fa640 1 -- 172.21.15.88:0/1969944653 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e700329c0 con 0x7f0e880ba380 2024-01-22T10:14:00.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.722+0000 7f0e8eb33640 1 -- 172.21.15.88:0/1969944653 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e88147870 con 0x7f0e880ba380 2024-01-22T10:14:00.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.722+0000 7f0e857fa640 1 -- 172.21.15.88:0/1969944653 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70032d70 con 0x7f0e880ba380 2024-01-22T10:14:00.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.722+0000 7f0e8eb33640 1 -- 172.21.15.88:0/1969944653 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e88148b70 con 0x7f0e880ba380 2024-01-22T10:14:00.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.723+0000 7f0e8eb33640 1 -- 172.21.15.88:0/1969944653 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8804ea30 con 0x7f0e880ba380 2024-01-22T10:14:00.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.723+0000 7f0e857fa640 1 -- 172.21.15.88:0/1969944653 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f0e700453f0 con 0x7f0e880ba380 2024-01-22T10:14:00.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.723+0000 7f0e857fa640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0e6806b330 0x7f0e6806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.724+0000 7f0e857fa640 1 -- 172.21.15.88:0/1969944653 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e700abc20 con 0x7f0e880ba380 2024-01-22T10:14:00.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.724+0000 7f0e8c8cf640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0e6806b330 0x7f0e6806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.724+0000 7f0e8c8cf640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0e6806b330 0x7f0e6806d7f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0e80000f60 tx=0x7f0e800079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.728+0000 7f0e857fa640 1 -- 172.21.15.88:0/1969944653 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0e700769f0 con 0x7f0e880ba380 2024-01-22T10:14:00.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.896+0000 7f0e8eb33640 1 -- 172.21.15.88:0/1969944653 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e880b7840 con 0x7f0e6806b330 2024-01-22T10:14:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.898+0000 7f0e857fa640 1 -- 172.21.15.88:0/1969944653 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0e80001440 con 0x7f0e6806b330 2024-01-22T10:14:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 7 to deep-scrub 2024-01-22T10:14:00.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.900+0000 7f0e8eb33640 1 -- 172.21.15.88:0/1969944653 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0e6806b330 msgr2=0x7f0e6806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.900+0000 7f0e8eb33640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0e6806b330 0x7f0e6806d7f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0e80000f60 tx=0x7f0e800079b0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.900+0000 7f0e8eb33640 1 -- 172.21.15.88:0/1969944653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e880ba380 msgr2=0x7f0e88149b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.900+0000 7f0e8eb33640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e880ba380 0x7f0e88149b40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009890 tx=0x7f0e700046c0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.900+0000 7f0e8eb33640 1 -- 172.21.15.88:0/1969944653 shutdown_connections 2024-01-22T10:14:00.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.900+0000 7f0e8eb33640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0e6806b330 0x7f0e6806d7f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.900+0000 7f0e8eb33640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e880b8990 0x7f0e88146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.900+0000 7f0e8eb33640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e880ba380 0x7f0e88149b40 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.900+0000 7f0e8eb33640 1 --2- 172.21.15.88:0/1969944653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e880b7420 0x7f0e881dec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.900+0000 7f0e8eb33640 1 -- 172.21.15.88:0/1969944653 >> 172.21.15.88:0/1969944653 conn(0x7f0e8806e970 msgr2=0x7f0e880b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:00.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.900+0000 7f0e8eb33640 1 -- 172.21.15.88:0/1969944653 shutdown_connections 2024-01-22T10:14:00.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:00.900+0000 7f0e8eb33640 1 -- 172.21.15.88:0/1969944653 wait complete. 2024-01-22T10:14:00.892 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T10:14:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.009+0000 7f2724ca6640 1 Processor -- start 2024-01-22T10:14:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.009+0000 7f2724ca6640 1 -- start start 2024-01-22T10:14:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.010+0000 7f2724ca6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27200bb8b0 0x7f27200b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.010+0000 7f2724ca6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2720149760 0x7f2720149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.010+0000 7f2724ca6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27200b8850 con 0x7f27200b5830 2024-01-22T10:14:00.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.010+0000 7f2724ca6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27200b9060 con 0x7f2720149760 2024-01-22T10:14:00.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.010+0000 7f2724ca6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27200bab60 con 0x7f27200bb8b0 2024-01-22T10:14:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.010+0000 7f271ed9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2720149760 0x7f2720149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.011+0000 7f271e59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27200bb8b0 0x7f27200b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.011+0000 7f271dd9b640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f27200b5830 0x7f2720143240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.88:58792/0 (socket says 172.21.15.88:58792) 2024-01-22T10:14:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.011+0000 7f271dd9b640 1 -- 172.21.15.88:0/2771451874 learned_addr learned my addr 172.21.15.88:0/2771451874 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:14:00.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.011+0000 7f271e59c640 1 -- 172.21.15.88:0/2771451874 >> v2:172.21.15.119:3300/0 conn(0x7f2720149760 msgr2=0x7f2720149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.011+0000 7f271e59c640 1 --2- 172.21.15.88:0/2771451874 >> v2:172.21.15.119:3300/0 conn(0x7f2720149760 0x7f2720149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.011+0000 7f271e59c640 1 -- 172.21.15.88:0/2771451874 >> v1:172.21.15.119:6789/0 conn(0x7f27200b5830 legacy=0x7f2720143240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.011+0000 7f271e59c640 1 -- 172.21.15.88:0/2771451874 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272014a110 con 0x7f27200bb8b0 2024-01-22T10:14:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.011+0000 7f271ed9d640 1 --2- 172.21.15.88:0/2771451874 >> v2:172.21.15.119:3300/0 conn(0x7f2720149760 0x7f2720149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-22T10:14:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.012+0000 7f271e59c640 1 --2- 172.21.15.88:0/2771451874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27200bb8b0 0x7f27200b95b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2710009d90 tx=0x7f271002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3571b92ea4dfd3c server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.012+0000 7f271d59a640 1 -- 172.21.15.88:0/2771451874 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271002cce0 con 0x7f27200bb8b0 2024-01-22T10:14:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.012+0000 7f271d59a640 1 -- 172.21.15.88:0/2771451874 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271002ce40 con 0x7f27200bb8b0 2024-01-22T10:14:00.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.012+0000 7f271d59a640 1 -- 172.21.15.88:0/2771451874 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710034660 con 0x7f27200bb8b0 2024-01-22T10:14:00.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.012+0000 7f2724ca6640 1 -- 172.21.15.88:0/2771451874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27200bb8b0 msgr2=0x7f27200b95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:00.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.012+0000 7f2724ca6640 1 --2- 172.21.15.88:0/2771451874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27200bb8b0 0x7f27200b95b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2710009d90 tx=0x7f271002bf30 comp rx=0 tx=0).stop 2024-01-22T10:14:00.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.012+0000 7f2724ca6640 1 -- 172.21.15.88:0/2771451874 shutdown_connections 2024-01-22T10:14:00.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.012+0000 7f2724ca6640 1 --2- 172.21.15.88:0/2771451874 >> v2:172.21.15.119:3300/0 conn(0x7f2720149760 0x7f2720149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.012+0000 7f2724ca6640 1 --2- 172.21.15.88:0/2771451874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27200bb8b0 0x7f27200b95b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:00.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.012+0000 7f2724ca6640 1 -- 172.21.15.88:0/2771451874 >> 172.21.15.88:0/2771451874 conn(0x7f2720066380 msgr2=0x7f2720066760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:00.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.012+0000 7f2724ca6640 1 -- 172.21.15.88:0/2771451874 shutdown_connections 2024-01-22T10:14:00.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.013+0000 7f2724ca6640 1 -- 172.21.15.88:0/2771451874 wait complete. 2024-01-22T10:14:00.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f2724ca6640 1 Processor -- start 2024-01-22T10:14:00.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f2724ca6640 1 -- start start 2024-01-22T10:14:00.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f2724ca6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27200b5830 0x7f272006d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f2724ca6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27200bb8b0 0x7f272006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f2724ca6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2720149760 0x7f272013f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f2724ca6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27201d30a0 con 0x7f27200bb8b0 2024-01-22T10:14:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f2724ca6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272006d000 con 0x7f27200b5830 2024-01-22T10:14:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f2724ca6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27201d3310 con 0x7f2720149760 2024-01-22T10:14:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f271dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27200bb8b0 0x7f272006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f271dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27200bb8b0 0x7f272006cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46596/0 (socket says 172.21.15.88:46596) 2024-01-22T10:14:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f271dd9b640 1 -- 172.21.15.88:0/3534211364 learned_addr learned my addr 172.21.15.88:0/3534211364 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:14:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f271e59c640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27200b5830 0x7f272006d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.014+0000 7f271ed9d640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2720149760 0x7f272013f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.015+0000 7f271dd9b640 1 -- 172.21.15.88:0/3534211364 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2720149760 msgr2=0x7f272013f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.015+0000 7f271dd9b640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2720149760 0x7f272013f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.015+0000 7f271dd9b640 1 -- 172.21.15.88:0/3534211364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27200b5830 msgr2=0x7f272006d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.015+0000 7f271dd9b640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27200b5830 0x7f272006d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.015+0000 7f271dd9b640 1 -- 172.21.15.88:0/3534211364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718009400 con 0x7f27200bb8b0 2024-01-22T10:14:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.015+0000 7f271dd9b640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27200bb8b0 0x7f272006cac0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f270800c400 tx=0x7f270800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:01.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.015+0000 7f2716ffd640 1 -- 172.21.15.88:0/3534211364 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708005ce0 con 0x7f27200bb8b0 2024-01-22T10:14:01.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.015+0000 7f2716ffd640 1 -- 172.21.15.88:0/3534211364 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2708005e40 con 0x7f27200bb8b0 2024-01-22T10:14:01.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.015+0000 7f2724ca6640 1 -- 172.21.15.88:0/3534211364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2710009a70 con 0x7f27200bb8b0 2024-01-22T10:14:01.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.015+0000 7f2716ffd640 1 -- 172.21.15.88:0/3534211364 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080072d0 con 0x7f27200bb8b0 2024-01-22T10:14:01.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.015+0000 7f2724ca6640 1 -- 172.21.15.88:0/3534211364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27201d2790 con 0x7f27200bb8b0 2024-01-22T10:14:01.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.016+0000 7f2724ca6640 1 -- 172.21.15.88:0/3534211364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27200ba370 con 0x7f27200bb8b0 2024-01-22T10:14:01.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.017+0000 7f2716ffd640 1 -- 172.21.15.88:0/3534211364 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f2708007430 con 0x7f27200bb8b0 2024-01-22T10:14:01.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.017+0000 7f2716ffd640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f270006b360 0x7f270006d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:01.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.017+0000 7f2716ffd640 1 -- 172.21.15.88:0/3534211364 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2708088fc0 con 0x7f27200bb8b0 2024-01-22T10:14:01.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.017+0000 7f271e59c640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f270006b360 0x7f270006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:01.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.017+0000 7f271e59c640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f270006b360 0x7f270006d820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2710036000 tx=0x7f2710030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:01.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.021+0000 7f2716ffd640 1 -- 172.21.15.88:0/3534211364 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f27080bc0d0 con 0x7f27200bb8b0 2024-01-22T10:14:01.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.189+0000 7f2724ca6640 1 -- 172.21.15.88:0/3534211364 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27200bbc90 con 0x7f270006b360 2024-01-22T10:14:01.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.196+0000 7f2716ffd640 1 -- 172.21.15.88:0/3534211364 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289751 (secure 0 0 0) 0x7f2710042070 con 0x7f270006b360 2024-01-22T10:14:01.181 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:14:01.182 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-01-22T10:14:01.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.199+0000 7f2724ca6640 1 -- 172.21.15.88:0/3534211364 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f270006b360 msgr2=0x7f270006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:01.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.199+0000 7f2724ca6640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f270006b360 0x7f270006d820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2710036000 tx=0x7f2710030000 comp rx=0 tx=0).stop 2024-01-22T10:14:01.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.199+0000 7f2724ca6640 1 -- 172.21.15.88:0/3534211364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27200bb8b0 msgr2=0x7f272006cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:01.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.199+0000 7f2724ca6640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27200bb8b0 0x7f272006cac0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f270800c400 tx=0x7f270800c800 comp rx=0 tx=0).stop 2024-01-22T10:14:01.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.199+0000 7f2724ca6640 1 -- 172.21.15.88:0/3534211364 shutdown_connections 2024-01-22T10:14:01.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.199+0000 7f2724ca6640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f270006b360 0x7f270006d820 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:01.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.199+0000 7f2724ca6640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2720149760 0x7f272013f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:01.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.199+0000 7f2724ca6640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27200bb8b0 0x7f272006cac0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:01.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.199+0000 7f2724ca6640 1 --2- 172.21.15.88:0/3534211364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27200b5830 0x7f272006d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:01.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.199+0000 7f2724ca6640 1 -- 172.21.15.88:0/3534211364 >> 172.21.15.88:0/3534211364 conn(0x7f2720066380 msgr2=0x7f27200b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:01.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.199+0000 7f2724ca6640 1 -- 172.21.15.88:0/3534211364 shutdown_connections 2024-01-22T10:14:01.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:01.199+0000 7f2724ca6640 1 -- 172.21.15.88:0/3534211364 wait complete. 2024-01-22T10:14:01.191 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-01-22T10:14:00.716888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598309,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220040,"kb_used_data":3856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754680,"statfs":{"total":773094113280,"available":772868792320,"internally_reserved":0,"allocated":3948544,"data_stored":2228978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5531,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003094"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986737+0000","last_change":"2024-01-22T10:13:42.628705+0000","last_active":"2024-01-22T10:13:43.986737+0000","last_peered":"2024-01-22T10:13:43.986737+0000","last_clean":"2024-01-22T10:13:43.986737+0000","last_became_active":"2024-01-22T10:13:42.627514+0000","last_became_peered":"2024-01-22T10:13:42.627514+0000","last_unstale":"2024-01-22T10:13:43.986737+0000","last_undegraded":"2024-01-22T10:13:43.986737+0000","last_fullsized":"2024-01-22T10:13:43.986737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624367+0000","last_change":"2024-01-22T10:13:42.623390+0000","last_active":"2024-01-22T10:13:43.624367+0000","last_peered":"2024-01-22T10:13:43.624367+0000","last_clean":"2024-01-22T10:13:43.624367+0000","last_became_active":"2024-01-22T10:13:42.623152+0000","last_became_peered":"2024-01-22T10:13:42.623152+0000","last_unstale":"2024-01-22T10:13:43.624367+0000","last_undegraded":"2024-01-22T10:13:43.624367+0000","last_fullsized":"2024-01-22T10:13:43.624367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:45:45.479717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034543+0000","last_change":"2024-01-22T10:13:42.627502+0000","last_active":"2024-01-22T10:13:44.034543+0000","last_peered":"2024-01-22T10:13:44.034543+0000","last_clean":"2024-01-22T10:13:44.034543+0000","last_became_active":"2024-01-22T10:13:42.627157+0000","last_became_peered":"2024-01-22T10:13:42.627157+0000","last_unstale":"2024-01-22T10:13:44.034543+0000","last_undegraded":"2024-01-22T10:13:44.034543+0000","last_fullsized":"2024-01-22T10:13:44.034543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622679+0000","last_change":"2024-01-22T10:13:42.631690+0000","last_active":"2024-01-22T10:13:43.622679+0000","last_peered":"2024-01-22T10:13:43.622679+0000","last_clean":"2024-01-22T10:13:43.622679+0000","last_became_active":"2024-01-22T10:13:42.630134+0000","last_became_peered":"2024-01-22T10:13:42.630134+0000","last_unstale":"2024-01-22T10:13:43.622679+0000","last_undegraded":"2024-01-22T10:13:43.622679+0000","last_fullsized":"2024-01-22T10:13:43.622679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:00:21.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034028+0000","last_change":"2024-01-22T10:13:42.636628+0000","last_active":"2024-01-22T10:13:44.034028+0000","last_peered":"2024-01-22T10:13:44.034028+0000","last_clean":"2024-01-22T10:13:44.034028+0000","last_became_active":"2024-01-22T10:13:42.636239+0000","last_became_peered":"2024-01-22T10:13:42.636239+0000","last_unstale":"2024-01-22T10:13:44.034028+0000","last_undegraded":"2024-01-22T10:13:44.034028+0000","last_fullsized":"2024-01-22T10:13:44.034028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:44:19.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624118+0000","last_change":"2024-01-22T10:13:42.621975+0000","last_active":"2024-01-22T10:13:43.624118+0000","last_peered":"2024-01-22T10:13:43.624118+0000","last_clean":"2024-01-22T10:13:43.624118+0000","last_became_active":"2024-01-22T10:13:42.621590+0000","last_became_peered":"2024-01-22T10:13:42.621590+0000","last_unstale":"2024-01-22T10:13:43.624118+0000","last_undegraded":"2024-01-22T10:13:43.624118+0000","last_fullsized":"2024-01-22T10:13:43.624118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624659+0000","last_change":"2024-01-22T10:13:42.617901+0000","last_active":"2024-01-22T10:13:43.624659+0000","last_peered":"2024-01-22T10:13:43.624659+0000","last_clean":"2024-01-22T10:13:43.624659+0000","last_became_active":"2024-01-22T10:13:42.617384+0000","last_became_peered":"2024-01-22T10:13:42.617384+0000","last_unstale":"2024-01-22T10:13:43.624659+0000","last_undegraded":"2024-01-22T10:13:43.624659+0000","last_fullsized":"2024-01-22T10:13:43.624659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624647+0000","last_change":"2024-01-22T10:13:42.622490+0000","last_active":"2024-01-22T10:13:43.624647+0000","last_peered":"2024-01-22T10:13:43.624647+0000","last_clean":"2024-01-22T10:13:43.624647+0000","last_became_active":"2024-01-22T10:13:42.622220+0000","last_became_peered":"2024-01-22T10:13:42.622220+0000","last_unstale":"2024-01-22T10:13:43.624647+0000","last_undegraded":"2024-01-22T10:13:43.624647+0000","last_fullsized":"2024-01-22T10:13:43.624647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035496+0000","last_change":"2024-01-22T10:13:42.635502+0000","last_active":"2024-01-22T10:13:44.035496+0000","last_peered":"2024-01-22T10:13:44.035496+0000","last_clean":"2024-01-22T10:13:44.035496+0000","last_became_active":"2024-01-22T10:13:42.635312+0000","last_became_peered":"2024-01-22T10:13:42.635312+0000","last_unstale":"2024-01-22T10:13:44.035496+0000","last_undegraded":"2024-01-22T10:13:44.035496+0000","last_fullsized":"2024-01-22T10:13:44.035496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:19:17.630353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622947+0000","last_change":"2024-01-22T10:13:42.635158+0000","last_active":"2024-01-22T10:13:43.622947+0000","last_peered":"2024-01-22T10:13:43.622947+0000","last_clean":"2024-01-22T10:13:43.622947+0000","last_became_active":"2024-01-22T10:13:42.634191+0000","last_became_peered":"2024-01-22T10:13:42.634191+0000","last_unstale":"2024-01-22T10:13:43.622947+0000","last_undegraded":"2024-01-22T10:13:43.622947+0000","last_fullsized":"2024-01-22T10:13:43.622947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:17.709645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624931+0000","last_change":"2024-01-22T10:13:42.621049+0000","last_active":"2024-01-22T10:13:43.624931+0000","last_peered":"2024-01-22T10:13:43.624931+0000","last_clean":"2024-01-22T10:13:43.624931+0000","last_became_active":"2024-01-22T10:13:42.620763+0000","last_became_peered":"2024-01-22T10:13:42.620763+0000","last_unstale":"2024-01-22T10:13:43.624931+0000","last_undegraded":"2024-01-22T10:13:43.624931+0000","last_fullsized":"2024-01-22T10:13:43.624931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:45:45.479717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034352+0000","last_change":"2024-01-22T10:13:42.634597+0000","last_active":"2024-01-22T10:13:44.034352+0000","last_peered":"2024-01-22T10:13:44.034352+0000","last_clean":"2024-01-22T10:13:44.034352+0000","last_became_active":"2024-01-22T10:13:42.634366+0000","last_became_peered":"2024-01-22T10:13:42.634366+0000","last_unstale":"2024-01-22T10:13:44.034352+0000","last_undegraded":"2024-01-22T10:13:44.034352+0000","last_fullsized":"2024-01-22T10:13:44.034352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034137+0000","last_change":"2024-01-22T10:13:42.624821+0000","last_active":"2024-01-22T10:13:44.034137+0000","last_peered":"2024-01-22T10:13:44.034137+0000","last_clean":"2024-01-22T10:13:44.034137+0000","last_became_active":"2024-01-22T10:13:42.624548+0000","last_became_peered":"2024-01-22T10:13:42.624548+0000","last_unstale":"2024-01-22T10:13:44.034137+0000","last_undegraded":"2024-01-22T10:13:44.034137+0000","last_fullsized":"2024-01-22T10:13:44.034137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:26.195084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624093+0000","last_change":"2024-01-22T10:13:42.625911+0000","last_active":"2024-01-22T10:13:43.624093+0000","last_peered":"2024-01-22T10:13:43.624093+0000","last_clean":"2024-01-22T10:13:43.624093+0000","last_became_active":"2024-01-22T10:13:42.625647+0000","last_became_peered":"2024-01-22T10:13:42.625647+0000","last_unstale":"2024-01-22T10:13:43.624093+0000","last_undegraded":"2024-01-22T10:13:43.624093+0000","last_fullsized":"2024-01-22T10:13:43.624093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034305+0000","last_change":"2024-01-22T10:13:42.621130+0000","last_active":"2024-01-22T10:13:44.034305+0000","last_peered":"2024-01-22T10:13:44.034305+0000","last_clean":"2024-01-22T10:13:44.034305+0000","last_became_active":"2024-01-22T10:13:42.620805+0000","last_became_peered":"2024-01-22T10:13:42.620805+0000","last_unstale":"2024-01-22T10:13:44.034305+0000","last_undegraded":"2024-01-22T10:13:44.034305+0000","last_fullsized":"2024-01-22T10:13:44.034305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:20.447342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624819+0000","last_change":"2024-01-22T10:13:42.624267+0000","last_active":"2024-01-22T10:13:43.624819+0000","last_peered":"2024-01-22T10:13:43.624819+0000","last_clean":"2024-01-22T10:13:43.624819+0000","last_became_active":"2024-01-22T10:13:42.623306+0000","last_became_peered":"2024-01-22T10:13:42.623306+0000","last_unstale":"2024-01-22T10:13:43.624819+0000","last_undegraded":"2024-01-22T10:13:43.624819+0000","last_fullsized":"2024-01-22T10:13:43.624819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:55.572047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.625077+0000","last_change":"2024-01-22T10:13:42.617345+0000","last_active":"2024-01-22T10:13:43.625077+0000","last_peered":"2024-01-22T10:13:43.625077+0000","last_clean":"2024-01-22T10:13:43.625077+0000","last_became_active":"2024-01-22T10:13:42.617072+0000","last_became_peered":"2024-01-22T10:13:42.617072+0000","last_unstale":"2024-01-22T10:13:43.625077+0000","last_undegraded":"2024-01-22T10:13:43.625077+0000","last_fullsized":"2024-01-22T10:13:43.625077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:08:00.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624439+0000","last_change":"2024-01-22T10:13:42.625193+0000","last_active":"2024-01-22T10:13:43.624439+0000","last_peered":"2024-01-22T10:13:43.624439+0000","last_clean":"2024-01-22T10:13:43.624439+0000","last_became_active":"2024-01-22T10:13:42.624862+0000","last_became_peered":"2024-01-22T10:13:42.624862+0000","last_unstale":"2024-01-22T10:13:43.624439+0000","last_undegraded":"2024-01-22T10:13:43.624439+0000","last_fullsized":"2024-01-22T10:13:43.624439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:08:00.177276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624133+0000","last_change":"2024-01-22T10:13:42.626004+0000","last_active":"2024-01-22T10:13:43.624133+0000","last_peered":"2024-01-22T10:13:43.624133+0000","last_clean":"2024-01-22T10:13:43.624133+0000","last_became_active":"2024-01-22T10:13:42.625078+0000","last_became_peered":"2024-01-22T10:13:42.625078+0000","last_unstale":"2024-01-22T10:13:43.624133+0000","last_undegraded":"2024-01-22T10:13:43.624133+0000","last_fullsized":"2024-01-22T10:13:43.624133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:42:48.607289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034290+0000","last_change":"2024-01-22T10:13:42.626913+0000","last_active":"2024-01-22T10:13:44.034290+0000","last_peered":"2024-01-22T10:13:44.034290+0000","last_clean":"2024-01-22T10:13:44.034290+0000","last_became_active":"2024-01-22T10:13:42.626641+0000","last_became_peered":"2024-01-22T10:13:42.626641+0000","last_unstale":"2024-01-22T10:13:44.034290+0000","last_undegraded":"2024-01-22T10:13:44.034290+0000","last_fullsized":"2024-01-22T10:13:44.034290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:48.542860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035305+0000","last_change":"2024-01-22T10:13:42.626420+0000","last_active":"2024-01-22T10:13:44.035305+0000","last_peered":"2024-01-22T10:13:44.035305+0000","last_clean":"2024-01-22T10:13:44.035305+0000","last_became_active":"2024-01-22T10:13:42.626133+0000","last_became_peered":"2024-01-22T10:13:42.626133+0000","last_unstale":"2024-01-22T10:13:44.035305+0000","last_undegraded":"2024-01-22T10:13:44.035305+0000","last_fullsized":"2024-01-22T10:13:44.035305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:33:09.287996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035119+0000","last_change":"2024-01-22T10:13:42.637449+0000","last_active":"2024-01-22T10:13:44.035119+0000","last_peered":"2024-01-22T10:13:44.035119+0000","last_clean":"2024-01-22T10:13:44.035119+0000","last_became_active":"2024-01-22T10:13:42.637144+0000","last_became_peered":"2024-01-22T10:13:42.637144+0000","last_unstale":"2024-01-22T10:13:44.035119+0000","last_undegraded":"2024-01-22T10:13:44.035119+0000","last_fullsized":"2024-01-22T10:13:44.035119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:09.341746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033847+0000","last_change":"2024-01-22T10:13:42.623905+0000","last_active":"2024-01-22T10:13:44.033847+0000","last_peered":"2024-01-22T10:13:44.033847+0000","last_clean":"2024-01-22T10:13:44.033847+0000","last_became_active":"2024-01-22T10:13:42.623652+0000","last_became_peered":"2024-01-22T10:13:42.623652+0000","last_unstale":"2024-01-22T10:13:44.033847+0000","last_undegraded":"2024-01-22T10:13:44.033847+0000","last_fullsized":"2024-01-22T10:13:44.033847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034166+0000","last_change":"2024-01-22T10:13:42.626456+0000","last_active":"2024-01-22T10:13:44.034166+0000","last_peered":"2024-01-22T10:13:44.034166+0000","last_clean":"2024-01-22T10:13:44.034166+0000","last_became_active":"2024-01-22T10:13:42.626193+0000","last_became_peered":"2024-01-22T10:13:42.626193+0000","last_unstale":"2024-01-22T10:13:44.034166+0000","last_undegraded":"2024-01-22T10:13:44.034166+0000","last_fullsized":"2024-01-22T10:13:44.034166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:17.709645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622986+0000","last_change":"2024-01-22T10:13:42.619961+0000","last_active":"2024-01-22T10:13:43.622986+0000","last_peered":"2024-01-22T10:13:43.622986+0000","last_clean":"2024-01-22T10:13:43.622986+0000","last_became_active":"2024-01-22T10:13:42.619484+0000","last_became_peered":"2024-01-22T10:13:42.619484+0000","last_unstale":"2024-01-22T10:13:43.622986+0000","last_undegraded":"2024-01-22T10:13:43.622986+0000","last_fullsized":"2024-01-22T10:13:43.622986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624437+0000","last_change":"2024-01-22T10:13:42.621000+0000","last_active":"2024-01-22T10:13:43.624437+0000","last_peered":"2024-01-22T10:13:43.624437+0000","last_clean":"2024-01-22T10:13:43.624437+0000","last_became_active":"2024-01-22T10:13:42.620624+0000","last_became_peered":"2024-01-22T10:13:42.620624+0000","last_unstale":"2024-01-22T10:13:43.624437+0000","last_undegraded":"2024-01-22T10:13:43.624437+0000","last_fullsized":"2024-01-22T10:13:43.624437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:13.693929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622855+0000","last_change":"2024-01-22T10:13:42.631519+0000","last_active":"2024-01-22T10:13:43.622855+0000","last_peered":"2024-01-22T10:13:43.622855+0000","last_clean":"2024-01-22T10:13:43.622855+0000","last_became_active":"2024-01-22T10:13:42.630812+0000","last_became_peered":"2024-01-22T10:13:42.630812+0000","last_unstale":"2024-01-22T10:13:43.622855+0000","last_undegraded":"2024-01-22T10:13:43.622855+0000","last_fullsized":"2024-01-22T10:13:43.622855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:30:17.081991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034519+0000","last_change":"2024-01-22T10:13:42.624797+0000","last_active":"2024-01-22T10:13:44.034519+0000","last_peered":"2024-01-22T10:13:44.034519+0000","last_clean":"2024-01-22T10:13:44.034519+0000","last_became_active":"2024-01-22T10:13:42.624529+0000","last_became_peered":"2024-01-22T10:13:42.624529+0000","last_unstale":"2024-01-22T10:13:44.034519+0000","last_undegraded":"2024-01-22T10:13:44.034519+0000","last_fullsized":"2024-01-22T10:13:44.034519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:27.521783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035160+0000","last_change":"2024-01-22T10:13:42.637426+0000","last_active":"2024-01-22T10:13:44.035160+0000","last_peered":"2024-01-22T10:13:44.035160+0000","last_clean":"2024-01-22T10:13:44.035160+0000","last_became_active":"2024-01-22T10:13:42.637077+0000","last_became_peered":"2024-01-22T10:13:42.637077+0000","last_unstale":"2024-01-22T10:13:44.035160+0000","last_undegraded":"2024-01-22T10:13:44.035160+0000","last_fullsized":"2024-01-22T10:13:44.035160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:21:10.389082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624648+0000","last_change":"2024-01-22T10:13:42.617414+0000","last_active":"2024-01-22T10:13:43.624648+0000","last_peered":"2024-01-22T10:13:43.624648+0000","last_clean":"2024-01-22T10:13:43.624648+0000","last_became_active":"2024-01-22T10:13:42.617110+0000","last_became_peered":"2024-01-22T10:13:42.617110+0000","last_unstale":"2024-01-22T10:13:43.624648+0000","last_undegraded":"2024-01-22T10:13:43.624648+0000","last_fullsized":"2024-01-22T10:13:43.624648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986570+0000","last_change":"2024-01-22T10:13:42.628627+0000","last_active":"2024-01-22T10:13:43.986570+0000","last_peered":"2024-01-22T10:13:43.986570+0000","last_clean":"2024-01-22T10:13:43.986570+0000","last_became_active":"2024-01-22T10:13:42.628259+0000","last_became_peered":"2024-01-22T10:13:42.628259+0000","last_unstale":"2024-01-22T10:13:43.986570+0000","last_undegraded":"2024-01-22T10:13:43.986570+0000","last_fullsized":"2024-01-22T10:13:43.986570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:49.014219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624513+0000","last_change":"2024-01-22T10:13:42.624473+0000","last_active":"2024-01-22T10:13:43.624513+0000","last_peered":"2024-01-22T10:13:43.624513+0000","last_clean":"2024-01-22T10:13:43.624513+0000","last_became_active":"2024-01-22T10:13:42.623675+0000","last_became_peered":"2024-01-22T10:13:42.623675+0000","last_unstale":"2024-01-22T10:13:43.624513+0000","last_undegraded":"2024-01-22T10:13:43.624513+0000","last_fullsized":"2024-01-22T10:13:43.624513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:00:42.245954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034197+0000","last_change":"2024-01-22T10:13:42.623919+0000","last_active":"2024-01-22T10:13:44.034197+0000","last_peered":"2024-01-22T10:13:44.034197+0000","last_clean":"2024-01-22T10:13:44.034197+0000","last_became_active":"2024-01-22T10:13:42.623680+0000","last_became_peered":"2024-01-22T10:13:42.623680+0000","last_unstale":"2024-01-22T10:13:44.034197+0000","last_undegraded":"2024-01-22T10:13:44.034197+0000","last_fullsized":"2024-01-22T10:13:44.034197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:09.341746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.638092+0000","last_change":"2024-01-22T10:13:41.601272+0000","last_active":"2024-01-22T10:13:42.638092+0000","last_peered":"2024-01-22T10:13:42.638092+0000","last_clean":"2024-01-22T10:13:42.638092+0000","last_became_active":"2024-01-22T10:13:41.600823+0000","last_became_peered":"2024-01-22T10:13:41.600823+0000","last_unstale":"2024-01-22T10:13:42.638092+0000","last_undegraded":"2024-01-22T10:13:42.638092+0000","last_fullsized":"2024-01-22T10:13:42.638092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:25.193353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986817+0000","last_change":"2024-01-22T10:13:42.628954+0000","last_active":"2024-01-22T10:13:43.986817+0000","last_peered":"2024-01-22T10:13:43.986817+0000","last_clean":"2024-01-22T10:13:43.986817+0000","last_became_active":"2024-01-22T10:13:42.626926+0000","last_became_peered":"2024-01-22T10:13:42.626926+0000","last_unstale":"2024-01-22T10:13:43.986817+0000","last_undegraded":"2024-01-22T10:13:43.986817+0000","last_fullsized":"2024-01-22T10:13:43.986817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.629143+0000","last_change":"2024-01-22T10:13:41.598256+0000","last_active":"2024-01-22T10:13:42.629143+0000","last_peered":"2024-01-22T10:13:42.629143+0000","last_clean":"2024-01-22T10:13:42.629143+0000","last_became_active":"2024-01-22T10:13:41.597853+0000","last_became_peered":"2024-01-22T10:13:41.597853+0000","last_unstale":"2024-01-22T10:13:42.629143+0000","last_undegraded":"2024-01-22T10:13:42.629143+0000","last_fullsized":"2024-01-22T10:13:42.629143+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:49:40.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035276+0000","last_change":"2024-01-22T10:13:42.637399+0000","last_active":"2024-01-22T10:13:44.035276+0000","last_peered":"2024-01-22T10:13:44.035276+0000","last_clean":"2024-01-22T10:13:44.035276+0000","last_became_active":"2024-01-22T10:13:42.637040+0000","last_became_peered":"2024-01-22T10:13:42.637040+0000","last_unstale":"2024-01-22T10:13:44.035276+0000","last_undegraded":"2024-01-22T10:13:44.035276+0000","last_fullsized":"2024-01-22T10:13:44.035276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:24:30.281721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.636032+0000","last_change":"2024-01-22T10:13:41.594947+0000","last_active":"2024-01-22T10:13:42.636032+0000","last_peered":"2024-01-22T10:13:42.636032+0000","last_clean":"2024-01-22T10:13:42.636032+0000","last_became_active":"2024-01-22T10:13:41.594297+0000","last_became_peered":"2024-01-22T10:13:41.594297+0000","last_unstale":"2024-01-22T10:13:42.636032+0000","last_undegraded":"2024-01-22T10:13:42.636032+0000","last_fullsized":"2024-01-22T10:13:42.636032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:08.340015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622980+0000","last_change":"2024-01-22T10:13:42.631105+0000","last_active":"2024-01-22T10:13:43.622980+0000","last_peered":"2024-01-22T10:13:43.622980+0000","last_clean":"2024-01-22T10:13:43.622980+0000","last_became_active":"2024-01-22T10:13:42.630434+0000","last_became_peered":"2024-01-22T10:13:42.630434+0000","last_unstale":"2024-01-22T10:13:43.622980+0000","last_undegraded":"2024-01-22T10:13:43.622980+0000","last_fullsized":"2024-01-22T10:13:43.622980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:20.447342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635390+0000","last_change":"2024-01-22T10:13:41.595358+0000","last_active":"2024-01-22T10:13:42.635390+0000","last_peered":"2024-01-22T10:13:42.635390+0000","last_clean":"2024-01-22T10:13:42.635390+0000","last_became_active":"2024-01-22T10:13:41.595111+0000","last_became_peered":"2024-01-22T10:13:41.595111+0000","last_unstale":"2024-01-22T10:13:42.635390+0000","last_undegraded":"2024-01-22T10:13:42.635390+0000","last_fullsized":"2024-01-22T10:13:42.635390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:42:01.516366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624715+0000","last_change":"2024-01-22T10:13:42.623899+0000","last_active":"2024-01-22T10:13:43.624715+0000","last_peered":"2024-01-22T10:13:43.624715+0000","last_clean":"2024-01-22T10:13:43.624715+0000","last_became_active":"2024-01-22T10:13:42.623634+0000","last_became_peered":"2024-01-22T10:13:42.623634+0000","last_unstale":"2024-01-22T10:13:43.624715+0000","last_undegraded":"2024-01-22T10:13:43.624715+0000","last_fullsized":"2024-01-22T10:13:43.624715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640552+0000","last_change":"2024-01-22T10:13:41.598117+0000","last_active":"2024-01-22T10:13:42.640552+0000","last_peered":"2024-01-22T10:13:42.640552+0000","last_clean":"2024-01-22T10:13:42.640552+0000","last_became_active":"2024-01-22T10:13:41.597046+0000","last_became_peered":"2024-01-22T10:13:41.597046+0000","last_unstale":"2024-01-22T10:13:42.640552+0000","last_undegraded":"2024-01-22T10:13:42.640552+0000","last_fullsized":"2024-01-22T10:13:42.640552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:44.239736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034430+0000","last_change":"2024-01-22T10:13:42.624025+0000","last_active":"2024-01-22T10:13:44.034430+0000","last_peered":"2024-01-22T10:13:44.034430+0000","last_clean":"2024-01-22T10:13:44.034430+0000","last_became_active":"2024-01-22T10:13:42.623760+0000","last_became_peered":"2024-01-22T10:13:42.623760+0000","last_unstale":"2024-01-22T10:13:44.034430+0000","last_undegraded":"2024-01-22T10:13:44.034430+0000","last_fullsized":"2024-01-22T10:13:44.034430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637438+0000","last_change":"2024-01-22T10:13:41.597237+0000","last_active":"2024-01-22T10:13:42.637438+0000","last_peered":"2024-01-22T10:13:42.637438+0000","last_clean":"2024-01-22T10:13:42.637438+0000","last_became_active":"2024-01-22T10:13:41.596938+0000","last_became_peered":"2024-01-22T10:13:41.596938+0000","last_unstale":"2024-01-22T10:13:42.637438+0000","last_undegraded":"2024-01-22T10:13:42.637438+0000","last_fullsized":"2024-01-22T10:13:42.637438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:24:25.193353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034876+0000","last_change":"2024-01-22T10:13:42.622658+0000","last_active":"2024-01-22T10:13:44.034876+0000","last_peered":"2024-01-22T10:13:44.034876+0000","last_clean":"2024-01-22T10:13:44.034876+0000","last_became_active":"2024-01-22T10:13:42.622398+0000","last_became_peered":"2024-01-22T10:13:42.622398+0000","last_unstale":"2024-01-22T10:13:44.034876+0000","last_undegraded":"2024-01-22T10:13:44.034876+0000","last_fullsized":"2024-01-22T10:13:44.034876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:49.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.610874+0000","last_change":"2024-01-22T10:13:41.593515+0000","last_active":"2024-01-22T10:13:42.610874+0000","last_peered":"2024-01-22T10:13:42.610874+0000","last_clean":"2024-01-22T10:13:42.610874+0000","last_became_active":"2024-01-22T10:13:41.593248+0000","last_became_peered":"2024-01-22T10:13:41.593248+0000","last_unstale":"2024-01-22T10:13:42.610874+0000","last_undegraded":"2024-01-22T10:13:42.610874+0000","last_fullsized":"2024-01-22T10:13:42.610874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:31:48.475424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622556+0000","last_change":"2024-01-22T10:13:42.630318+0000","last_active":"2024-01-22T10:13:43.622556+0000","last_peered":"2024-01-22T10:13:43.622556+0000","last_clean":"2024-01-22T10:13:43.622556+0000","last_became_active":"2024-01-22T10:13:42.623690+0000","last_became_peered":"2024-01-22T10:13:42.623690+0000","last_unstale":"2024-01-22T10:13:43.622556+0000","last_undegraded":"2024-01-22T10:13:43.622556+0000","last_fullsized":"2024-01-22T10:13:43.622556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:33:09.287996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621953+0000","last_change":"2024-01-22T10:13:41.601278+0000","last_active":"2024-01-22T10:13:42.621953+0000","last_peered":"2024-01-22T10:13:42.621953+0000","last_clean":"2024-01-22T10:13:42.621953+0000","last_became_active":"2024-01-22T10:13:41.601016+0000","last_became_peered":"2024-01-22T10:13:41.601016+0000","last_unstale":"2024-01-22T10:13:42.621953+0000","last_undegraded":"2024-01-22T10:13:42.621953+0000","last_fullsized":"2024-01-22T10:13:42.621953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:44:18.938485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034523+0000","last_change":"2024-01-22T10:13:42.633673+0000","last_active":"2024-01-22T10:13:44.034523+0000","last_peered":"2024-01-22T10:13:44.034523+0000","last_clean":"2024-01-22T10:13:44.034523+0000","last_became_active":"2024-01-22T10:13:42.633419+0000","last_became_peered":"2024-01-22T10:13:42.633419+0000","last_unstale":"2024-01-22T10:13:44.034523+0000","last_undegraded":"2024-01-22T10:13:44.034523+0000","last_fullsized":"2024-01-22T10:13:44.034523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:31:20.608068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.609891+0000","last_change":"2024-01-22T10:13:41.599944+0000","last_active":"2024-01-22T10:13:42.609891+0000","last_peered":"2024-01-22T10:13:42.609891+0000","last_clean":"2024-01-22T10:13:42.609891+0000","last_became_active":"2024-01-22T10:13:41.599658+0000","last_became_peered":"2024-01-22T10:13:41.599658+0000","last_unstale":"2024-01-22T10:13:42.609891+0000","last_undegraded":"2024-01-22T10:13:42.609891+0000","last_fullsized":"2024-01-22T10:13:42.609891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:48.012488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624289+0000","last_change":"2024-01-22T10:13:42.624509+0000","last_active":"2024-01-22T10:13:43.624289+0000","last_peered":"2024-01-22T10:13:43.624289+0000","last_clean":"2024-01-22T10:13:43.624289+0000","last_became_active":"2024-01-22T10:13:42.624258+0000","last_became_peered":"2024-01-22T10:13:42.624258+0000","last_unstale":"2024-01-22T10:13:43.624289+0000","last_undegraded":"2024-01-22T10:13:43.624289+0000","last_fullsized":"2024-01-22T10:13:43.624289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614510+0000","last_change":"2024-01-22T10:13:41.603096+0000","last_active":"2024-01-22T10:13:42.614510+0000","last_peered":"2024-01-22T10:13:42.614510+0000","last_clean":"2024-01-22T10:13:42.614510+0000","last_became_active":"2024-01-22T10:13:41.602525+0000","last_became_peered":"2024-01-22T10:13:41.602525+0000","last_unstale":"2024-01-22T10:13:42.614510+0000","last_undegraded":"2024-01-22T10:13:42.614510+0000","last_fullsized":"2024-01-22T10:13:42.614510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624219+0000","last_change":"2024-01-22T10:13:42.615910+0000","last_active":"2024-01-22T10:13:43.624219+0000","last_peered":"2024-01-22T10:13:43.624219+0000","last_clean":"2024-01-22T10:13:43.624219+0000","last_became_active":"2024-01-22T10:13:42.615658+0000","last_became_peered":"2024-01-22T10:13:42.615658+0000","last_unstale":"2024-01-22T10:13:43.624219+0000","last_undegraded":"2024-01-22T10:13:43.624219+0000","last_fullsized":"2024-01-22T10:13:43.624219+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.632230+0000","last_change":"2024-01-22T10:13:41.599287+0000","last_active":"2024-01-22T10:13:42.632230+0000","last_peered":"2024-01-22T10:13:42.632230+0000","last_clean":"2024-01-22T10:13:42.632230+0000","last_became_active":"2024-01-22T10:13:41.598984+0000","last_became_peered":"2024-01-22T10:13:41.598984+0000","last_unstale":"2024-01-22T10:13:42.632230+0000","last_undegraded":"2024-01-22T10:13:42.632230+0000","last_fullsized":"2024-01-22T10:13:42.632230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:34:48.012488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034398+0000","last_change":"2024-01-22T10:13:42.627844+0000","last_active":"2024-01-22T10:13:44.034398+0000","last_peered":"2024-01-22T10:13:44.034398+0000","last_clean":"2024-01-22T10:13:44.034398+0000","last_became_active":"2024-01-22T10:13:42.626619+0000","last_became_peered":"2024-01-22T10:13:42.626619+0000","last_unstale":"2024-01-22T10:13:44.034398+0000","last_undegraded":"2024-01-22T10:13:44.034398+0000","last_fullsized":"2024-01-22T10:13:44.034398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:00:42.245954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'11","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:54.782316+0000","last_change":"2024-01-22T10:13:41.596903+0000","last_active":"2024-01-22T10:13:54.782316+0000","last_peered":"2024-01-22T10:13:54.782316+0000","last_clean":"2024-01-22T10:13:54.782316+0000","last_became_active":"2024-01-22T10:13:41.596658+0000","last_became_peered":"2024-01-22T10:13:41.596658+0000","last_unstale":"2024-01-22T10:13:54.782316+0000","last_undegraded":"2024-01-22T10:13:54.782316+0000","last_fullsized":"2024-01-22T10:13:54.782316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T22:02:40.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622560+0000","last_change":"2024-01-22T10:13:42.627496+0000","last_active":"2024-01-22T10:13:43.622560+0000","last_peered":"2024-01-22T10:13:43.622560+0000","last_clean":"2024-01-22T10:13:43.622560+0000","last_became_active":"2024-01-22T10:13:42.627194+0000","last_became_peered":"2024-01-22T10:13:42.627194+0000","last_unstale":"2024-01-22T10:13:43.622560+0000","last_undegraded":"2024-01-22T10:13:43.622560+0000","last_fullsized":"2024-01-22T10:13:43.622560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:24:30.281721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640785+0000","last_change":"2024-01-22T10:13:41.602468+0000","last_active":"2024-01-22T10:13:42.640785+0000","last_peered":"2024-01-22T10:13:42.640785+0000","last_clean":"2024-01-22T10:13:42.640785+0000","last_became_active":"2024-01-22T10:13:41.602166+0000","last_became_peered":"2024-01-22T10:13:41.602166+0000","last_unstale":"2024-01-22T10:13:42.640785+0000","last_undegraded":"2024-01-22T10:13:42.640785+0000","last_fullsized":"2024-01-22T10:13:42.640785+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:47.541129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624319+0000","last_change":"2024-01-22T10:13:42.624284+0000","last_active":"2024-01-22T10:13:43.624319+0000","last_peered":"2024-01-22T10:13:43.624319+0000","last_clean":"2024-01-22T10:13:43.624319+0000","last_became_active":"2024-01-22T10:13:42.623996+0000","last_became_peered":"2024-01-22T10:13:42.623996+0000","last_unstale":"2024-01-22T10:13:43.624319+0000","last_undegraded":"2024-01-22T10:13:43.624319+0000","last_fullsized":"2024-01-22T10:13:43.624319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:41:55.572047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.611919+0000","last_change":"2024-01-22T10:13:41.596625+0000","last_active":"2024-01-22T10:13:42.611919+0000","last_peered":"2024-01-22T10:13:42.611919+0000","last_clean":"2024-01-22T10:13:42.611919+0000","last_became_active":"2024-01-22T10:13:41.596376+0000","last_became_peered":"2024-01-22T10:13:41.596376+0000","last_unstale":"2024-01-22T10:13:42.611919+0000","last_undegraded":"2024-01-22T10:13:42.611919+0000","last_fullsized":"2024-01-22T10:13:42.611919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:49:40.415775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624720+0000","last_change":"2024-01-22T10:13:42.624678+0000","last_active":"2024-01-22T10:13:43.624720+0000","last_peered":"2024-01-22T10:13:43.624720+0000","last_clean":"2024-01-22T10:13:43.624720+0000","last_became_active":"2024-01-22T10:13:42.624005+0000","last_became_peered":"2024-01-22T10:13:42.624005+0000","last_unstale":"2024-01-22T10:13:43.624720+0000","last_undegraded":"2024-01-22T10:13:43.624720+0000","last_fullsized":"2024-01-22T10:13:43.624720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.611000+0000","last_change":"2024-01-22T10:13:41.597383+0000","last_active":"2024-01-22T10:13:42.611000+0000","last_peered":"2024-01-22T10:13:42.611000+0000","last_clean":"2024-01-22T10:13:42.611000+0000","last_became_active":"2024-01-22T10:13:41.597155+0000","last_became_peered":"2024-01-22T10:13:41.597155+0000","last_unstale":"2024-01-22T10:13:42.611000+0000","last_undegraded":"2024-01-22T10:13:42.611000+0000","last_fullsized":"2024-01-22T10:13:42.611000+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:32.767529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986697+0000","last_change":"2024-01-22T10:13:42.625547+0000","last_active":"2024-01-22T10:13:43.986697+0000","last_peered":"2024-01-22T10:13:43.986697+0000","last_clean":"2024-01-22T10:13:43.986697+0000","last_became_active":"2024-01-22T10:13:42.625291+0000","last_became_peered":"2024-01-22T10:13:42.625291+0000","last_unstale":"2024-01-22T10:13:43.986697+0000","last_undegraded":"2024-01-22T10:13:43.986697+0000","last_fullsized":"2024-01-22T10:13:43.986697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:23:18.919792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635796+0000","last_change":"2024-01-22T10:13:41.595957+0000","last_active":"2024-01-22T10:13:42.635796+0000","last_peered":"2024-01-22T10:13:42.635796+0000","last_clean":"2024-01-22T10:13:42.635796+0000","last_became_active":"2024-01-22T10:13:41.594410+0000","last_became_peered":"2024-01-22T10:13:41.594410+0000","last_unstale":"2024-01-22T10:13:42.635796+0000","last_undegraded":"2024-01-22T10:13:42.635796+0000","last_fullsized":"2024-01-22T10:13:42.635796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:22:33.851960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.035330+0000","last_change":"2024-01-22T10:13:42.633175+0000","last_active":"2024-01-22T10:13:44.035330+0000","last_peered":"2024-01-22T10:13:44.035330+0000","last_clean":"2024-01-22T10:13:44.035330+0000","last_became_active":"2024-01-22T10:13:42.632877+0000","last_became_peered":"2024-01-22T10:13:42.632877+0000","last_unstale":"2024-01-22T10:13:44.035330+0000","last_undegraded":"2024-01-22T10:13:44.035330+0000","last_fullsized":"2024-01-22T10:13:44.035330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:00:21.049236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637591+0000","last_change":"2024-01-22T10:13:41.595203+0000","last_active":"2024-01-22T10:13:42.637591+0000","last_peered":"2024-01-22T10:13:42.637591+0000","last_clean":"2024-01-22T10:13:42.637591+0000","last_became_active":"2024-01-22T10:13:41.594555+0000","last_became_peered":"2024-01-22T10:13:41.594555+0000","last_unstale":"2024-01-22T10:13:42.637591+0000","last_undegraded":"2024-01-22T10:13:42.637591+0000","last_fullsized":"2024-01-22T10:13:42.637591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034639+0000","last_change":"2024-01-22T10:13:42.630113+0000","last_active":"2024-01-22T10:13:44.034639+0000","last_peered":"2024-01-22T10:13:44.034639+0000","last_clean":"2024-01-22T10:13:44.034639+0000","last_became_active":"2024-01-22T10:13:42.629837+0000","last_became_peered":"2024-01-22T10:13:42.629837+0000","last_unstale":"2024-01-22T10:13:44.034639+0000","last_undegraded":"2024-01-22T10:13:44.034639+0000","last_fullsized":"2024-01-22T10:13:44.034639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:31.185169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.635198+0000","last_change":"2024-01-22T10:13:41.602980+0000","last_active":"2024-01-22T10:13:42.635198+0000","last_peered":"2024-01-22T10:13:42.635198+0000","last_clean":"2024-01-22T10:13:42.635198+0000","last_became_active":"2024-01-22T10:13:41.602710+0000","last_became_peered":"2024-01-22T10:13:41.602710+0000","last_unstale":"2024-01-22T10:13:42.635198+0000","last_undegraded":"2024-01-22T10:13:42.635198+0000","last_fullsized":"2024-01-22T10:13:42.635198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.622803+0000","last_change":"2024-01-22T10:13:42.629784+0000","last_active":"2024-01-22T10:13:43.622803+0000","last_peered":"2024-01-22T10:13:43.622803+0000","last_clean":"2024-01-22T10:13:43.622803+0000","last_became_active":"2024-01-22T10:13:42.629488+0000","last_became_peered":"2024-01-22T10:13:42.629488+0000","last_unstale":"2024-01-22T10:13:43.622803+0000","last_undegraded":"2024-01-22T10:13:43.622803+0000","last_fullsized":"2024-01-22T10:13:43.622803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:19:17.630353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.637429+0000","last_change":"2024-01-22T10:13:41.599558+0000","last_active":"2024-01-22T10:13:42.637429+0000","last_peered":"2024-01-22T10:13:42.637429+0000","last_clean":"2024-01-22T10:13:42.637429+0000","last_became_active":"2024-01-22T10:13:41.599228+0000","last_became_peered":"2024-01-22T10:13:41.599228+0000","last_unstale":"2024-01-22T10:13:42.637429+0000","last_undegraded":"2024-01-22T10:13:42.637429+0000","last_fullsized":"2024-01-22T10:13:42.637429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:25:58.698252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034332+0000","last_change":"2024-01-22T10:13:42.626089+0000","last_active":"2024-01-22T10:13:44.034332+0000","last_peered":"2024-01-22T10:13:44.034332+0000","last_clean":"2024-01-22T10:13:44.034332+0000","last_became_active":"2024-01-22T10:13:42.625809+0000","last_became_peered":"2024-01-22T10:13:42.625809+0000","last_unstale":"2024-01-22T10:13:44.034332+0000","last_undegraded":"2024-01-22T10:13:44.034332+0000","last_fullsized":"2024-01-22T10:13:44.034332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:55.872670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.622441+0000","last_change":"2024-01-22T10:13:41.597556+0000","last_active":"2024-01-22T10:13:42.622441+0000","last_peered":"2024-01-22T10:13:42.622441+0000","last_clean":"2024-01-22T10:13:42.622441+0000","last_became_active":"2024-01-22T10:13:41.597157+0000","last_became_peered":"2024-01-22T10:13:41.597157+0000","last_unstale":"2024-01-22T10:13:42.622441+0000","last_undegraded":"2024-01-22T10:13:42.622441+0000","last_fullsized":"2024-01-22T10:13:42.622441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:54.870939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034040+0000","last_change":"2024-01-22T10:13:42.630577+0000","last_active":"2024-01-22T10:13:44.034040+0000","last_peered":"2024-01-22T10:13:44.034040+0000","last_clean":"2024-01-22T10:13:44.034040+0000","last_became_active":"2024-01-22T10:13:42.630345+0000","last_became_peered":"2024-01-22T10:13:42.630345+0000","last_unstale":"2024-01-22T10:13:44.034040+0000","last_undegraded":"2024-01-22T10:13:44.034040+0000","last_fullsized":"2024-01-22T10:13:44.034040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:33:00.953623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.633167+0000","last_change":"2024-01-22T10:13:41.603385+0000","last_active":"2024-01-22T10:13:42.633167+0000","last_peered":"2024-01-22T10:13:42.633167+0000","last_clean":"2024-01-22T10:13:42.633167+0000","last_became_active":"2024-01-22T10:13:41.603096+0000","last_became_peered":"2024-01-22T10:13:41.603096+0000","last_unstale":"2024-01-22T10:13:42.633167+0000","last_undegraded":"2024-01-22T10:13:42.633167+0000","last_fullsized":"2024-01-22T10:13:42.633167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:52:13.557327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034134+0000","last_change":"2024-01-22T10:13:42.625780+0000","last_active":"2024-01-22T10:13:44.034134+0000","last_peered":"2024-01-22T10:13:44.034134+0000","last_clean":"2024-01-22T10:13:44.034134+0000","last_became_active":"2024-01-22T10:13:42.625524+0000","last_became_peered":"2024-01-22T10:13:42.625524+0000","last_unstale":"2024-01-22T10:13:44.034134+0000","last_undegraded":"2024-01-22T10:13:44.034134+0000","last_fullsized":"2024-01-22T10:13:44.034134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:58:45.241467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614787+0000","last_change":"2024-01-22T10:13:41.600994+0000","last_active":"2024-01-22T10:13:42.614787+0000","last_peered":"2024-01-22T10:13:42.614787+0000","last_clean":"2024-01-22T10:13:42.614787+0000","last_became_active":"2024-01-22T10:13:41.600704+0000","last_became_peered":"2024-01-22T10:13:41.600704+0000","last_unstale":"2024-01-22T10:13:42.614787+0000","last_undegraded":"2024-01-22T10:13:42.614787+0000","last_fullsized":"2024-01-22T10:13:42.614787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:12:54.870939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033907+0000","last_change":"2024-01-22T10:13:42.622896+0000","last_active":"2024-01-22T10:13:44.033907+0000","last_peered":"2024-01-22T10:13:44.033907+0000","last_clean":"2024-01-22T10:13:44.033907+0000","last_became_active":"2024-01-22T10:13:42.622631+0000","last_became_peered":"2024-01-22T10:13:42.622631+0000","last_unstale":"2024-01-22T10:13:44.033907+0000","last_undegraded":"2024-01-22T10:13:44.033907+0000","last_fullsized":"2024-01-22T10:13:44.033907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:43:02.897571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621795+0000","last_change":"2024-01-22T10:13:41.597586+0000","last_active":"2024-01-22T10:13:42.621795+0000","last_peered":"2024-01-22T10:13:42.621795+0000","last_clean":"2024-01-22T10:13:42.621795+0000","last_became_active":"2024-01-22T10:13:41.597324+0000","last_became_peered":"2024-01-22T10:13:41.597324+0000","last_unstale":"2024-01-22T10:13:42.621795+0000","last_undegraded":"2024-01-22T10:13:42.621795+0000","last_fullsized":"2024-01-22T10:13:42.621795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:43:01.895840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624510+0000","last_change":"2024-01-22T10:13:42.617670+0000","last_active":"2024-01-22T10:13:43.624510+0000","last_peered":"2024-01-22T10:13:43.624510+0000","last_clean":"2024-01-22T10:13:43.624510+0000","last_became_active":"2024-01-22T10:13:42.616992+0000","last_became_peered":"2024-01-22T10:13:42.616992+0000","last_unstale":"2024-01-22T10:13:43.624510+0000","last_undegraded":"2024-01-22T10:13:43.624510+0000","last_fullsized":"2024-01-22T10:13:43.624510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:06.202314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614491+0000","last_change":"2024-01-22T10:13:41.599431+0000","last_active":"2024-01-22T10:13:42.614491+0000","last_peered":"2024-01-22T10:13:42.614491+0000","last_clean":"2024-01-22T10:13:42.614491+0000","last_became_active":"2024-01-22T10:13:41.599008+0000","last_became_peered":"2024-01-22T10:13:41.599008+0000","last_unstale":"2024-01-22T10:13:42.614491+0000","last_undegraded":"2024-01-22T10:13:42.614491+0000","last_fullsized":"2024-01-22T10:13:42.614491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T22:02:40.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034455+0000","last_change":"2024-01-22T10:13:42.626317+0000","last_active":"2024-01-22T10:13:44.034455+0000","last_peered":"2024-01-22T10:13:44.034455+0000","last_clean":"2024-01-22T10:13:44.034455+0000","last_became_active":"2024-01-22T10:13:42.626088+0000","last_became_peered":"2024-01-22T10:13:42.626088+0000","last_unstale":"2024-01-22T10:13:44.034455+0000","last_undegraded":"2024-01-22T10:13:44.034455+0000","last_fullsized":"2024-01-22T10:13:44.034455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:39:36.530327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.640956+0000","last_change":"2024-01-22T10:13:41.597369+0000","last_active":"2024-01-22T10:13:42.640956+0000","last_peered":"2024-01-22T10:13:42.640956+0000","last_clean":"2024-01-22T10:13:42.640956+0000","last_became_active":"2024-01-22T10:13:41.597126+0000","last_became_peered":"2024-01-22T10:13:41.597126+0000","last_unstale":"2024-01-22T10:13:42.640956+0000","last_undegraded":"2024-01-22T10:13:42.640956+0000","last_fullsized":"2024-01-22T10:13:42.640956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034664+0000","last_change":"2024-01-22T10:13:42.624684+0000","last_active":"2024-01-22T10:13:44.034664+0000","last_peered":"2024-01-22T10:13:44.034664+0000","last_clean":"2024-01-22T10:13:44.034664+0000","last_became_active":"2024-01-22T10:13:42.624431+0000","last_became_peered":"2024-01-22T10:13:42.624431+0000","last_unstale":"2024-01-22T10:13:44.034664+0000","last_undegraded":"2024-01-22T10:13:44.034664+0000","last_fullsized":"2024-01-22T10:13:44.034664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:05.225071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:51.613777+0000","last_change":"2024-01-22T10:13:41.603337+0000","last_active":"2024-01-22T10:13:51.613777+0000","last_peered":"2024-01-22T10:13:51.613777+0000","last_clean":"2024-01-22T10:13:51.613777+0000","last_became_active":"2024-01-22T10:13:41.602818+0000","last_became_peered":"2024-01-22T10:13:41.602818+0000","last_unstale":"2024-01-22T10:13:51.613777+0000","last_undegraded":"2024-01-22T10:13:51.613777+0000","last_fullsized":"2024-01-22T10:13:51.613777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:13.717585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.033982+0000","last_change":"2024-01-22T10:13:42.626012+0000","last_active":"2024-01-22T10:13:44.033982+0000","last_peered":"2024-01-22T10:13:44.033982+0000","last_clean":"2024-01-22T10:13:44.033982+0000","last_became_active":"2024-01-22T10:13:42.625759+0000","last_became_peered":"2024-01-22T10:13:42.625759+0000","last_unstale":"2024-01-22T10:13:44.033982+0000","last_undegraded":"2024-01-22T10:13:44.033982+0000","last_fullsized":"2024-01-22T10:13:44.033982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.613216+0000","last_change":"2024-01-22T10:13:41.593779+0000","last_active":"2024-01-22T10:13:42.613216+0000","last_peered":"2024-01-22T10:13:42.613216+0000","last_clean":"2024-01-22T10:13:42.613216+0000","last_became_active":"2024-01-22T10:13:41.593469+0000","last_became_peered":"2024-01-22T10:13:41.593469+0000","last_unstale":"2024-01-22T10:13:42.613216+0000","last_undegraded":"2024-01-22T10:13:42.613216+0000","last_fullsized":"2024-01-22T10:13:42.613216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:52:13.557327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.986594+0000","last_change":"2024-01-22T10:13:42.622705+0000","last_active":"2024-01-22T10:13:43.986594+0000","last_peered":"2024-01-22T10:13:43.986594+0000","last_clean":"2024-01-22T10:13:43.986594+0000","last_became_active":"2024-01-22T10:13:42.622464+0000","last_became_peered":"2024-01-22T10:13:42.622464+0000","last_unstale":"2024-01-22T10:13:43.986594+0000","last_undegraded":"2024-01-22T10:13:43.986594+0000","last_fullsized":"2024-01-22T10:13:43.986594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:22:34.853691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.614866+0000","last_change":"2024-01-22T10:13:41.601304+0000","last_active":"2024-01-22T10:13:42.614866+0000","last_peered":"2024-01-22T10:13:42.614866+0000","last_clean":"2024-01-22T10:13:42.614866+0000","last_became_active":"2024-01-22T10:13:41.601010+0000","last_became_peered":"2024-01-22T10:13:41.601010+0000","last_unstale":"2024-01-22T10:13:42.614866+0000","last_undegraded":"2024-01-22T10:13:42.614866+0000","last_fullsized":"2024-01-22T10:13:42.614866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:33:12.832661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034206+0000","last_change":"2024-01-22T10:13:42.623113+0000","last_active":"2024-01-22T10:13:44.034206+0000","last_peered":"2024-01-22T10:13:44.034206+0000","last_clean":"2024-01-22T10:13:44.034206+0000","last_became_active":"2024-01-22T10:13:42.622855+0000","last_became_peered":"2024-01-22T10:13:42.622855+0000","last_unstale":"2024-01-22T10:13:44.034206+0000","last_undegraded":"2024-01-22T10:13:44.034206+0000","last_fullsized":"2024-01-22T10:13:44.034206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:21:10.389082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.612039+0000","last_change":"2024-01-22T10:13:41.597546+0000","last_active":"2024-01-22T10:13:42.612039+0000","last_peered":"2024-01-22T10:13:42.612039+0000","last_clean":"2024-01-22T10:13:42.612039+0000","last_became_active":"2024-01-22T10:13:41.597270+0000","last_became_peered":"2024-01-22T10:13:41.597270+0000","last_unstale":"2024-01-22T10:13:42.612039+0000","last_undegraded":"2024-01-22T10:13:42.612039+0000","last_fullsized":"2024-01-22T10:13:42.612039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:33:12.832661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624046+0000","last_change":"2024-01-22T10:13:42.623605+0000","last_active":"2024-01-22T10:13:43.624046+0000","last_peered":"2024-01-22T10:13:43.624046+0000","last_clean":"2024-01-22T10:13:43.624046+0000","last_became_active":"2024-01-22T10:13:42.623331+0000","last_became_peered":"2024-01-22T10:13:42.623331+0000","last_unstale":"2024-01-22T10:13:43.624046+0000","last_undegraded":"2024-01-22T10:13:43.624046+0000","last_fullsized":"2024-01-22T10:13:43.624046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.621970+0000","last_change":"2024-01-22T10:13:41.596973+0000","last_active":"2024-01-22T10:13:42.621970+0000","last_peered":"2024-01-22T10:13:42.621970+0000","last_clean":"2024-01-22T10:13:42.621970+0000","last_became_active":"2024-01-22T10:13:41.596639+0000","last_became_peered":"2024-01-22T10:13:41.596639+0000","last_unstale":"2024-01-22T10:13:42.621970+0000","last_undegraded":"2024-01-22T10:13:42.621970+0000","last_fullsized":"2024-01-22T10:13:42.621970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:32:59.951892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:44.034916+0000","last_change":"2024-01-22T10:13:42.637594+0000","last_active":"2024-01-22T10:13:44.034916+0000","last_peered":"2024-01-22T10:13:44.034916+0000","last_clean":"2024-01-22T10:13:44.034916+0000","last_became_active":"2024-01-22T10:13:42.637152+0000","last_became_peered":"2024-01-22T10:13:42.637152+0000","last_unstale":"2024-01-22T10:13:44.034916+0000","last_undegraded":"2024-01-22T10:13:44.034916+0000","last_fullsized":"2024-01-22T10:13:44.034916+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:17:33.769260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.610626+0000","last_change":"2024-01-22T10:13:41.600670+0000","last_active":"2024-01-22T10:13:42.610626+0000","last_peered":"2024-01-22T10:13:42.610626+0000","last_clean":"2024-01-22T10:13:42.610626+0000","last_became_active":"2024-01-22T10:13:41.600181+0000","last_became_peered":"2024-01-22T10:13:41.600181+0000","last_unstale":"2024-01-22T10:13:42.610626+0000","last_undegraded":"2024-01-22T10:13:42.610626+0000","last_fullsized":"2024-01-22T10:13:42.610626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:23:17.918061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:43.624601+0000","last_change":"2024-01-22T10:13:42.626739+0000","last_active":"2024-01-22T10:13:43.624601+0000","last_peered":"2024-01-22T10:13:43.624601+0000","last_clean":"2024-01-22T10:13:43.624601+0000","last_became_active":"2024-01-22T10:13:42.626445+0000","last_became_peered":"2024-01-22T10:13:42.626445+0000","last_unstale":"2024-01-22T10:13:43.624601+0000","last_undegraded":"2024-01-22T10:13:43.624601+0000","last_fullsized":"2024-01-22T10:13:43.624601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:29.231788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.613827+0000","last_change":"2024-01-22T10:13:41.600294+0000","last_active":"2024-01-22T10:13:42.613827+0000","last_peered":"2024-01-22T10:13:42.613827+0000","last_clean":"2024-01-22T10:13:42.613827+0000","last_became_active":"2024-01-22T10:13:41.599985+0000","last_became_peered":"2024-01-22T10:13:41.599985+0000","last_unstale":"2024-01-22T10:13:42.613827+0000","last_undegraded":"2024-01-22T10:13:42.613827+0000","last_fullsized":"2024-01-22T10:13:42.613827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:40.576371+0000","last_clean_scrub_stamp":"2024-01-22T10:13:40.576371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:12:47.541129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-22T10:13:42.609823+0000","last_change":"2024-01-22T10:12:52.033359+0000","last_active":"2024-01-22T10:13:42.609823+0000","last_peered":"2024-01-22T10:13:42.609823+0000","last_clean":"2024-01-22T10:13:42.609823+0000","last_became_active":"2024-01-22T10:12:52.033101+0000","last_became_peered":"2024-01-22T10:12:52.033101+0000","last_unstale":"2024-01-22T10:13:42.609823+0000","last_undegraded":"2024-01-22T10:13:42.609823+0000","last_fullsized":"2024-01-22T10:13:42.609823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:12:51.022957+0000","last_clean_scrub_stamp":"2024-01-22T10:12:51.022957+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:45:37.023233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7941,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":719503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48699999999999999}]},{"osd":1,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.497},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.41299999999999998}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.436}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.372}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.54900000000000004}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66800000000000004}]},{"osd":1,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51000000000000001}]},{"osd":2,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.36499999999999999}]},{"osd":3,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.434},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.626}]},{"osd":5,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.621},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.34200000000000003}]},{"osd":2,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.39400000000000002}]},{"osd":3,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.41899999999999998}]},{"osd":4,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58999999999999997}]},{"osd":6,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":129149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53600000000000003}]},{"osd":1,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52400000000000002}]},{"osd":2,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.626},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.56599999999999995}]},{"osd":3,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.435},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.63900000000000001}]},{"osd":6,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.48499999999999999}]},{"osd":7,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.50900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":136210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.28699999999999998}]},{"osd":1,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.246},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.377}]},{"osd":2,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.30499999999999999}]},{"osd":4,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":129115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.42299999999999999}]},{"osd":1,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.37},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.34300000000000003}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64500000000000002}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.58999999999999997}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":136210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.20999999999999999}]},{"osd":2,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.191},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28699999999999998}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.22900000000000001}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.45200000000000001}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.46700000000000003}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.50700000000000001}]},{"osd":7,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.437}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":719413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.25},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.28799999999999998}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.314}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.53300000000000003}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56899999999999995}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T10:14:01.198 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.198 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.198 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.199 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.199 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.199 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.199 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.199 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.199 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.199 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.200 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.200 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.200 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.200 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.200 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.200 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.201 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.201 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.201 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.201 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.201 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.201 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.202 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.202 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.202 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.202 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.202 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.202 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.203 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.203 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.203 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.203 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.203 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.203 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.204 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.204 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.204 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.204 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.204 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.204 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.205 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.205 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.205 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.205 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.205 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.205 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.206 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.206 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.206 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.206 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.206 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.206 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.207 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.207 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.207 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.207 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.207 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.207 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.207 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.208 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.208 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.208 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.208 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.208 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.208 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.209 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.209 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.209 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.209 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.209 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.209 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.210 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.210 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.210 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.210 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.210 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.210 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.210 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.211 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.211 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.211 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.211 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.211 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.211 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.212 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.212 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.212 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.212 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.212 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.212 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.213 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.213 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.213 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.213 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.213 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.213 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-01-22T10:13:40.576371+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=40, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.214 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-22T10:12:51.022957+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=12, tm_sec=51, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:01.214 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-22T10:14:03.154 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:14:03.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:14:03.160 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:14:21.214 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T10:14:21.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.343+0000 7fb82a968640 1 Processor -- start 2024-01-22T10:14:21.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.343+0000 7fb82a968640 1 -- start start 2024-01-22T10:14:21.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb82a968640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb824148d90 0x7fb8240b96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb82a968640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb82414ba30 0x7fb82414bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb82a968640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8240b9c30 con 0x7fb8240b4ec0 2024-01-22T10:14:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb82a968640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8240b68b0 con 0x7fb82414ba30 2024-01-22T10:14:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb82a968640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8240b5500 con 0x7fb824148d90 2024-01-22T10:14:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb828f05640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb82414ba30 0x7fb82414bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb828f05640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb82414ba30 0x7fb82414bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56404/0 (socket says 172.21.15.88:56404) 2024-01-22T10:14:21.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb828f05640 1 -- 172.21.15.88:0/822569881 learned_addr learned my addr 172.21.15.88:0/822569881 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:14:21.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb823fff640 1 --2- 172.21.15.88:0/822569881 >> v2:172.21.15.119:3300/0 conn(0x7fb824148d90 0x7fb8240b96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:21.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb828f05640 1 -- 172.21.15.88:0/822569881 >> v2:172.21.15.119:3300/0 conn(0x7fb824148d90 msgr2=0x7fb8240b96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:21.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb828f05640 1 --2- 172.21.15.88:0/822569881 >> v2:172.21.15.119:3300/0 conn(0x7fb824148d90 0x7fb8240b96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:21.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb828f05640 1 -- 172.21.15.88:0/822569881 >> v1:172.21.15.119:6789/0 conn(0x7fb8240b4ec0 legacy=0x7fb8240bdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:21.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb828f05640 1 -- 172.21.15.88:0/822569881 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240be230 con 0x7fb82414ba30 2024-01-22T10:14:21.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.344+0000 7fb823fff640 1 --2- 172.21.15.88:0/822569881 >> v2:172.21.15.119:3300/0 conn(0x7fb824148d90 0x7fb8240b96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-22T10:14:21.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.345+0000 7fb828f05640 1 --2- 172.21.15.88:0/822569881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb82414ba30 0x7fb82414bea0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb82406fb00 tx=0x7fb81c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d5e053ffa02c2f server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:21.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.345+0000 7fb822ffd640 1 -- 172.21.15.88:0/822569881 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c02ca80 con 0x7fb82414ba30 2024-01-22T10:14:21.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.345+0000 7fb822ffd640 1 -- 172.21.15.88:0/822569881 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c02cbe0 con 0x7fb82414ba30 2024-01-22T10:14:21.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.345+0000 7fb822ffd640 1 -- 172.21.15.88:0/822569881 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0343f0 con 0x7fb82414ba30 2024-01-22T10:14:21.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.345+0000 7fb82a968640 1 -- 172.21.15.88:0/822569881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb82414ba30 msgr2=0x7fb82414bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:21.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.345+0000 7fb82a968640 1 --2- 172.21.15.88:0/822569881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb82414ba30 0x7fb82414bea0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb82406fb00 tx=0x7fb81c02bee0 comp rx=0 tx=0).stop 2024-01-22T10:14:21.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.346+0000 7fb82a968640 1 -- 172.21.15.88:0/822569881 shutdown_connections 2024-01-22T10:14:21.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.346+0000 7fb82a968640 1 --2- 172.21.15.88:0/822569881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb82414ba30 0x7fb82414bea0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:21.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.346+0000 7fb82a968640 1 --2- 172.21.15.88:0/822569881 >> v2:172.21.15.119:3300/0 conn(0x7fb824148d90 0x7fb8240b96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:21.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.346+0000 7fb82a968640 1 -- 172.21.15.88:0/822569881 >> 172.21.15.88:0/822569881 conn(0x7fb82406ad20 msgr2=0x7fb8240bd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:21.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.346+0000 7fb82a968640 1 -- 172.21.15.88:0/822569881 shutdown_connections 2024-01-22T10:14:21.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.346+0000 7fb82a968640 1 -- 172.21.15.88:0/822569881 wait complete. 2024-01-22T10:14:21.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.347+0000 7fb82a968640 1 Processor -- start 2024-01-22T10:14:21.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.347+0000 7fb82a968640 1 -- start start 2024-01-22T10:14:21.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.347+0000 7fb82a968640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8240b4ec0 0x7fb8240724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:21.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.347+0000 7fb82a968640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb824148d90 0x7fb8241d3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:21.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.347+0000 7fb82a968640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb82414ba30 0x7fb824144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:21.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.347+0000 7fb82a968640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240729e0 con 0x7fb82414ba30 2024-01-22T10:14:21.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.347+0000 7fb82a968640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8241d6880 con 0x7fb8240b4ec0 2024-01-22T10:14:21.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.347+0000 7fb82a968640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8241d4620 con 0x7fb824148d90 2024-01-22T10:14:21.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb828f05640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb82414ba30 0x7fb824144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:21.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb828f05640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb82414ba30 0x7fb824144690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56418/0 (socket says 172.21.15.88:56418) 2024-01-22T10:14:21.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb828f05640 1 -- 172.21.15.88:0/2176028673 learned_addr learned my addr 172.21.15.88:0/2176028673 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:14:21.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb823fff640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8240b4ec0 0x7fb8240724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:21.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb828f05640 1 -- 172.21.15.88:0/2176028673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb824148d90 msgr2=0x7fb8241d3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:21.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb828f05640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb824148d90 0x7fb8241d3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:21.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb828f05640 1 -- 172.21.15.88:0/2176028673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8240b4ec0 msgr2=0x7fb8240724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:21.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb828f05640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8240b4ec0 0x7fb8240724a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:21.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb828f05640 1 -- 172.21.15.88:0/2176028673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c009b30 con 0x7fb82414ba30 2024-01-22T10:14:21.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb828f05640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb82414ba30 0x7fb824144690 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb81c036040 tx=0x7fb81c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:21.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb820ff9640 1 -- 172.21.15.88:0/2176028673 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c03e450 con 0x7fb82414ba30 2024-01-22T10:14:21.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb820ff9640 1 -- 172.21.15.88:0/2176028673 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c03e5d0 con 0x7fb82414ba30 2024-01-22T10:14:21.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb82a968640 1 -- 172.21.15.88:0/2176028673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8241d5250 con 0x7fb82414ba30 2024-01-22T10:14:21.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb820ff9640 1 -- 172.21.15.88:0/2176028673 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c03e980 con 0x7fb82414ba30 2024-01-22T10:14:21.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.348+0000 7fb82a968640 1 -- 172.21.15.88:0/2176028673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8241d2b40 con 0x7fb82414ba30 2024-01-22T10:14:21.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.349+0000 7fb82a968640 1 -- 172.21.15.88:0/2176028673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8241d5770 con 0x7fb82414ba30 2024-01-22T10:14:21.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.350+0000 7fb820ff9640 1 -- 172.21.15.88:0/2176028673 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fb81c02cd50 con 0x7fb82414ba30 2024-01-22T10:14:21.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.350+0000 7fb820ff9640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb81006b360 0x7fb81006d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:21.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.350+0000 7fb820ff9640 1 -- 172.21.15.88:0/2176028673 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb81c0ac4a0 con 0x7fb82414ba30 2024-01-22T10:14:21.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.350+0000 7fb823fff640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb81006b360 0x7fb81006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:21.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.350+0000 7fb823fff640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb81006b360 0x7fb81006d820 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb814008850 tx=0x7fb814008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:21.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.354+0000 7fb820ff9640 1 -- 172.21.15.88:0/2176028673 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb8241d5770 con 0x7fb82414ba30 2024-01-22T10:14:21.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.519+0000 7fb82a968640 1 -- 172.21.15.88:0/2176028673 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8240b5a30 con 0x7fb81006b360 2024-01-22T10:14:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.526+0000 7fb820ff9640 1 -- 172.21.15.88:0/2176028673 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289796 (secure 0 0 0) 0x7fb81400c040 con 0x7fb81006b360 2024-01-22T10:14:21.512 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:14:21.514 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-01-22T10:14:21.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.530+0000 7fb82a968640 1 -- 172.21.15.88:0/2176028673 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb81006b360 msgr2=0x7fb81006d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:21.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.530+0000 7fb82a968640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb81006b360 0x7fb81006d820 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb814008850 tx=0x7fb814008040 comp rx=0 tx=0).stop 2024-01-22T10:14:21.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.530+0000 7fb82a968640 1 -- 172.21.15.88:0/2176028673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb82414ba30 msgr2=0x7fb824144690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:21.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.530+0000 7fb82a968640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb82414ba30 0x7fb824144690 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb81c036040 tx=0x7fb81c004a40 comp rx=0 tx=0).stop 2024-01-22T10:14:21.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.530+0000 7fb82a968640 1 -- 172.21.15.88:0/2176028673 shutdown_connections 2024-01-22T10:14:21.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.530+0000 7fb82a968640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fb81006b360 0x7fb81006d820 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:21.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.530+0000 7fb82a968640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb824148d90 0x7fb8241d3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:21.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.530+0000 7fb82a968640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb82414ba30 0x7fb824144690 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:21.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.530+0000 7fb82a968640 1 --2- 172.21.15.88:0/2176028673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8240b4ec0 0x7fb8240724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:21.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.530+0000 7fb82a968640 1 -- 172.21.15.88:0/2176028673 >> 172.21.15.88:0/2176028673 conn(0x7fb82406ad20 msgr2=0x7fb8240b86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:21.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.530+0000 7fb82a968640 1 -- 172.21.15.88:0/2176028673 shutdown_connections 2024-01-22T10:14:21.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:21.530+0000 7fb82a968640 1 -- 172.21.15.88:0/2176028673 wait complete. 2024-01-22T10:14:21.522 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-01-22T10:14:20.722393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598309,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219984,"kb_used_data":3856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754736,"statfs":{"total":773094113280,"available":772868849664,"internally_reserved":0,"allocated":3948544,"data_stored":2228978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003472"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.046419+0000","last_change":"2024-01-22T10:14:07.046448+0000","last_active":"2024-01-22T10:14:07.046419+0000","last_peered":"2024-01-22T10:14:07.046419+0000","last_clean":"2024-01-22T10:14:07.046419+0000","last_became_active":"2024-01-22T10:13:42.627514+0000","last_became_peered":"2024-01-22T10:13:42.627514+0000","last_unstale":"2024-01-22T10:14:07.046419+0000","last_undegraded":"2024-01-22T10:14:07.046419+0000","last_fullsized":"2024-01-22T10:14:07.046419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.046336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.046336+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.046336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:39.162164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:09.380008+0000","last_change":"2024-01-22T10:14:09.380030+0000","last_active":"2024-01-22T10:14:09.380008+0000","last_peered":"2024-01-22T10:14:09.380008+0000","last_clean":"2024-01-22T10:14:09.380008+0000","last_became_active":"2024-01-22T10:13:42.623152+0000","last_became_peered":"2024-01-22T10:13:42.623152+0000","last_unstale":"2024-01-22T10:14:09.380008+0000","last_undegraded":"2024-01-22T10:14:09.380008+0000","last_fullsized":"2024-01-22T10:14:09.380008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:09.379928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:09.379928+0000","last_clean_scrub_stamp":"2024-01-22T10:14:09.379928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:51:48.182750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.787201+0000","last_change":"2024-01-22T10:14:07.787243+0000","last_active":"2024-01-22T10:14:07.787201+0000","last_peered":"2024-01-22T10:14:07.787201+0000","last_clean":"2024-01-22T10:14:07.787201+0000","last_became_active":"2024-01-22T10:13:42.627157+0000","last_became_peered":"2024-01-22T10:13:42.627157+0000","last_unstale":"2024-01-22T10:14:07.787201+0000","last_undegraded":"2024-01-22T10:14:07.787201+0000","last_fullsized":"2024-01-22T10:14:07.787201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.787094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.787094+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.787094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:52:45.909013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:10.088172+0000","last_change":"2024-01-22T10:14:10.088228+0000","last_active":"2024-01-22T10:14:10.088172+0000","last_peered":"2024-01-22T10:14:10.088172+0000","last_clean":"2024-01-22T10:14:10.088172+0000","last_became_active":"2024-01-22T10:13:42.630134+0000","last_became_peered":"2024-01-22T10:13:42.630134+0000","last_unstale":"2024-01-22T10:14:10.088172+0000","last_undegraded":"2024-01-22T10:14:10.088172+0000","last_fullsized":"2024-01-22T10:14:10.088172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:10.088082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:10.088082+0000","last_clean_scrub_stamp":"2024-01-22T10:14:10.088082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:33:14.876901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.009444+0000","last_change":"2024-01-22T10:14:07.009469+0000","last_active":"2024-01-22T10:14:07.009444+0000","last_peered":"2024-01-22T10:14:07.009444+0000","last_clean":"2024-01-22T10:14:07.009444+0000","last_became_active":"2024-01-22T10:13:42.636239+0000","last_became_peered":"2024-01-22T10:13:42.636239+0000","last_unstale":"2024-01-22T10:14:07.009444+0000","last_undegraded":"2024-01-22T10:14:07.009444+0000","last_fullsized":"2024-01-22T10:14:07.009444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.009360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.009360+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.009360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:43:14.038547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:08.380417+0000","last_change":"2024-01-22T10:14:08.380441+0000","last_active":"2024-01-22T10:14:08.380417+0000","last_peered":"2024-01-22T10:14:08.380417+0000","last_clean":"2024-01-22T10:14:08.380417+0000","last_became_active":"2024-01-22T10:13:42.621590+0000","last_became_peered":"2024-01-22T10:13:42.621590+0000","last_unstale":"2024-01-22T10:14:08.380417+0000","last_undegraded":"2024-01-22T10:14:08.380417+0000","last_fullsized":"2024-01-22T10:14:08.380417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:08.380301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:08.380301+0000","last_clean_scrub_stamp":"2024-01-22T10:14:08.380301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:43:52.883769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:05.230274+0000","last_change":"2024-01-22T10:14:05.230308+0000","last_active":"2024-01-22T10:14:05.230274+0000","last_peered":"2024-01-22T10:14:05.230274+0000","last_clean":"2024-01-22T10:14:05.230274+0000","last_became_active":"2024-01-22T10:13:42.617384+0000","last_became_peered":"2024-01-22T10:13:42.617384+0000","last_unstale":"2024-01-22T10:14:05.230274+0000","last_undegraded":"2024-01-22T10:14:05.230274+0000","last_fullsized":"2024-01-22T10:14:05.230274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:05.230181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:05.230181+0000","last_clean_scrub_stamp":"2024-01-22T10:14:05.230181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:52:43.352100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.218514+0000","last_change":"2024-01-22T10:14:07.218535+0000","last_active":"2024-01-22T10:14:07.218514+0000","last_peered":"2024-01-22T10:14:07.218514+0000","last_clean":"2024-01-22T10:14:07.218514+0000","last_became_active":"2024-01-22T10:13:42.622220+0000","last_became_peered":"2024-01-22T10:13:42.622220+0000","last_unstale":"2024-01-22T10:14:07.218514+0000","last_undegraded":"2024-01-22T10:14:07.218514+0000","last_fullsized":"2024-01-22T10:14:07.218514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.218426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.218426+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.218426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:59:05.445970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:12.155852+0000","last_change":"2024-01-22T10:14:12.155877+0000","last_active":"2024-01-22T10:14:12.155852+0000","last_peered":"2024-01-22T10:14:12.155852+0000","last_clean":"2024-01-22T10:14:12.155852+0000","last_became_active":"2024-01-22T10:13:42.635312+0000","last_became_peered":"2024-01-22T10:13:42.635312+0000","last_unstale":"2024-01-22T10:14:12.155852+0000","last_undegraded":"2024-01-22T10:14:12.155852+0000","last_fullsized":"2024-01-22T10:14:12.155852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:12.155773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:12.155773+0000","last_clean_scrub_stamp":"2024-01-22T10:14:12.155773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:52:50.277692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:11.083668+0000","last_change":"2024-01-22T10:14:11.083693+0000","last_active":"2024-01-22T10:14:11.083668+0000","last_peered":"2024-01-22T10:14:11.083668+0000","last_clean":"2024-01-22T10:14:11.083668+0000","last_became_active":"2024-01-22T10:13:42.634191+0000","last_became_peered":"2024-01-22T10:13:42.634191+0000","last_unstale":"2024-01-22T10:14:11.083668+0000","last_undegraded":"2024-01-22T10:14:11.083668+0000","last_fullsized":"2024-01-22T10:14:11.083668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:11.083581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:11.083581+0000","last_clean_scrub_stamp":"2024-01-22T10:14:11.083581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:59:09.311125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.213652+0000","last_change":"2024-01-22T10:14:06.213684+0000","last_active":"2024-01-22T10:14:06.213652+0000","last_peered":"2024-01-22T10:14:06.213652+0000","last_clean":"2024-01-22T10:14:06.213652+0000","last_became_active":"2024-01-22T10:13:42.620763+0000","last_became_peered":"2024-01-22T10:13:42.620763+0000","last_unstale":"2024-01-22T10:14:06.213652+0000","last_undegraded":"2024-01-22T10:14:06.213652+0000","last_fullsized":"2024-01-22T10:14:06.213652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.213572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.213572+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.213572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:33:11.002391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:11.839758+0000","last_change":"2024-01-22T10:14:11.839781+0000","last_active":"2024-01-22T10:14:11.839758+0000","last_peered":"2024-01-22T10:14:11.839758+0000","last_clean":"2024-01-22T10:14:11.839758+0000","last_became_active":"2024-01-22T10:13:42.634366+0000","last_became_peered":"2024-01-22T10:13:42.634366+0000","last_unstale":"2024-01-22T10:14:11.839758+0000","last_undegraded":"2024-01-22T10:14:11.839758+0000","last_fullsized":"2024-01-22T10:14:11.839758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:11.839673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:11.839673+0000","last_clean_scrub_stamp":"2024-01-22T10:14:11.839673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:04:03.575879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.028304+0000","last_change":"2024-01-22T10:14:01.028337+0000","last_active":"2024-01-22T10:14:01.028304+0000","last_peered":"2024-01-22T10:14:01.028304+0000","last_clean":"2024-01-22T10:14:01.028304+0000","last_became_active":"2024-01-22T10:13:42.624548+0000","last_became_peered":"2024-01-22T10:13:42.624548+0000","last_unstale":"2024-01-22T10:14:01.028304+0000","last_undegraded":"2024-01-22T10:14:01.028304+0000","last_fullsized":"2024-01-22T10:14:01.028304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:01.028190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:01.028190+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.028190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:28.791835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:14.450550+0000","last_change":"2024-01-22T10:14:14.450588+0000","last_active":"2024-01-22T10:14:14.450550+0000","last_peered":"2024-01-22T10:14:14.450550+0000","last_clean":"2024-01-22T10:14:14.450550+0000","last_became_active":"2024-01-22T10:13:42.625647+0000","last_became_peered":"2024-01-22T10:13:42.625647+0000","last_unstale":"2024-01-22T10:14:14.450550+0000","last_undegraded":"2024-01-22T10:14:14.450550+0000","last_fullsized":"2024-01-22T10:14:14.450550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:14.450451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:14.450451+0000","last_clean_scrub_stamp":"2024-01-22T10:14:14.450451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:16:14.496207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.835655+0000","last_change":"2024-01-22T10:14:02.835679+0000","last_active":"2024-01-22T10:14:02.835655+0000","last_peered":"2024-01-22T10:14:02.835655+0000","last_clean":"2024-01-22T10:14:02.835655+0000","last_became_active":"2024-01-22T10:13:42.620805+0000","last_became_peered":"2024-01-22T10:13:42.620805+0000","last_unstale":"2024-01-22T10:14:02.835655+0000","last_undegraded":"2024-01-22T10:14:02.835655+0000","last_fullsized":"2024-01-22T10:14:02.835655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:02.835578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:02.835578+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.835578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:42:58.524074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:09.211575+0000","last_change":"2024-01-22T10:14:09.211597+0000","last_active":"2024-01-22T10:14:09.211575+0000","last_peered":"2024-01-22T10:14:09.211575+0000","last_clean":"2024-01-22T10:14:09.211575+0000","last_became_active":"2024-01-22T10:13:42.623306+0000","last_became_peered":"2024-01-22T10:13:42.623306+0000","last_unstale":"2024-01-22T10:14:09.211575+0000","last_undegraded":"2024-01-22T10:14:09.211575+0000","last_fullsized":"2024-01-22T10:14:09.211575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:09.211460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:09.211460+0000","last_clean_scrub_stamp":"2024-01-22T10:14:09.211460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:59:56.010158+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.153844+0000","last_change":"2024-01-22T10:14:02.153894+0000","last_active":"2024-01-22T10:14:02.153844+0000","last_peered":"2024-01-22T10:14:02.153844+0000","last_clean":"2024-01-22T10:14:02.153844+0000","last_became_active":"2024-01-22T10:13:42.617072+0000","last_became_peered":"2024-01-22T10:13:42.617072+0000","last_unstale":"2024-01-22T10:14:02.153844+0000","last_undegraded":"2024-01-22T10:14:02.153844+0000","last_fullsized":"2024-01-22T10:14:02.153844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:02.153746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:02.153746+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.153746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:00:50.672015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:13.429941+0000","last_change":"2024-01-22T10:14:13.429962+0000","last_active":"2024-01-22T10:14:13.429941+0000","last_peered":"2024-01-22T10:14:13.429941+0000","last_clean":"2024-01-22T10:14:13.429941+0000","last_became_active":"2024-01-22T10:13:42.624862+0000","last_became_peered":"2024-01-22T10:13:42.624862+0000","last_unstale":"2024-01-22T10:14:13.429941+0000","last_undegraded":"2024-01-22T10:14:13.429941+0000","last_fullsized":"2024-01-22T10:14:13.429941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:13.429864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:13.429864+0000","last_clean_scrub_stamp":"2024-01-22T10:14:13.429864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:05:47.576513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:15.467018+0000","last_change":"2024-01-22T10:14:15.467044+0000","last_active":"2024-01-22T10:14:15.467018+0000","last_peered":"2024-01-22T10:14:15.467018+0000","last_clean":"2024-01-22T10:14:15.467018+0000","last_became_active":"2024-01-22T10:13:42.625078+0000","last_became_peered":"2024-01-22T10:13:42.625078+0000","last_unstale":"2024-01-22T10:14:15.467018+0000","last_undegraded":"2024-01-22T10:14:15.467018+0000","last_fullsized":"2024-01-22T10:14:15.467018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:15.466929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:15.466929+0000","last_clean_scrub_stamp":"2024-01-22T10:14:15.466929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:53.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.967417+0000","last_change":"2024-01-22T10:14:04.967456+0000","last_active":"2024-01-22T10:14:04.967417+0000","last_peered":"2024-01-22T10:14:04.967417+0000","last_clean":"2024-01-22T10:14:04.967417+0000","last_became_active":"2024-01-22T10:13:42.626641+0000","last_became_peered":"2024-01-22T10:13:42.626641+0000","last_unstale":"2024-01-22T10:14:04.967417+0000","last_undegraded":"2024-01-22T10:14:04.967417+0000","last_fullsized":"2024-01-22T10:14:04.967417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.967320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.967320+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.967320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:01:05.635173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:10.134150+0000","last_change":"2024-01-22T10:14:10.134174+0000","last_active":"2024-01-22T10:14:10.134150+0000","last_peered":"2024-01-22T10:14:10.134150+0000","last_clean":"2024-01-22T10:14:10.134150+0000","last_became_active":"2024-01-22T10:13:42.626133+0000","last_became_peered":"2024-01-22T10:13:42.626133+0000","last_unstale":"2024-01-22T10:14:10.134150+0000","last_undegraded":"2024-01-22T10:14:10.134150+0000","last_fullsized":"2024-01-22T10:14:10.134150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:10.134075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:10.134075+0000","last_clean_scrub_stamp":"2024-01-22T10:14:10.134075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:47:38.123498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:15.062952+0000","last_change":"2024-01-22T10:14:15.062973+0000","last_active":"2024-01-22T10:14:15.062952+0000","last_peered":"2024-01-22T10:14:15.062952+0000","last_clean":"2024-01-22T10:14:15.062952+0000","last_became_active":"2024-01-22T10:13:42.637144+0000","last_became_peered":"2024-01-22T10:13:42.637144+0000","last_unstale":"2024-01-22T10:14:15.062952+0000","last_undegraded":"2024-01-22T10:14:15.062952+0000","last_fullsized":"2024-01-22T10:14:15.062952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:15.062858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:15.062858+0000","last_clean_scrub_stamp":"2024-01-22T10:14:15.062858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:02.897449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.455291+0000","last_change":"2024-01-22T10:14:04.455312+0000","last_active":"2024-01-22T10:14:04.455291+0000","last_peered":"2024-01-22T10:14:04.455291+0000","last_clean":"2024-01-22T10:14:04.455291+0000","last_became_active":"2024-01-22T10:13:42.623652+0000","last_became_peered":"2024-01-22T10:13:42.623652+0000","last_unstale":"2024-01-22T10:14:04.455291+0000","last_undegraded":"2024-01-22T10:14:04.455291+0000","last_fullsized":"2024-01-22T10:14:04.455291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.455200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.455200+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.455200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:44:22.893759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.820628+0000","last_change":"2024-01-22T10:14:06.820672+0000","last_active":"2024-01-22T10:14:06.820628+0000","last_peered":"2024-01-22T10:14:06.820628+0000","last_clean":"2024-01-22T10:14:06.820628+0000","last_became_active":"2024-01-22T10:13:42.626193+0000","last_became_peered":"2024-01-22T10:13:42.626193+0000","last_unstale":"2024-01-22T10:14:06.820628+0000","last_undegraded":"2024-01-22T10:14:06.820628+0000","last_fullsized":"2024-01-22T10:14:06.820628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.820536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.820536+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.820536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:52:54.480186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.110510+0000","last_change":"2024-01-22T10:14:04.110558+0000","last_active":"2024-01-22T10:14:04.110510+0000","last_peered":"2024-01-22T10:14:04.110510+0000","last_clean":"2024-01-22T10:14:04.110510+0000","last_became_active":"2024-01-22T10:13:42.619484+0000","last_became_peered":"2024-01-22T10:13:42.619484+0000","last_unstale":"2024-01-22T10:14:04.110510+0000","last_undegraded":"2024-01-22T10:14:04.110510+0000","last_fullsized":"2024-01-22T10:14:04.110510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.110419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.110419+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.110419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:06:07.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:59.397554+0000","last_change":"2024-01-22T10:13:59.397589+0000","last_active":"2024-01-22T10:13:59.397554+0000","last_peered":"2024-01-22T10:13:59.397554+0000","last_clean":"2024-01-22T10:13:59.397554+0000","last_became_active":"2024-01-22T10:13:42.620624+0000","last_became_peered":"2024-01-22T10:13:42.620624+0000","last_unstale":"2024-01-22T10:13:59.397554+0000","last_undegraded":"2024-01-22T10:13:59.397554+0000","last_fullsized":"2024-01-22T10:13:59.397554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:59.397466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:59.397466+0000","last_clean_scrub_stamp":"2024-01-22T10:13:59.397466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:09:54.887980+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:09.129113+0000","last_change":"2024-01-22T10:14:09.129140+0000","last_active":"2024-01-22T10:14:09.129113+0000","last_peered":"2024-01-22T10:14:09.129113+0000","last_clean":"2024-01-22T10:14:09.129113+0000","last_became_active":"2024-01-22T10:13:42.630812+0000","last_became_peered":"2024-01-22T10:13:42.630812+0000","last_unstale":"2024-01-22T10:14:09.129113+0000","last_undegraded":"2024-01-22T10:14:09.129113+0000","last_fullsized":"2024-01-22T10:14:09.129113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:09.129025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:09.129025+0000","last_clean_scrub_stamp":"2024-01-22T10:14:09.129025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:52:47.250944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:05.819927+0000","last_change":"2024-01-22T10:14:05.819947+0000","last_active":"2024-01-22T10:14:05.819927+0000","last_peered":"2024-01-22T10:14:05.819927+0000","last_clean":"2024-01-22T10:14:05.819927+0000","last_became_active":"2024-01-22T10:13:42.624529+0000","last_became_peered":"2024-01-22T10:13:42.624529+0000","last_unstale":"2024-01-22T10:14:05.819927+0000","last_undegraded":"2024-01-22T10:14:05.819927+0000","last_fullsized":"2024-01-22T10:14:05.819927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:05.819856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:05.819856+0000","last_clean_scrub_stamp":"2024-01-22T10:14:05.819856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:47:33.809279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:14.084863+0000","last_change":"2024-01-22T10:14:14.084887+0000","last_active":"2024-01-22T10:14:14.084863+0000","last_peered":"2024-01-22T10:14:14.084863+0000","last_clean":"2024-01-22T10:14:14.084863+0000","last_became_active":"2024-01-22T10:13:42.637077+0000","last_became_peered":"2024-01-22T10:13:42.637077+0000","last_unstale":"2024-01-22T10:14:14.084863+0000","last_undegraded":"2024-01-22T10:14:14.084863+0000","last_fullsized":"2024-01-22T10:14:14.084863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:14.084757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:14.084757+0000","last_clean_scrub_stamp":"2024-01-22T10:14:14.084757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:50:57.903522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.185703+0000","last_change":"2024-01-22T10:14:03.185725+0000","last_active":"2024-01-22T10:14:03.185703+0000","last_peered":"2024-01-22T10:14:03.185703+0000","last_clean":"2024-01-22T10:14:03.185703+0000","last_became_active":"2024-01-22T10:13:42.617110+0000","last_became_peered":"2024-01-22T10:13:42.617110+0000","last_unstale":"2024-01-22T10:14:03.185703+0000","last_undegraded":"2024-01-22T10:14:03.185703+0000","last_fullsized":"2024-01-22T10:14:03.185703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:03.185618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:03.185618+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.185618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:36:15.341379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.008374+0000","last_change":"2024-01-22T10:14:06.008396+0000","last_active":"2024-01-22T10:14:06.008374+0000","last_peered":"2024-01-22T10:14:06.008374+0000","last_clean":"2024-01-22T10:14:06.008374+0000","last_became_active":"2024-01-22T10:13:42.628259+0000","last_became_peered":"2024-01-22T10:13:42.628259+0000","last_unstale":"2024-01-22T10:14:06.008374+0000","last_undegraded":"2024-01-22T10:14:06.008374+0000","last_fullsized":"2024-01-22T10:14:06.008374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.008294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.008294+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.008294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:46:09.909909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:10.176365+0000","last_change":"2024-01-22T10:14:10.176390+0000","last_active":"2024-01-22T10:14:10.176365+0000","last_peered":"2024-01-22T10:14:10.176365+0000","last_clean":"2024-01-22T10:14:10.176365+0000","last_became_active":"2024-01-22T10:13:42.623675+0000","last_became_peered":"2024-01-22T10:13:42.623675+0000","last_unstale":"2024-01-22T10:14:10.176365+0000","last_undegraded":"2024-01-22T10:14:10.176365+0000","last_fullsized":"2024-01-22T10:14:10.176365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:10.176281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:10.176281+0000","last_clean_scrub_stamp":"2024-01-22T10:14:10.176281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:13:36.241170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:05.435060+0000","last_change":"2024-01-22T10:14:05.435097+0000","last_active":"2024-01-22T10:14:05.435060+0000","last_peered":"2024-01-22T10:14:05.435060+0000","last_clean":"2024-01-22T10:14:05.435060+0000","last_became_active":"2024-01-22T10:13:42.623680+0000","last_became_peered":"2024-01-22T10:13:42.623680+0000","last_unstale":"2024-01-22T10:14:05.435060+0000","last_undegraded":"2024-01-22T10:14:05.435060+0000","last_fullsized":"2024-01-22T10:14:05.435060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:05.434973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:05.434973+0000","last_clean_scrub_stamp":"2024-01-22T10:14:05.434973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:57:15.458759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.062203+0000","last_change":"2024-01-22T10:14:03.062231+0000","last_active":"2024-01-22T10:14:03.062203+0000","last_peered":"2024-01-22T10:14:03.062203+0000","last_clean":"2024-01-22T10:14:03.062203+0000","last_became_active":"2024-01-22T10:13:41.600823+0000","last_became_peered":"2024-01-22T10:13:41.600823+0000","last_unstale":"2024-01-22T10:14:03.062203+0000","last_undegraded":"2024-01-22T10:14:03.062203+0000","last_fullsized":"2024-01-22T10:14:03.062203+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-01-22T10:14:03.062121+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-01-22T10:14:03.062121+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.062121+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:01:03.729973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:08.022953+0000","last_change":"2024-01-22T10:14:08.022974+0000","last_active":"2024-01-22T10:14:08.022953+0000","last_peered":"2024-01-22T10:14:08.022953+0000","last_clean":"2024-01-22T10:14:08.022953+0000","last_became_active":"2024-01-22T10:13:42.626926+0000","last_became_peered":"2024-01-22T10:13:42.626926+0000","last_unstale":"2024-01-22T10:14:08.022953+0000","last_undegraded":"2024-01-22T10:14:08.022953+0000","last_fullsized":"2024-01-22T10:14:08.022953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:08.022872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:08.022872+0000","last_clean_scrub_stamp":"2024-01-22T10:14:08.022872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:44:26.461430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:58.463601+0000","last_change":"2024-01-22T10:13:58.463621+0000","last_active":"2024-01-22T10:13:58.463601+0000","last_peered":"2024-01-22T10:13:58.463601+0000","last_clean":"2024-01-22T10:13:58.463601+0000","last_became_active":"2024-01-22T10:13:41.597853+0000","last_became_peered":"2024-01-22T10:13:41.597853+0000","last_unstale":"2024-01-22T10:13:58.463601+0000","last_undegraded":"2024-01-22T10:13:58.463601+0000","last_fullsized":"2024-01-22T10:13:58.463601+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-01-22T10:13:58.463542+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-01-22T10:13:58.463542+0000","last_clean_scrub_stamp":"2024-01-22T10:13:58.463542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:34.595085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:13.115419+0000","last_change":"2024-01-22T10:14:13.115442+0000","last_active":"2024-01-22T10:14:13.115419+0000","last_peered":"2024-01-22T10:14:13.115419+0000","last_clean":"2024-01-22T10:14:13.115419+0000","last_became_active":"2024-01-22T10:13:42.637040+0000","last_became_peered":"2024-01-22T10:13:42.637040+0000","last_unstale":"2024-01-22T10:14:13.115419+0000","last_undegraded":"2024-01-22T10:14:13.115419+0000","last_fullsized":"2024-01-22T10:14:13.115419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:13.115332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:13.115332+0000","last_clean_scrub_stamp":"2024-01-22T10:14:13.115332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:33:17.904151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.431500+0000","last_change":"2024-01-22T10:14:01.431524+0000","last_active":"2024-01-22T10:14:01.431500+0000","last_peered":"2024-01-22T10:14:01.431500+0000","last_clean":"2024-01-22T10:14:01.431500+0000","last_became_active":"2024-01-22T10:13:41.594297+0000","last_became_peered":"2024-01-22T10:13:41.594297+0000","last_unstale":"2024-01-22T10:14:01.431500+0000","last_undegraded":"2024-01-22T10:14:01.431500+0000","last_fullsized":"2024-01-22T10:14:01.431500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-22T10:14:01.431414+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-22T10:14:01.431414+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.431414+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:47:29.420837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:08.124922+0000","last_change":"2024-01-22T10:14:08.124947+0000","last_active":"2024-01-22T10:14:08.124922+0000","last_peered":"2024-01-22T10:14:08.124922+0000","last_clean":"2024-01-22T10:14:08.124922+0000","last_became_active":"2024-01-22T10:13:42.630434+0000","last_became_peered":"2024-01-22T10:13:42.630434+0000","last_unstale":"2024-01-22T10:14:08.124922+0000","last_undegraded":"2024-01-22T10:14:08.124922+0000","last_fullsized":"2024-01-22T10:14:08.124922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:08.124838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:08.124838+0000","last_clean_scrub_stamp":"2024-01-22T10:14:08.124838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:35:07.377517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:59.072565+0000","last_change":"2024-01-22T10:13:59.072620+0000","last_active":"2024-01-22T10:13:59.072565+0000","last_peered":"2024-01-22T10:13:59.072565+0000","last_clean":"2024-01-22T10:13:59.072565+0000","last_became_active":"2024-01-22T10:13:41.595111+0000","last_became_peered":"2024-01-22T10:13:41.595111+0000","last_unstale":"2024-01-22T10:13:59.072565+0000","last_undegraded":"2024-01-22T10:13:59.072565+0000","last_fullsized":"2024-01-22T10:13:59.072565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-22T10:13:59.072494+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-22T10:13:59.072494+0000","last_clean_scrub_stamp":"2024-01-22T10:13:59.072494+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:22:52.348084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:08.250897+0000","last_change":"2024-01-22T10:14:08.250921+0000","last_active":"2024-01-22T10:14:08.250897+0000","last_peered":"2024-01-22T10:14:08.250897+0000","last_clean":"2024-01-22T10:14:08.250897+0000","last_became_active":"2024-01-22T10:13:42.623634+0000","last_became_peered":"2024-01-22T10:13:42.623634+0000","last_unstale":"2024-01-22T10:14:08.250897+0000","last_undegraded":"2024-01-22T10:14:08.250897+0000","last_fullsized":"2024-01-22T10:14:08.250897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:08.250813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:08.250813+0000","last_clean_scrub_stamp":"2024-01-22T10:14:08.250813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:56.085404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:05.106203+0000","last_change":"2024-01-22T10:14:05.106224+0000","last_active":"2024-01-22T10:14:05.106203+0000","last_peered":"2024-01-22T10:14:05.106203+0000","last_clean":"2024-01-22T10:14:05.106203+0000","last_became_active":"2024-01-22T10:13:41.597046+0000","last_became_peered":"2024-01-22T10:13:41.597046+0000","last_unstale":"2024-01-22T10:14:05.106203+0000","last_undegraded":"2024-01-22T10:14:05.106203+0000","last_fullsized":"2024-01-22T10:14:05.106203+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-01-22T10:14:05.106133+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-01-22T10:14:05.106133+0000","last_clean_scrub_stamp":"2024-01-22T10:14:05.106133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:14:09.478251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.828725+0000","last_change":"2024-01-22T10:14:03.828759+0000","last_active":"2024-01-22T10:14:03.828725+0000","last_peered":"2024-01-22T10:14:03.828725+0000","last_clean":"2024-01-22T10:14:03.828725+0000","last_became_active":"2024-01-22T10:13:42.623760+0000","last_became_peered":"2024-01-22T10:13:42.623760+0000","last_unstale":"2024-01-22T10:14:03.828725+0000","last_undegraded":"2024-01-22T10:14:03.828725+0000","last_fullsized":"2024-01-22T10:14:03.828725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:03.828614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:03.828614+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.828614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:25:27.280755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.022017+0000","last_change":"2024-01-22T10:14:02.022043+0000","last_active":"2024-01-22T10:14:02.022017+0000","last_peered":"2024-01-22T10:14:02.022017+0000","last_clean":"2024-01-22T10:14:02.022017+0000","last_became_active":"2024-01-22T10:13:41.596938+0000","last_became_peered":"2024-01-22T10:13:41.596938+0000","last_unstale":"2024-01-22T10:14:02.022017+0000","last_undegraded":"2024-01-22T10:14:02.022017+0000","last_fullsized":"2024-01-22T10:14:02.022017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-01-22T10:14:02.021936+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-01-22T10:14:02.021936+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.021936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:25.668906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:09.116819+0000","last_change":"2024-01-22T10:14:09.116859+0000","last_active":"2024-01-22T10:14:09.116819+0000","last_peered":"2024-01-22T10:14:09.116819+0000","last_clean":"2024-01-22T10:14:09.116819+0000","last_became_active":"2024-01-22T10:13:42.622398+0000","last_became_peered":"2024-01-22T10:13:42.622398+0000","last_unstale":"2024-01-22T10:14:09.116819+0000","last_undegraded":"2024-01-22T10:14:09.116819+0000","last_fullsized":"2024-01-22T10:14:09.116819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:09.116696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:09.116696+0000","last_clean_scrub_stamp":"2024-01-22T10:14:09.116696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:29:32.317104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:00.424314+0000","last_change":"2024-01-22T10:14:00.424333+0000","last_active":"2024-01-22T10:14:00.424314+0000","last_peered":"2024-01-22T10:14:00.424314+0000","last_clean":"2024-01-22T10:14:00.424314+0000","last_became_active":"2024-01-22T10:13:41.593248+0000","last_became_peered":"2024-01-22T10:13:41.593248+0000","last_unstale":"2024-01-22T10:14:00.424314+0000","last_undegraded":"2024-01-22T10:14:00.424314+0000","last_fullsized":"2024-01-22T10:14:00.424314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:00.424230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:00.424230+0000","last_clean_scrub_stamp":"2024-01-22T10:14:00.424230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:29:23.624638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.148694+0000","last_change":"2024-01-22T10:14:07.148727+0000","last_active":"2024-01-22T10:14:07.148694+0000","last_peered":"2024-01-22T10:14:07.148694+0000","last_clean":"2024-01-22T10:14:07.148694+0000","last_became_active":"2024-01-22T10:13:42.623690+0000","last_became_peered":"2024-01-22T10:13:42.623690+0000","last_unstale":"2024-01-22T10:14:07.148694+0000","last_undegraded":"2024-01-22T10:14:07.148694+0000","last_fullsized":"2024-01-22T10:14:07.148694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.148566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.148566+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.148566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:36:19.304327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.099207+0000","last_change":"2024-01-22T10:14:07.099230+0000","last_active":"2024-01-22T10:14:07.099207+0000","last_peered":"2024-01-22T10:14:07.099207+0000","last_clean":"2024-01-22T10:14:07.099207+0000","last_became_active":"2024-01-22T10:13:41.601016+0000","last_became_peered":"2024-01-22T10:13:41.601016+0000","last_unstale":"2024-01-22T10:14:07.099207+0000","last_undegraded":"2024-01-22T10:14:07.099207+0000","last_fullsized":"2024-01-22T10:14:07.099207+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.099109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.099109+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.099109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:43:02.787605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:10.822961+0000","last_change":"2024-01-22T10:14:10.822999+0000","last_active":"2024-01-22T10:14:10.822961+0000","last_peered":"2024-01-22T10:14:10.822961+0000","last_clean":"2024-01-22T10:14:10.822961+0000","last_became_active":"2024-01-22T10:13:42.633419+0000","last_became_peered":"2024-01-22T10:13:42.633419+0000","last_unstale":"2024-01-22T10:14:10.822961+0000","last_undegraded":"2024-01-22T10:14:10.822961+0000","last_fullsized":"2024-01-22T10:14:10.822961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:10.822855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:10.822855+0000","last_clean_scrub_stamp":"2024-01-22T10:14:10.822855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:58.657446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:05.393489+0000","last_change":"2024-01-22T10:14:05.393545+0000","last_active":"2024-01-22T10:14:05.393489+0000","last_peered":"2024-01-22T10:14:05.393489+0000","last_clean":"2024-01-22T10:14:05.393489+0000","last_became_active":"2024-01-22T10:13:41.599658+0000","last_became_peered":"2024-01-22T10:13:41.599658+0000","last_unstale":"2024-01-22T10:14:05.393489+0000","last_undegraded":"2024-01-22T10:14:05.393489+0000","last_fullsized":"2024-01-22T10:14:05.393489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:05.393399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:05.393399+0000","last_clean_scrub_stamp":"2024-01-22T10:14:05.393399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:50:49.212164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:12.389316+0000","last_change":"2024-01-22T10:14:12.389339+0000","last_active":"2024-01-22T10:14:12.389316+0000","last_peered":"2024-01-22T10:14:12.389316+0000","last_clean":"2024-01-22T10:14:12.389316+0000","last_became_active":"2024-01-22T10:13:42.624258+0000","last_became_peered":"2024-01-22T10:13:42.624258+0000","last_unstale":"2024-01-22T10:14:12.389316+0000","last_undegraded":"2024-01-22T10:14:12.389316+0000","last_fullsized":"2024-01-22T10:14:12.389316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:12.389234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:12.389234+0000","last_clean_scrub_stamp":"2024-01-22T10:14:12.389234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:27:55.709609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:00.464103+0000","last_change":"2024-01-22T10:14:00.464122+0000","last_active":"2024-01-22T10:14:00.464103+0000","last_peered":"2024-01-22T10:14:00.464103+0000","last_clean":"2024-01-22T10:14:00.464103+0000","last_became_active":"2024-01-22T10:13:41.602525+0000","last_became_peered":"2024-01-22T10:13:41.602525+0000","last_unstale":"2024-01-22T10:14:00.464103+0000","last_undegraded":"2024-01-22T10:14:00.464103+0000","last_fullsized":"2024-01-22T10:14:00.464103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:00.464041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:00.464041+0000","last_clean_scrub_stamp":"2024-01-22T10:14:00.464041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:46.407722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.398136+0000","last_change":"2024-01-22T10:14:07.398161+0000","last_active":"2024-01-22T10:14:07.398136+0000","last_peered":"2024-01-22T10:14:07.398136+0000","last_clean":"2024-01-22T10:14:07.398136+0000","last_became_active":"2024-01-22T10:13:42.615658+0000","last_became_peered":"2024-01-22T10:13:42.615658+0000","last_unstale":"2024-01-22T10:14:07.398136+0000","last_undegraded":"2024-01-22T10:14:07.398136+0000","last_fullsized":"2024-01-22T10:14:07.398136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.398040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.398040+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.398040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:03:59.134246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:00.853533+0000","last_change":"2024-01-22T10:14:00.853559+0000","last_active":"2024-01-22T10:14:00.853533+0000","last_peered":"2024-01-22T10:14:00.853533+0000","last_clean":"2024-01-22T10:14:00.853533+0000","last_became_active":"2024-01-22T10:13:41.598984+0000","last_became_peered":"2024-01-22T10:13:41.598984+0000","last_unstale":"2024-01-22T10:14:00.853533+0000","last_undegraded":"2024-01-22T10:14:00.853533+0000","last_fullsized":"2024-01-22T10:14:00.853533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-01-22T10:14:00.853447+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-01-22T10:14:00.853447+0000","last_clean_scrub_stamp":"2024-01-22T10:14:00.853447+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:14:05.225565+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:08.814083+0000","last_change":"2024-01-22T10:14:08.814126+0000","last_active":"2024-01-22T10:14:08.814083+0000","last_peered":"2024-01-22T10:14:08.814083+0000","last_clean":"2024-01-22T10:14:08.814083+0000","last_became_active":"2024-01-22T10:13:42.626619+0000","last_became_peered":"2024-01-22T10:13:42.626619+0000","last_unstale":"2024-01-22T10:14:08.814083+0000","last_undegraded":"2024-01-22T10:14:08.814083+0000","last_fullsized":"2024-01-22T10:14:08.814083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:08.814000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:08.814000+0000","last_clean_scrub_stamp":"2024-01-22T10:14:08.814000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:33:13.602819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'11","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.406448+0000","last_change":"2024-01-22T10:14:03.406482+0000","last_active":"2024-01-22T10:14:03.406448+0000","last_peered":"2024-01-22T10:14:03.406448+0000","last_clean":"2024-01-22T10:14:03.406448+0000","last_became_active":"2024-01-22T10:13:41.596658+0000","last_became_peered":"2024-01-22T10:13:41.596658+0000","last_unstale":"2024-01-22T10:14:03.406448+0000","last_undegraded":"2024-01-22T10:14:03.406448+0000","last_fullsized":"2024-01-22T10:14:03.406448+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'11","last_scrub_stamp":"2024-01-22T10:14:03.406365+0000","last_deep_scrub":"30'11","last_deep_scrub_stamp":"2024-01-22T10:14:03.406365+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.406365+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:52:41.528284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:05.135997+0000","last_change":"2024-01-22T10:14:05.136035+0000","last_active":"2024-01-22T10:14:05.135997+0000","last_peered":"2024-01-22T10:14:05.135997+0000","last_clean":"2024-01-22T10:14:05.135997+0000","last_became_active":"2024-01-22T10:13:42.627194+0000","last_became_peered":"2024-01-22T10:13:42.627194+0000","last_unstale":"2024-01-22T10:14:05.135997+0000","last_undegraded":"2024-01-22T10:14:05.135997+0000","last_fullsized":"2024-01-22T10:14:05.135997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:05.135921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:05.135921+0000","last_clean_scrub_stamp":"2024-01-22T10:14:05.135921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:10:00.626435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:08.136315+0000","last_change":"2024-01-22T10:14:08.136341+0000","last_active":"2024-01-22T10:14:08.136315+0000","last_peered":"2024-01-22T10:14:08.136315+0000","last_clean":"2024-01-22T10:14:08.136315+0000","last_became_active":"2024-01-22T10:13:41.602166+0000","last_became_peered":"2024-01-22T10:13:41.602166+0000","last_unstale":"2024-01-22T10:14:08.136315+0000","last_undegraded":"2024-01-22T10:14:08.136315+0000","last_fullsized":"2024-01-22T10:14:08.136315+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-22T10:14:08.136237+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-22T10:14:08.136237+0000","last_clean_scrub_stamp":"2024-01-22T10:14:08.136237+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:25:31.588378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:11.392344+0000","last_change":"2024-01-22T10:14:11.392365+0000","last_active":"2024-01-22T10:14:11.392344+0000","last_peered":"2024-01-22T10:14:11.392344+0000","last_clean":"2024-01-22T10:14:11.392344+0000","last_became_active":"2024-01-22T10:13:42.623996+0000","last_became_peered":"2024-01-22T10:13:42.623996+0000","last_unstale":"2024-01-22T10:14:11.392344+0000","last_undegraded":"2024-01-22T10:14:11.392344+0000","last_fullsized":"2024-01-22T10:14:11.392344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:11.392251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:11.392251+0000","last_clean_scrub_stamp":"2024-01-22T10:14:11.392251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:41:06.194378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.176322+0000","last_change":"2024-01-22T10:14:01.176357+0000","last_active":"2024-01-22T10:14:01.176322+0000","last_peered":"2024-01-22T10:14:01.176322+0000","last_clean":"2024-01-22T10:14:01.176322+0000","last_became_active":"2024-01-22T10:13:41.596376+0000","last_became_peered":"2024-01-22T10:13:41.596376+0000","last_unstale":"2024-01-22T10:14:01.176322+0000","last_undegraded":"2024-01-22T10:14:01.176322+0000","last_fullsized":"2024-01-22T10:14:01.176322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:01.176253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:01.176253+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.176253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:18:38.219103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:11.206022+0000","last_change":"2024-01-22T10:14:11.206051+0000","last_active":"2024-01-22T10:14:11.206022+0000","last_peered":"2024-01-22T10:14:11.206022+0000","last_clean":"2024-01-22T10:14:11.206022+0000","last_became_active":"2024-01-22T10:13:42.624005+0000","last_became_peered":"2024-01-22T10:13:42.624005+0000","last_unstale":"2024-01-22T10:14:11.206022+0000","last_undegraded":"2024-01-22T10:14:11.206022+0000","last_fullsized":"2024-01-22T10:14:11.206022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:11.205935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:11.205935+0000","last_clean_scrub_stamp":"2024-01-22T10:14:11.205935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:08:39.984992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.390349+0000","last_change":"2024-01-22T10:14:04.390381+0000","last_active":"2024-01-22T10:14:04.390349+0000","last_peered":"2024-01-22T10:14:04.390349+0000","last_clean":"2024-01-22T10:14:04.390349+0000","last_became_active":"2024-01-22T10:13:41.597155+0000","last_became_peered":"2024-01-22T10:13:41.597155+0000","last_unstale":"2024-01-22T10:14:04.390349+0000","last_undegraded":"2024-01-22T10:14:04.390349+0000","last_fullsized":"2024-01-22T10:14:04.390349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.390258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.390258+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.390258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:02:30.165843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.999001+0000","last_change":"2024-01-22T10:14:04.999035+0000","last_active":"2024-01-22T10:14:04.999001+0000","last_peered":"2024-01-22T10:14:04.999001+0000","last_clean":"2024-01-22T10:14:04.999001+0000","last_became_active":"2024-01-22T10:13:42.625291+0000","last_became_peered":"2024-01-22T10:13:42.625291+0000","last_unstale":"2024-01-22T10:14:04.999001+0000","last_undegraded":"2024-01-22T10:14:04.999001+0000","last_fullsized":"2024-01-22T10:14:04.999001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.998883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.998883+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.998883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:54.605950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.442598+0000","last_change":"2024-01-22T10:14:02.442647+0000","last_active":"2024-01-22T10:14:02.442598+0000","last_peered":"2024-01-22T10:14:02.442598+0000","last_clean":"2024-01-22T10:14:02.442598+0000","last_became_active":"2024-01-22T10:13:41.594410+0000","last_became_peered":"2024-01-22T10:13:41.594410+0000","last_unstale":"2024-01-22T10:14:02.442598+0000","last_undegraded":"2024-01-22T10:14:02.442598+0000","last_fullsized":"2024-01-22T10:14:02.442598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-01-22T10:14:02.442484+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-01-22T10:14:02.442484+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.442484+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:52:50.102134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:11.131373+0000","last_change":"2024-01-22T10:14:11.131409+0000","last_active":"2024-01-22T10:14:11.131373+0000","last_peered":"2024-01-22T10:14:11.131373+0000","last_clean":"2024-01-22T10:14:11.131373+0000","last_became_active":"2024-01-22T10:13:42.632877+0000","last_became_peered":"2024-01-22T10:13:42.632877+0000","last_unstale":"2024-01-22T10:14:11.131373+0000","last_undegraded":"2024-01-22T10:14:11.131373+0000","last_fullsized":"2024-01-22T10:14:11.131373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:11.131269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:11.131269+0000","last_clean_scrub_stamp":"2024-01-22T10:14:11.131269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:52:58.790919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:00.158180+0000","last_change":"2024-01-22T10:14:00.158219+0000","last_active":"2024-01-22T10:14:00.158180+0000","last_peered":"2024-01-22T10:14:00.158180+0000","last_clean":"2024-01-22T10:14:00.158180+0000","last_became_active":"2024-01-22T10:13:41.594555+0000","last_became_peered":"2024-01-22T10:13:41.594555+0000","last_unstale":"2024-01-22T10:14:00.158180+0000","last_undegraded":"2024-01-22T10:14:00.158180+0000","last_fullsized":"2024-01-22T10:14:00.158180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-01-22T10:14:00.158081+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-01-22T10:14:00.158081+0000","last_clean_scrub_stamp":"2024-01-22T10:14:00.158081+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:46:04.059696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:09.792151+0000","last_change":"2024-01-22T10:14:09.792172+0000","last_active":"2024-01-22T10:14:09.792151+0000","last_peered":"2024-01-22T10:14:09.792151+0000","last_clean":"2024-01-22T10:14:09.792151+0000","last_became_active":"2024-01-22T10:13:42.629837+0000","last_became_peered":"2024-01-22T10:13:42.629837+0000","last_unstale":"2024-01-22T10:14:09.792151+0000","last_undegraded":"2024-01-22T10:14:09.792151+0000","last_fullsized":"2024-01-22T10:14:09.792151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:09.792070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:09.792070+0000","last_clean_scrub_stamp":"2024-01-22T10:14:09.792070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:50:53.610836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:00.075372+0000","last_change":"2024-01-22T10:14:00.075405+0000","last_active":"2024-01-22T10:14:00.075372+0000","last_peered":"2024-01-22T10:14:00.075372+0000","last_clean":"2024-01-22T10:14:00.075372+0000","last_became_active":"2024-01-22T10:13:41.602710+0000","last_became_peered":"2024-01-22T10:13:41.602710+0000","last_unstale":"2024-01-22T10:14:00.075372+0000","last_undegraded":"2024-01-22T10:14:00.075372+0000","last_fullsized":"2024-01-22T10:14:00.075372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-22T10:14:00.075287+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-22T10:14:00.075287+0000","last_clean_scrub_stamp":"2024-01-22T10:14:00.075287+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:47.728973+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.127556+0000","last_change":"2024-01-22T10:14:06.127594+0000","last_active":"2024-01-22T10:14:06.127556+0000","last_peered":"2024-01-22T10:14:06.127556+0000","last_clean":"2024-01-22T10:14:06.127556+0000","last_became_active":"2024-01-22T10:13:42.629488+0000","last_became_peered":"2024-01-22T10:13:42.629488+0000","last_unstale":"2024-01-22T10:14:06.127556+0000","last_undegraded":"2024-01-22T10:14:06.127556+0000","last_fullsized":"2024-01-22T10:14:06.127556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.127470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.127470+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.127470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:00:54.645739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.075598+0000","last_change":"2024-01-22T10:14:06.075646+0000","last_active":"2024-01-22T10:14:06.075598+0000","last_peered":"2024-01-22T10:14:06.075598+0000","last_clean":"2024-01-22T10:14:06.075598+0000","last_became_active":"2024-01-22T10:13:41.599228+0000","last_became_peered":"2024-01-22T10:13:41.599228+0000","last_unstale":"2024-01-22T10:14:06.075598+0000","last_undegraded":"2024-01-22T10:14:06.075598+0000","last_fullsized":"2024-01-22T10:14:06.075598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-01-22T10:14:06.075513+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-01-22T10:14:06.075513+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.075513+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:35:17.883727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.987597+0000","last_change":"2024-01-22T10:14:02.987620+0000","last_active":"2024-01-22T10:14:02.987597+0000","last_peered":"2024-01-22T10:14:02.987597+0000","last_clean":"2024-01-22T10:14:02.987597+0000","last_became_active":"2024-01-22T10:13:42.625809+0000","last_became_peered":"2024-01-22T10:13:42.625809+0000","last_unstale":"2024-01-22T10:14:02.987597+0000","last_undegraded":"2024-01-22T10:14:02.987597+0000","last_fullsized":"2024-01-22T10:14:02.987597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:02.987516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:02.987516+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.987516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:19:39.039767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.066935+0000","last_change":"2024-01-22T10:14:03.066960+0000","last_active":"2024-01-22T10:14:03.066935+0000","last_peered":"2024-01-22T10:14:03.066935+0000","last_clean":"2024-01-22T10:14:03.066935+0000","last_became_active":"2024-01-22T10:13:41.597157+0000","last_became_peered":"2024-01-22T10:13:41.597157+0000","last_unstale":"2024-01-22T10:14:03.066935+0000","last_undegraded":"2024-01-22T10:14:03.066935+0000","last_fullsized":"2024-01-22T10:14:03.066935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:03.066858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:03.066858+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.066858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:46:06.968473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.002457+0000","last_change":"2024-01-22T10:14:06.002491+0000","last_active":"2024-01-22T10:14:06.002457+0000","last_peered":"2024-01-22T10:14:06.002457+0000","last_clean":"2024-01-22T10:14:06.002457+0000","last_became_active":"2024-01-22T10:13:42.630345+0000","last_became_peered":"2024-01-22T10:13:42.630345+0000","last_unstale":"2024-01-22T10:14:06.002457+0000","last_undegraded":"2024-01-22T10:14:06.002457+0000","last_fullsized":"2024-01-22T10:14:06.002457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.002346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.002346+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.002346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:51.946028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.475295+0000","last_change":"2024-01-22T10:14:02.475354+0000","last_active":"2024-01-22T10:14:02.475295+0000","last_peered":"2024-01-22T10:14:02.475295+0000","last_clean":"2024-01-22T10:14:02.475295+0000","last_became_active":"2024-01-22T10:13:41.603096+0000","last_became_peered":"2024-01-22T10:13:41.603096+0000","last_unstale":"2024-01-22T10:14:02.475295+0000","last_undegraded":"2024-01-22T10:14:02.475295+0000","last_fullsized":"2024-01-22T10:14:02.475295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-22T10:14:02.475188+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-22T10:14:02.475188+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.475188+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:46:06.376804+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.984585+0000","last_change":"2024-01-22T10:14:01.984604+0000","last_active":"2024-01-22T10:14:01.984585+0000","last_peered":"2024-01-22T10:14:01.984585+0000","last_clean":"2024-01-22T10:14:01.984585+0000","last_became_active":"2024-01-22T10:13:42.625524+0000","last_became_peered":"2024-01-22T10:13:42.625524+0000","last_unstale":"2024-01-22T10:14:01.984585+0000","last_undegraded":"2024-01-22T10:14:01.984585+0000","last_fullsized":"2024-01-22T10:14:01.984585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:01.984515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:01.984515+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.984515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:33:29.694410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.110046+0000","last_change":"2024-01-22T10:14:02.110067+0000","last_active":"2024-01-22T10:14:02.110046+0000","last_peered":"2024-01-22T10:14:02.110046+0000","last_clean":"2024-01-22T10:14:02.110046+0000","last_became_active":"2024-01-22T10:13:41.600704+0000","last_became_peered":"2024-01-22T10:13:41.600704+0000","last_unstale":"2024-01-22T10:14:02.110046+0000","last_undegraded":"2024-01-22T10:14:02.110046+0000","last_fullsized":"2024-01-22T10:14:02.110046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:02.109932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:02.109932+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.109932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:40.979172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:00.051717+0000","last_change":"2024-01-22T10:14:00.051736+0000","last_active":"2024-01-22T10:14:00.051717+0000","last_peered":"2024-01-22T10:14:00.051717+0000","last_clean":"2024-01-22T10:14:00.051717+0000","last_became_active":"2024-01-22T10:13:42.622631+0000","last_became_peered":"2024-01-22T10:13:42.622631+0000","last_unstale":"2024-01-22T10:14:00.051717+0000","last_undegraded":"2024-01-22T10:14:00.051717+0000","last_fullsized":"2024-01-22T10:14:00.051717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:00.051646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:00.051646+0000","last_clean_scrub_stamp":"2024-01-22T10:14:00.051646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:32:07.950699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.110751+0000","last_change":"2024-01-22T10:14:04.110769+0000","last_active":"2024-01-22T10:14:04.110751+0000","last_peered":"2024-01-22T10:14:04.110751+0000","last_clean":"2024-01-22T10:14:04.110751+0000","last_became_active":"2024-01-22T10:13:41.597324+0000","last_became_peered":"2024-01-22T10:13:41.597324+0000","last_unstale":"2024-01-22T10:14:04.110751+0000","last_undegraded":"2024-01-22T10:14:04.110751+0000","last_fullsized":"2024-01-22T10:14:04.110751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.110672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.110672+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.110672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:36.226500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.195532+0000","last_change":"2024-01-22T10:14:04.195552+0000","last_active":"2024-01-22T10:14:04.195532+0000","last_peered":"2024-01-22T10:14:04.195532+0000","last_clean":"2024-01-22T10:14:04.195532+0000","last_became_active":"2024-01-22T10:13:42.616992+0000","last_became_peered":"2024-01-22T10:13:42.616992+0000","last_unstale":"2024-01-22T10:14:04.195532+0000","last_undegraded":"2024-01-22T10:14:04.195532+0000","last_fullsized":"2024-01-22T10:14:04.195532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.195466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.195466+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.195466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:35:03.448145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.866708+0000","last_change":"2024-01-22T10:14:01.866749+0000","last_active":"2024-01-22T10:14:01.866708+0000","last_peered":"2024-01-22T10:14:01.866708+0000","last_clean":"2024-01-22T10:14:01.866708+0000","last_became_active":"2024-01-22T10:13:41.599008+0000","last_became_peered":"2024-01-22T10:13:41.599008+0000","last_unstale":"2024-01-22T10:14:01.866708+0000","last_undegraded":"2024-01-22T10:14:01.866708+0000","last_fullsized":"2024-01-22T10:14:01.866708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:01.866608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:01.866608+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.866608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:35:13.674823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.001093+0000","last_change":"2024-01-22T10:14:04.001117+0000","last_active":"2024-01-22T10:14:04.001093+0000","last_peered":"2024-01-22T10:14:04.001093+0000","last_clean":"2024-01-22T10:14:04.001093+0000","last_became_active":"2024-01-22T10:13:42.626088+0000","last_became_peered":"2024-01-22T10:13:42.626088+0000","last_unstale":"2024-01-22T10:14:04.001093+0000","last_undegraded":"2024-01-22T10:14:04.001093+0000","last_fullsized":"2024-01-22T10:14:04.001093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.001000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.001000+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.001000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:40.132544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.135147+0000","last_change":"2024-01-22T10:14:02.135175+0000","last_active":"2024-01-22T10:14:02.135147+0000","last_peered":"2024-01-22T10:14:02.135147+0000","last_clean":"2024-01-22T10:14:02.135147+0000","last_became_active":"2024-01-22T10:13:41.597126+0000","last_became_peered":"2024-01-22T10:13:41.597126+0000","last_unstale":"2024-01-22T10:14:02.135147+0000","last_undegraded":"2024-01-22T10:14:02.135147+0000","last_fullsized":"2024-01-22T10:14:02.135147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-22T10:14:02.135070+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-22T10:14:02.135070+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.135070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:14:06.507188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.837944+0000","last_change":"2024-01-22T10:14:04.837965+0000","last_active":"2024-01-22T10:14:04.837944+0000","last_peered":"2024-01-22T10:14:04.837944+0000","last_clean":"2024-01-22T10:14:04.837944+0000","last_became_active":"2024-01-22T10:13:42.624431+0000","last_became_peered":"2024-01-22T10:13:42.624431+0000","last_unstale":"2024-01-22T10:14:04.837944+0000","last_undegraded":"2024-01-22T10:14:04.837944+0000","last_fullsized":"2024-01-22T10:14:04.837944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.837878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.837878+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.837878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:29:28.038286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"30'3","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.443263+0000","last_change":"2024-01-22T10:14:01.443288+0000","last_active":"2024-01-22T10:14:01.443263+0000","last_peered":"2024-01-22T10:14:01.443263+0000","last_clean":"2024-01-22T10:14:01.443263+0000","last_became_active":"2024-01-22T10:13:41.602818+0000","last_became_peered":"2024-01-22T10:13:41.602818+0000","last_unstale":"2024-01-22T10:14:01.443263+0000","last_undegraded":"2024-01-22T10:14:01.443263+0000","last_fullsized":"2024-01-22T10:14:01.443263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-01-22T10:14:01.443201+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-01-22T10:14:01.443201+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.443201+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:51.050268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.454910+0000","last_change":"2024-01-22T10:14:06.454945+0000","last_active":"2024-01-22T10:14:06.454910+0000","last_peered":"2024-01-22T10:14:06.454910+0000","last_clean":"2024-01-22T10:14:06.454910+0000","last_became_active":"2024-01-22T10:13:42.625759+0000","last_became_peered":"2024-01-22T10:13:42.625759+0000","last_unstale":"2024-01-22T10:14:06.454910+0000","last_undegraded":"2024-01-22T10:14:06.454910+0000","last_fullsized":"2024-01-22T10:14:06.454910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.454826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.454826+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.454826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:06:09.754181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:59.114803+0000","last_change":"2024-01-22T10:13:59.114823+0000","last_active":"2024-01-22T10:13:59.114803+0000","last_peered":"2024-01-22T10:13:59.114803+0000","last_clean":"2024-01-22T10:13:59.114803+0000","last_became_active":"2024-01-22T10:13:41.593469+0000","last_became_peered":"2024-01-22T10:13:41.593469+0000","last_unstale":"2024-01-22T10:13:59.114803+0000","last_undegraded":"2024-01-22T10:13:59.114803+0000","last_fullsized":"2024-01-22T10:13:59.114803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:59.114741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:59.114741+0000","last_clean_scrub_stamp":"2024-01-22T10:13:59.114741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:22.761711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.024708+0000","last_change":"2024-01-22T10:14:04.024746+0000","last_active":"2024-01-22T10:14:04.024708+0000","last_peered":"2024-01-22T10:14:04.024708+0000","last_clean":"2024-01-22T10:14:04.024708+0000","last_became_active":"2024-01-22T10:13:42.622464+0000","last_became_peered":"2024-01-22T10:13:42.622464+0000","last_unstale":"2024-01-22T10:14:04.024708+0000","last_undegraded":"2024-01-22T10:14:04.024708+0000","last_fullsized":"2024-01-22T10:14:04.024708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.024631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.024631+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.024631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:49.968313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:59.416129+0000","last_change":"2024-01-22T10:13:59.416148+0000","last_active":"2024-01-22T10:13:59.416129+0000","last_peered":"2024-01-22T10:13:59.416129+0000","last_clean":"2024-01-22T10:13:59.416129+0000","last_became_active":"2024-01-22T10:13:41.601010+0000","last_became_peered":"2024-01-22T10:13:41.601010+0000","last_unstale":"2024-01-22T10:13:59.416129+0000","last_undegraded":"2024-01-22T10:13:59.416129+0000","last_fullsized":"2024-01-22T10:13:59.416129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:59.416062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:59.416062+0000","last_clean_scrub_stamp":"2024-01-22T10:13:59.416062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:24.040275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.483694+0000","last_change":"2024-01-22T10:14:03.483717+0000","last_active":"2024-01-22T10:14:03.483694+0000","last_peered":"2024-01-22T10:14:03.483694+0000","last_clean":"2024-01-22T10:14:03.483694+0000","last_became_active":"2024-01-22T10:13:42.622855+0000","last_became_peered":"2024-01-22T10:13:42.622855+0000","last_unstale":"2024-01-22T10:14:03.483694+0000","last_undegraded":"2024-01-22T10:14:03.483694+0000","last_fullsized":"2024-01-22T10:14:03.483694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:03.483617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:03.483617+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.483617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:35.599445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.116026+0000","last_change":"2024-01-22T10:14:03.116062+0000","last_active":"2024-01-22T10:14:03.116026+0000","last_peered":"2024-01-22T10:14:03.116026+0000","last_clean":"2024-01-22T10:14:03.116026+0000","last_became_active":"2024-01-22T10:13:41.597270+0000","last_became_peered":"2024-01-22T10:13:41.597270+0000","last_unstale":"2024-01-22T10:14:03.116026+0000","last_undegraded":"2024-01-22T10:14:03.116026+0000","last_fullsized":"2024-01-22T10:14:03.116026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:03.115950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:03.115950+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.115950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:33:21.462736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:10.398081+0000","last_change":"2024-01-22T10:14:10.398106+0000","last_active":"2024-01-22T10:14:10.398081+0000","last_peered":"2024-01-22T10:14:10.398081+0000","last_clean":"2024-01-22T10:14:10.398081+0000","last_became_active":"2024-01-22T10:13:42.623331+0000","last_became_peered":"2024-01-22T10:13:42.623331+0000","last_unstale":"2024-01-22T10:14:10.398081+0000","last_undegraded":"2024-01-22T10:14:10.398081+0000","last_fullsized":"2024-01-22T10:14:10.398081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:10.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:10.397991+0000","last_clean_scrub_stamp":"2024-01-22T10:14:10.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:43:52.500167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.070364+0000","last_change":"2024-01-22T10:14:01.070402+0000","last_active":"2024-01-22T10:14:01.070364+0000","last_peered":"2024-01-22T10:14:01.070364+0000","last_clean":"2024-01-22T10:14:01.070364+0000","last_became_active":"2024-01-22T10:13:41.596639+0000","last_became_peered":"2024-01-22T10:13:41.596639+0000","last_unstale":"2024-01-22T10:14:01.070364+0000","last_undegraded":"2024-01-22T10:14:01.070364+0000","last_fullsized":"2024-01-22T10:14:01.070364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:01.070278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:01.070278+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.070278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:43:08.099465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:45.772389+0000","last_change":"2024-01-22T10:13:42.637594+0000","last_active":"2024-01-22T10:13:45.772389+0000","last_peered":"2024-01-22T10:13:45.772389+0000","last_clean":"2024-01-22T10:13:45.772389+0000","last_became_active":"2024-01-22T10:13:42.637152+0000","last_became_peered":"2024-01-22T10:13:42.637152+0000","last_unstale":"2024-01-22T10:13:45.772389+0000","last_undegraded":"2024-01-22T10:13:45.772389+0000","last_fullsized":"2024-01-22T10:13:45.772389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:41.578102+0000","last_clean_scrub_stamp":"2024-01-22T10:13:41.578102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.378435+0000","last_change":"2024-01-22T10:14:06.378471+0000","last_active":"2024-01-22T10:14:06.378435+0000","last_peered":"2024-01-22T10:14:06.378435+0000","last_clean":"2024-01-22T10:14:06.378435+0000","last_became_active":"2024-01-22T10:13:41.600181+0000","last_became_peered":"2024-01-22T10:13:41.600181+0000","last_unstale":"2024-01-22T10:14:06.378435+0000","last_undegraded":"2024-01-22T10:14:06.378435+0000","last_fullsized":"2024-01-22T10:14:06.378435+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.378347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.378347+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.378347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:19:13.844082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:12.184756+0000","last_change":"2024-01-22T10:14:12.184794+0000","last_active":"2024-01-22T10:14:12.184756+0000","last_peered":"2024-01-22T10:14:12.184756+0000","last_clean":"2024-01-22T10:14:12.184756+0000","last_became_active":"2024-01-22T10:13:42.626445+0000","last_became_peered":"2024-01-22T10:13:42.626445+0000","last_unstale":"2024-01-22T10:14:12.184756+0000","last_undegraded":"2024-01-22T10:14:12.184756+0000","last_fullsized":"2024-01-22T10:14:12.184756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:12.184632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:12.184632+0000","last_clean_scrub_stamp":"2024-01-22T10:14:12.184632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:51:50.987453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.153667+0000","last_change":"2024-01-22T10:14:01.153692+0000","last_active":"2024-01-22T10:14:01.153667+0000","last_peered":"2024-01-22T10:14:01.153667+0000","last_clean":"2024-01-22T10:14:01.153667+0000","last_became_active":"2024-01-22T10:13:41.599985+0000","last_became_peered":"2024-01-22T10:13:41.599985+0000","last_unstale":"2024-01-22T10:14:01.153667+0000","last_undegraded":"2024-01-22T10:14:01.153667+0000","last_fullsized":"2024-01-22T10:14:01.153667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:01.153584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:01.153584+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.153584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:30:36.657474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.130645+0000","last_change":"2024-01-22T10:14:01.130679+0000","last_active":"2024-01-22T10:14:01.130645+0000","last_peered":"2024-01-22T10:14:01.130645+0000","last_clean":"2024-01-22T10:14:01.130645+0000","last_became_active":"2024-01-22T10:12:52.033101+0000","last_became_peered":"2024-01-22T10:12:52.033101+0000","last_unstale":"2024-01-22T10:14:01.130645+0000","last_undegraded":"2024-01-22T10:14:01.130645+0000","last_fullsized":"2024-01-22T10:14:01.130645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2024-01-22T10:14:01.130569+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2024-01-22T10:14:01.130569+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.130569+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:09:56.621083+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7941,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":933888,"data_stored":719503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59199999999999997}]},{"osd":1,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.56000000000000005}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52600000000000002}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.374},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.32000000000000001}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.42399999999999999}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.498}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":129661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.499},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.52700000000000002}]},{"osd":1,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.45200000000000001}]},{"osd":2,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.435}]},{"osd":3,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.54200000000000004}]},{"osd":4,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.33400000000000002}]},{"osd":5,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.39100000000000001}]},{"osd":7,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.48199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":129717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.67500000000000004}]},{"osd":1,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.61099999999999999}]},{"osd":2,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68700000000000006}]},{"osd":3,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.74099999999999999}]},{"osd":4,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.40000000000000002}]},{"osd":6,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.379},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.41799999999999998}]},{"osd":7,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.435},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.44400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":129149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.623},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52800000000000002}]},{"osd":1,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.58399999999999996}]},{"osd":2,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.54100000000000004}]},{"osd":3,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.63900000000000001}]},{"osd":5,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.41699999999999998}]},{"osd":6,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.436},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.45500000000000002}]},{"osd":7,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":136210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.52400000000000002}]},{"osd":1,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.45800000000000002}]},{"osd":2,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.435},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.70099999999999996}]},{"osd":6,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.62},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":129115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.27000000000000002}]},{"osd":1,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.33900000000000002}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.377},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.307}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.66300000000000003}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.68100000000000005}]},{"osd":7,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":136210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.51300000000000001}]},{"osd":2,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.44600000000000001}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.495},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.40600000000000003}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59499999999999997}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.56699999999999995}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.625}]},{"osd":7,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.68700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":929792,"data_stored":719413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.54900000000000004}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.64800000000000002}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.75700000000000001}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.66100000000000003}]},{"osd":7,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T10:14:21.529 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-01-22T10:13:41.578102+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=41, tm_wday=0, tm_yday=22, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=22, tm_hour=10, tm_min=13, tm_sec=56, tm_wday=0, tm_yday=22, tm_isdst=0) 2024-01-22T10:14:21.529 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-22T10:14:33.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:14:33.301 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:14:33.304 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:14:41.530 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-22T10:14:41.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.660+0000 7f0eed9d0640 1 Processor -- start 2024-01-22T10:14:41.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.660+0000 7f0eed9d0640 1 -- start start 2024-01-22T10:14:41.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.660+0000 7f0eed9d0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ee80b3630 0x7f0ee80bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.660+0000 7f0eed9d0640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee80b4e80 con 0x7f0ee80b49c0 2024-01-22T10:14:41.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.660+0000 7f0eed9d0640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee80b5fd0 con 0x7f0ee814c070 2024-01-22T10:14:41.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.660+0000 7f0eed9d0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80b5370 con 0x7f0ee80b3630 2024-01-22T10:14:41.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.661+0000 7f0ee67fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0ee80b49c0 0x7f0ee814b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57346/0 (socket says 172.21.15.88:57346) 2024-01-22T10:14:41.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.661+0000 7f0ee67fc640 1 -- 172.21.15.88:0/847424293 learned_addr learned my addr 172.21.15.88:0/847424293 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:14:41.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.661+0000 7f0ee6ffd640 1 --2- 172.21.15.88:0/847424293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ee80b3630 0x7f0ee80bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:41.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.661+0000 7f0ee5ffb640 1 -- 172.21.15.88:0/847424293 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553101104 0 0) 0x7f0ee80b4e80 con 0x7f0ee80b49c0 2024-01-22T10:14:41.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.661+0000 7f0ee5ffb640 1 -- 172.21.15.88:0/847424293 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ed0003520 con 0x7f0ee80b49c0 2024-01-22T10:14:41.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.661+0000 7f0ee5ffb640 1 -- 172.21.15.88:0/847424293 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493055026 0 0) 0x7f0ee80b5fd0 con 0x7f0ee814c070 2024-01-22T10:14:41.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.661+0000 7f0ee5ffb640 1 -- 172.21.15.88:0/847424293 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ee80b4e80 con 0x7f0ee814c070 2024-01-22T10:14:41.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.661+0000 7f0ee6ffd640 1 -- 172.21.15.88:0/847424293 >> v1:172.21.15.119:6789/0 conn(0x7f0ee814c070 legacy=0x7f0ee8152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:41.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.661+0000 7f0ee6ffd640 1 -- 172.21.15.88:0/847424293 >> v1:172.21.15.88:6789/0 conn(0x7f0ee80b49c0 legacy=0x7f0ee814b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:41.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.661+0000 7f0ee6ffd640 1 -- 172.21.15.88:0/847424293 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee80b6590 con 0x7f0ee80b3630 2024-01-22T10:14:41.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.662+0000 7f0ee6ffd640 1 --2- 172.21.15.88:0/847424293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ee80b3630 0x7f0ee80bd220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80097d0 tx=0x7f0ed802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=479f6261c36ba4bf server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:41.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.662+0000 7f0ee5ffb640 1 -- 172.21.15.88:0/847424293 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8031890 con 0x7f0ee80b3630 2024-01-22T10:14:41.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.662+0000 7f0ee5ffb640 1 -- 172.21.15.88:0/847424293 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed80319f0 con 0x7f0ee80b3630 2024-01-22T10:14:41.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.662+0000 7f0ee5ffb640 1 -- 172.21.15.88:0/847424293 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8031d80 con 0x7f0ee80b3630 2024-01-22T10:14:41.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.663+0000 7f0eed9d0640 1 -- 172.21.15.88:0/847424293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ee80b3630 msgr2=0x7f0ee80bd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:41.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.663+0000 7f0eed9d0640 1 --2- 172.21.15.88:0/847424293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ee80b3630 0x7f0ee80bd220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80097d0 tx=0x7f0ed802b930 comp rx=0 tx=0).stop 2024-01-22T10:14:41.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.663+0000 7f0eed9d0640 1 -- 172.21.15.88:0/847424293 shutdown_connections 2024-01-22T10:14:41.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.663+0000 7f0eed9d0640 1 --2- 172.21.15.88:0/847424293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ee80b3630 0x7f0ee80bd220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.663+0000 7f0eed9d0640 1 -- 172.21.15.88:0/847424293 >> 172.21.15.88:0/847424293 conn(0x7f0ee806acf0 msgr2=0x7f0ee80bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:41.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.663+0000 7f0eed9d0640 1 -- 172.21.15.88:0/847424293 shutdown_connections 2024-01-22T10:14:41.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.663+0000 7f0eed9d0640 1 -- 172.21.15.88:0/847424293 wait complete. 2024-01-22T10:14:41.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.664+0000 7f0eed9d0640 1 Processor -- start 2024-01-22T10:14:41.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.664+0000 7f0eed9d0640 1 -- start start 2024-01-22T10:14:41.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.664+0000 7f0eed9d0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ee80b3630 0x7f0ee813f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.664+0000 7f0eed9d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ee80b49c0 0x7f0ee813c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.664+0000 7f0eed9d0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ee81e0470 0x7f0ee81e08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.664+0000 7f0eed9d0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee813cf30 con 0x7f0ee81e0470 2024-01-22T10:14:41.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.664+0000 7f0eed9d0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee81e0e30 con 0x7f0ee80b49c0 2024-01-22T10:14:41.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.664+0000 7f0eed9d0640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee8140490 con 0x7f0ee80b3630 2024-01-22T10:14:41.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ee77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ee81e0470 0x7f0ee81e08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:41.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ee77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ee81e0470 0x7f0ee81e08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47864/0 (socket says 172.21.15.88:47864) 2024-01-22T10:14:41.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ee77fe640 1 -- 172.21.15.88:0/2464699932 learned_addr learned my addr 172.21.15.88:0/2464699932 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:14:41.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ee6ffd640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ee80b3630 0x7f0ee813f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:41.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ee67fc640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ee80b49c0 0x7f0ee813c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:41.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ee77fe640 1 -- 172.21.15.88:0/2464699932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ee80b3630 msgr2=0x7f0ee813f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:41.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ee77fe640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ee80b3630 0x7f0ee813f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ee77fe640 1 -- 172.21.15.88:0/2464699932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ee80b49c0 msgr2=0x7f0ee813c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:41.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ee77fe640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ee80b49c0 0x7f0ee813c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ee77fe640 1 -- 172.21.15.88:0/2464699932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8009400 con 0x7f0ee81e0470 2024-01-22T10:14:41.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ee77fe640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ee81e0470 0x7f0ee81e08f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000c7a0 tx=0x7f0ee000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:41.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ecffff640 1 -- 172.21.15.88:0/2464699932 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0003b70 con 0x7f0ee81e0470 2024-01-22T10:14:41.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ecffff640 1 -- 172.21.15.88:0/2464699932 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee0003cd0 con 0x7f0ee81e0470 2024-01-22T10:14:41.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0eed9d0640 1 -- 172.21.15.88:0/2464699932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee814ad40 con 0x7f0ee81e0470 2024-01-22T10:14:41.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0ecffff640 1 -- 172.21.15.88:0/2464699932 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000aa90 con 0x7f0ee81e0470 2024-01-22T10:14:41.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.665+0000 7f0eed9d0640 1 -- 172.21.15.88:0/2464699932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee80bbcb0 con 0x7f0ee81e0470 2024-01-22T10:14:41.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.666+0000 7f0eed9d0640 1 -- 172.21.15.88:0/2464699932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee813f630 con 0x7f0ee81e0470 2024-01-22T10:14:41.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.667+0000 7f0ecffff640 1 -- 172.21.15.88:0/2464699932 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f0ee000abf0 con 0x7f0ee81e0470 2024-01-22T10:14:41.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.667+0000 7f0ecffff640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0ed406b360 0x7f0ed406d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.667+0000 7f0ee6ffd640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0ed406b360 0x7f0ed406d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:41.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.667+0000 7f0ecffff640 1 -- 172.21.15.88:0/2464699932 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ee0089990 con 0x7f0ee81e0470 2024-01-22T10:14:41.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.668+0000 7f0ee6ffd640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0ed406b360 0x7f0ed406d820 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8036000 tx=0x7f0ed803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:41.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.672+0000 7f0ecffff640 1 -- 172.21.15.88:0/2464699932 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0ee813f630 con 0x7f0ee81e0470 2024-01-22T10:14:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.836+0000 7f0eed9d0640 1 -- 172.21.15.88:0/2464699932 --> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ee80b6b50 con 0x7f0ed406b360 2024-01-22T10:14:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.844+0000 7f0ecffff640 1 -- 172.21.15.88:0/2464699932 <== mgr.4101 v2:172.21.15.88:6832/3644863096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289813 (secure 0 0 0) 0x7f0ed803a420 con 0x7f0ed406b360 2024-01-22T10:14:41.829 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:14:41.831 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-01-22T10:14:41.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.847+0000 7f0eed9d0640 1 -- 172.21.15.88:0/2464699932 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0ed406b360 msgr2=0x7f0ed406d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:41.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.847+0000 7f0eed9d0640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0ed406b360 0x7f0ed406d820 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8036000 tx=0x7f0ed803c040 comp rx=0 tx=0).stop 2024-01-22T10:14:41.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.847+0000 7f0eed9d0640 1 -- 172.21.15.88:0/2464699932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ee81e0470 msgr2=0x7f0ee81e08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:41.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.847+0000 7f0eed9d0640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ee81e0470 0x7f0ee81e08f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000c7a0 tx=0x7f0ee000cc60 comp rx=0 tx=0).stop 2024-01-22T10:14:41.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.847+0000 7f0eed9d0640 1 -- 172.21.15.88:0/2464699932 shutdown_connections 2024-01-22T10:14:41.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.847+0000 7f0eed9d0640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f0ed406b360 0x7f0ed406d820 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.847+0000 7f0eed9d0640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ee81e0470 0x7f0ee81e08f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.847+0000 7f0eed9d0640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ee80b49c0 0x7f0ee813c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.847+0000 7f0eed9d0640 1 --2- 172.21.15.88:0/2464699932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ee80b3630 0x7f0ee813f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.847+0000 7f0eed9d0640 1 -- 172.21.15.88:0/2464699932 >> 172.21.15.88:0/2464699932 conn(0x7f0ee806acf0 msgr2=0x7f0ee80b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:41.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.847+0000 7f0eed9d0640 1 -- 172.21.15.88:0/2464699932 shutdown_connections 2024-01-22T10:14:41.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.847+0000 7f0eed9d0640 1 -- 172.21.15.88:0/2464699932 wait complete. 2024-01-22T10:14:41.840 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-01-22T10:14:40.727474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598309,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219984,"kb_used_data":3856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754736,"statfs":{"total":773094113280,"available":772868849664,"internally_reserved":0,"allocated":3948544,"data_stored":2228978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003109"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.046419+0000","last_change":"2024-01-22T10:14:07.046448+0000","last_active":"2024-01-22T10:14:07.046419+0000","last_peered":"2024-01-22T10:14:07.046419+0000","last_clean":"2024-01-22T10:14:07.046419+0000","last_became_active":"2024-01-22T10:13:42.627514+0000","last_became_peered":"2024-01-22T10:13:42.627514+0000","last_unstale":"2024-01-22T10:14:07.046419+0000","last_undegraded":"2024-01-22T10:14:07.046419+0000","last_fullsized":"2024-01-22T10:14:07.046419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.046336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.046336+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.046336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:39.162164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:09.380008+0000","last_change":"2024-01-22T10:14:09.380030+0000","last_active":"2024-01-22T10:14:09.380008+0000","last_peered":"2024-01-22T10:14:09.380008+0000","last_clean":"2024-01-22T10:14:09.380008+0000","last_became_active":"2024-01-22T10:13:42.623152+0000","last_became_peered":"2024-01-22T10:13:42.623152+0000","last_unstale":"2024-01-22T10:14:09.380008+0000","last_undegraded":"2024-01-22T10:14:09.380008+0000","last_fullsized":"2024-01-22T10:14:09.380008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:09.379928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:09.379928+0000","last_clean_scrub_stamp":"2024-01-22T10:14:09.379928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:51:48.182750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.787201+0000","last_change":"2024-01-22T10:14:07.787243+0000","last_active":"2024-01-22T10:14:07.787201+0000","last_peered":"2024-01-22T10:14:07.787201+0000","last_clean":"2024-01-22T10:14:07.787201+0000","last_became_active":"2024-01-22T10:13:42.627157+0000","last_became_peered":"2024-01-22T10:13:42.627157+0000","last_unstale":"2024-01-22T10:14:07.787201+0000","last_undegraded":"2024-01-22T10:14:07.787201+0000","last_fullsized":"2024-01-22T10:14:07.787201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.787094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.787094+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.787094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:52:45.909013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:10.088172+0000","last_change":"2024-01-22T10:14:10.088228+0000","last_active":"2024-01-22T10:14:10.088172+0000","last_peered":"2024-01-22T10:14:10.088172+0000","last_clean":"2024-01-22T10:14:10.088172+0000","last_became_active":"2024-01-22T10:13:42.630134+0000","last_became_peered":"2024-01-22T10:13:42.630134+0000","last_unstale":"2024-01-22T10:14:10.088172+0000","last_undegraded":"2024-01-22T10:14:10.088172+0000","last_fullsized":"2024-01-22T10:14:10.088172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:10.088082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:10.088082+0000","last_clean_scrub_stamp":"2024-01-22T10:14:10.088082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:33:14.876901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.009444+0000","last_change":"2024-01-22T10:14:07.009469+0000","last_active":"2024-01-22T10:14:07.009444+0000","last_peered":"2024-01-22T10:14:07.009444+0000","last_clean":"2024-01-22T10:14:07.009444+0000","last_became_active":"2024-01-22T10:13:42.636239+0000","last_became_peered":"2024-01-22T10:13:42.636239+0000","last_unstale":"2024-01-22T10:14:07.009444+0000","last_undegraded":"2024-01-22T10:14:07.009444+0000","last_fullsized":"2024-01-22T10:14:07.009444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.009360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.009360+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.009360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:43:14.038547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:08.380417+0000","last_change":"2024-01-22T10:14:08.380441+0000","last_active":"2024-01-22T10:14:08.380417+0000","last_peered":"2024-01-22T10:14:08.380417+0000","last_clean":"2024-01-22T10:14:08.380417+0000","last_became_active":"2024-01-22T10:13:42.621590+0000","last_became_peered":"2024-01-22T10:13:42.621590+0000","last_unstale":"2024-01-22T10:14:08.380417+0000","last_undegraded":"2024-01-22T10:14:08.380417+0000","last_fullsized":"2024-01-22T10:14:08.380417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:08.380301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:08.380301+0000","last_clean_scrub_stamp":"2024-01-22T10:14:08.380301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:43:52.883769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:05.230274+0000","last_change":"2024-01-22T10:14:05.230308+0000","last_active":"2024-01-22T10:14:05.230274+0000","last_peered":"2024-01-22T10:14:05.230274+0000","last_clean":"2024-01-22T10:14:05.230274+0000","last_became_active":"2024-01-22T10:13:42.617384+0000","last_became_peered":"2024-01-22T10:13:42.617384+0000","last_unstale":"2024-01-22T10:14:05.230274+0000","last_undegraded":"2024-01-22T10:14:05.230274+0000","last_fullsized":"2024-01-22T10:14:05.230274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:05.230181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:05.230181+0000","last_clean_scrub_stamp":"2024-01-22T10:14:05.230181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:52:43.352100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.218514+0000","last_change":"2024-01-22T10:14:07.218535+0000","last_active":"2024-01-22T10:14:07.218514+0000","last_peered":"2024-01-22T10:14:07.218514+0000","last_clean":"2024-01-22T10:14:07.218514+0000","last_became_active":"2024-01-22T10:13:42.622220+0000","last_became_peered":"2024-01-22T10:13:42.622220+0000","last_unstale":"2024-01-22T10:14:07.218514+0000","last_undegraded":"2024-01-22T10:14:07.218514+0000","last_fullsized":"2024-01-22T10:14:07.218514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.218426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.218426+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.218426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:59:05.445970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:12.155852+0000","last_change":"2024-01-22T10:14:12.155877+0000","last_active":"2024-01-22T10:14:12.155852+0000","last_peered":"2024-01-22T10:14:12.155852+0000","last_clean":"2024-01-22T10:14:12.155852+0000","last_became_active":"2024-01-22T10:13:42.635312+0000","last_became_peered":"2024-01-22T10:13:42.635312+0000","last_unstale":"2024-01-22T10:14:12.155852+0000","last_undegraded":"2024-01-22T10:14:12.155852+0000","last_fullsized":"2024-01-22T10:14:12.155852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:12.155773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:12.155773+0000","last_clean_scrub_stamp":"2024-01-22T10:14:12.155773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:52:50.277692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:11.083668+0000","last_change":"2024-01-22T10:14:11.083693+0000","last_active":"2024-01-22T10:14:11.083668+0000","last_peered":"2024-01-22T10:14:11.083668+0000","last_clean":"2024-01-22T10:14:11.083668+0000","last_became_active":"2024-01-22T10:13:42.634191+0000","last_became_peered":"2024-01-22T10:13:42.634191+0000","last_unstale":"2024-01-22T10:14:11.083668+0000","last_undegraded":"2024-01-22T10:14:11.083668+0000","last_fullsized":"2024-01-22T10:14:11.083668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:11.083581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:11.083581+0000","last_clean_scrub_stamp":"2024-01-22T10:14:11.083581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:59:09.311125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.213652+0000","last_change":"2024-01-22T10:14:06.213684+0000","last_active":"2024-01-22T10:14:06.213652+0000","last_peered":"2024-01-22T10:14:06.213652+0000","last_clean":"2024-01-22T10:14:06.213652+0000","last_became_active":"2024-01-22T10:13:42.620763+0000","last_became_peered":"2024-01-22T10:13:42.620763+0000","last_unstale":"2024-01-22T10:14:06.213652+0000","last_undegraded":"2024-01-22T10:14:06.213652+0000","last_fullsized":"2024-01-22T10:14:06.213652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.213572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.213572+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.213572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:33:11.002391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:11.839758+0000","last_change":"2024-01-22T10:14:11.839781+0000","last_active":"2024-01-22T10:14:11.839758+0000","last_peered":"2024-01-22T10:14:11.839758+0000","last_clean":"2024-01-22T10:14:11.839758+0000","last_became_active":"2024-01-22T10:13:42.634366+0000","last_became_peered":"2024-01-22T10:13:42.634366+0000","last_unstale":"2024-01-22T10:14:11.839758+0000","last_undegraded":"2024-01-22T10:14:11.839758+0000","last_fullsized":"2024-01-22T10:14:11.839758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:11.839673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:11.839673+0000","last_clean_scrub_stamp":"2024-01-22T10:14:11.839673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:04:03.575879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.028304+0000","last_change":"2024-01-22T10:14:01.028337+0000","last_active":"2024-01-22T10:14:01.028304+0000","last_peered":"2024-01-22T10:14:01.028304+0000","last_clean":"2024-01-22T10:14:01.028304+0000","last_became_active":"2024-01-22T10:13:42.624548+0000","last_became_peered":"2024-01-22T10:13:42.624548+0000","last_unstale":"2024-01-22T10:14:01.028304+0000","last_undegraded":"2024-01-22T10:14:01.028304+0000","last_fullsized":"2024-01-22T10:14:01.028304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:01.028190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:01.028190+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.028190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:56:28.791835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:14.450550+0000","last_change":"2024-01-22T10:14:14.450588+0000","last_active":"2024-01-22T10:14:14.450550+0000","last_peered":"2024-01-22T10:14:14.450550+0000","last_clean":"2024-01-22T10:14:14.450550+0000","last_became_active":"2024-01-22T10:13:42.625647+0000","last_became_peered":"2024-01-22T10:13:42.625647+0000","last_unstale":"2024-01-22T10:14:14.450550+0000","last_undegraded":"2024-01-22T10:14:14.450550+0000","last_fullsized":"2024-01-22T10:14:14.450550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:14.450451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:14.450451+0000","last_clean_scrub_stamp":"2024-01-22T10:14:14.450451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:16:14.496207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.835655+0000","last_change":"2024-01-22T10:14:02.835679+0000","last_active":"2024-01-22T10:14:02.835655+0000","last_peered":"2024-01-22T10:14:02.835655+0000","last_clean":"2024-01-22T10:14:02.835655+0000","last_became_active":"2024-01-22T10:13:42.620805+0000","last_became_peered":"2024-01-22T10:13:42.620805+0000","last_unstale":"2024-01-22T10:14:02.835655+0000","last_undegraded":"2024-01-22T10:14:02.835655+0000","last_fullsized":"2024-01-22T10:14:02.835655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:02.835578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:02.835578+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.835578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:42:58.524074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:09.211575+0000","last_change":"2024-01-22T10:14:09.211597+0000","last_active":"2024-01-22T10:14:09.211575+0000","last_peered":"2024-01-22T10:14:09.211575+0000","last_clean":"2024-01-22T10:14:09.211575+0000","last_became_active":"2024-01-22T10:13:42.623306+0000","last_became_peered":"2024-01-22T10:13:42.623306+0000","last_unstale":"2024-01-22T10:14:09.211575+0000","last_undegraded":"2024-01-22T10:14:09.211575+0000","last_fullsized":"2024-01-22T10:14:09.211575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:09.211460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:09.211460+0000","last_clean_scrub_stamp":"2024-01-22T10:14:09.211460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:59:56.010158+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.153844+0000","last_change":"2024-01-22T10:14:02.153894+0000","last_active":"2024-01-22T10:14:02.153844+0000","last_peered":"2024-01-22T10:14:02.153844+0000","last_clean":"2024-01-22T10:14:02.153844+0000","last_became_active":"2024-01-22T10:13:42.617072+0000","last_became_peered":"2024-01-22T10:13:42.617072+0000","last_unstale":"2024-01-22T10:14:02.153844+0000","last_undegraded":"2024-01-22T10:14:02.153844+0000","last_fullsized":"2024-01-22T10:14:02.153844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:02.153746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:02.153746+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.153746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:00:50.672015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:13.429941+0000","last_change":"2024-01-22T10:14:13.429962+0000","last_active":"2024-01-22T10:14:13.429941+0000","last_peered":"2024-01-22T10:14:13.429941+0000","last_clean":"2024-01-22T10:14:13.429941+0000","last_became_active":"2024-01-22T10:13:42.624862+0000","last_became_peered":"2024-01-22T10:13:42.624862+0000","last_unstale":"2024-01-22T10:14:13.429941+0000","last_undegraded":"2024-01-22T10:14:13.429941+0000","last_fullsized":"2024-01-22T10:14:13.429941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:13.429864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:13.429864+0000","last_clean_scrub_stamp":"2024-01-22T10:14:13.429864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:05:47.576513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:15.467018+0000","last_change":"2024-01-22T10:14:15.467044+0000","last_active":"2024-01-22T10:14:15.467018+0000","last_peered":"2024-01-22T10:14:15.467018+0000","last_clean":"2024-01-22T10:14:15.467018+0000","last_became_active":"2024-01-22T10:13:42.625078+0000","last_became_peered":"2024-01-22T10:13:42.625078+0000","last_unstale":"2024-01-22T10:14:15.467018+0000","last_undegraded":"2024-01-22T10:14:15.467018+0000","last_fullsized":"2024-01-22T10:14:15.467018+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:15.466929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:15.466929+0000","last_clean_scrub_stamp":"2024-01-22T10:14:15.466929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:53.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.967417+0000","last_change":"2024-01-22T10:14:04.967456+0000","last_active":"2024-01-22T10:14:04.967417+0000","last_peered":"2024-01-22T10:14:04.967417+0000","last_clean":"2024-01-22T10:14:04.967417+0000","last_became_active":"2024-01-22T10:13:42.626641+0000","last_became_peered":"2024-01-22T10:13:42.626641+0000","last_unstale":"2024-01-22T10:14:04.967417+0000","last_undegraded":"2024-01-22T10:14:04.967417+0000","last_fullsized":"2024-01-22T10:14:04.967417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.967320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.967320+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.967320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:01:05.635173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:10.134150+0000","last_change":"2024-01-22T10:14:10.134174+0000","last_active":"2024-01-22T10:14:10.134150+0000","last_peered":"2024-01-22T10:14:10.134150+0000","last_clean":"2024-01-22T10:14:10.134150+0000","last_became_active":"2024-01-22T10:13:42.626133+0000","last_became_peered":"2024-01-22T10:13:42.626133+0000","last_unstale":"2024-01-22T10:14:10.134150+0000","last_undegraded":"2024-01-22T10:14:10.134150+0000","last_fullsized":"2024-01-22T10:14:10.134150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:10.134075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:10.134075+0000","last_clean_scrub_stamp":"2024-01-22T10:14:10.134075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:47:38.123498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:15.062952+0000","last_change":"2024-01-22T10:14:15.062973+0000","last_active":"2024-01-22T10:14:15.062952+0000","last_peered":"2024-01-22T10:14:15.062952+0000","last_clean":"2024-01-22T10:14:15.062952+0000","last_became_active":"2024-01-22T10:13:42.637144+0000","last_became_peered":"2024-01-22T10:13:42.637144+0000","last_unstale":"2024-01-22T10:14:15.062952+0000","last_undegraded":"2024-01-22T10:14:15.062952+0000","last_fullsized":"2024-01-22T10:14:15.062952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:15.062858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:15.062858+0000","last_clean_scrub_stamp":"2024-01-22T10:14:15.062858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:02.897449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.455291+0000","last_change":"2024-01-22T10:14:04.455312+0000","last_active":"2024-01-22T10:14:04.455291+0000","last_peered":"2024-01-22T10:14:04.455291+0000","last_clean":"2024-01-22T10:14:04.455291+0000","last_became_active":"2024-01-22T10:13:42.623652+0000","last_became_peered":"2024-01-22T10:13:42.623652+0000","last_unstale":"2024-01-22T10:14:04.455291+0000","last_undegraded":"2024-01-22T10:14:04.455291+0000","last_fullsized":"2024-01-22T10:14:04.455291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.455200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.455200+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.455200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:44:22.893759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.820628+0000","last_change":"2024-01-22T10:14:06.820672+0000","last_active":"2024-01-22T10:14:06.820628+0000","last_peered":"2024-01-22T10:14:06.820628+0000","last_clean":"2024-01-22T10:14:06.820628+0000","last_became_active":"2024-01-22T10:13:42.626193+0000","last_became_peered":"2024-01-22T10:13:42.626193+0000","last_unstale":"2024-01-22T10:14:06.820628+0000","last_undegraded":"2024-01-22T10:14:06.820628+0000","last_fullsized":"2024-01-22T10:14:06.820628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.820536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.820536+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.820536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:52:54.480186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.110510+0000","last_change":"2024-01-22T10:14:04.110558+0000","last_active":"2024-01-22T10:14:04.110510+0000","last_peered":"2024-01-22T10:14:04.110510+0000","last_clean":"2024-01-22T10:14:04.110510+0000","last_became_active":"2024-01-22T10:13:42.619484+0000","last_became_peered":"2024-01-22T10:13:42.619484+0000","last_unstale":"2024-01-22T10:14:04.110510+0000","last_undegraded":"2024-01-22T10:14:04.110510+0000","last_fullsized":"2024-01-22T10:14:04.110510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.110419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.110419+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.110419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:06:07.409774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:59.397554+0000","last_change":"2024-01-22T10:13:59.397589+0000","last_active":"2024-01-22T10:13:59.397554+0000","last_peered":"2024-01-22T10:13:59.397554+0000","last_clean":"2024-01-22T10:13:59.397554+0000","last_became_active":"2024-01-22T10:13:42.620624+0000","last_became_peered":"2024-01-22T10:13:42.620624+0000","last_unstale":"2024-01-22T10:13:59.397554+0000","last_undegraded":"2024-01-22T10:13:59.397554+0000","last_fullsized":"2024-01-22T10:13:59.397554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:59.397466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:59.397466+0000","last_clean_scrub_stamp":"2024-01-22T10:13:59.397466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:09:54.887980+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:09.129113+0000","last_change":"2024-01-22T10:14:09.129140+0000","last_active":"2024-01-22T10:14:09.129113+0000","last_peered":"2024-01-22T10:14:09.129113+0000","last_clean":"2024-01-22T10:14:09.129113+0000","last_became_active":"2024-01-22T10:13:42.630812+0000","last_became_peered":"2024-01-22T10:13:42.630812+0000","last_unstale":"2024-01-22T10:14:09.129113+0000","last_undegraded":"2024-01-22T10:14:09.129113+0000","last_fullsized":"2024-01-22T10:14:09.129113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:09.129025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:09.129025+0000","last_clean_scrub_stamp":"2024-01-22T10:14:09.129025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:52:47.250944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:05.819927+0000","last_change":"2024-01-22T10:14:05.819947+0000","last_active":"2024-01-22T10:14:05.819927+0000","last_peered":"2024-01-22T10:14:05.819927+0000","last_clean":"2024-01-22T10:14:05.819927+0000","last_became_active":"2024-01-22T10:13:42.624529+0000","last_became_peered":"2024-01-22T10:13:42.624529+0000","last_unstale":"2024-01-22T10:14:05.819927+0000","last_undegraded":"2024-01-22T10:14:05.819927+0000","last_fullsized":"2024-01-22T10:14:05.819927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:05.819856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:05.819856+0000","last_clean_scrub_stamp":"2024-01-22T10:14:05.819856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:47:33.809279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:14.084863+0000","last_change":"2024-01-22T10:14:14.084887+0000","last_active":"2024-01-22T10:14:14.084863+0000","last_peered":"2024-01-22T10:14:14.084863+0000","last_clean":"2024-01-22T10:14:14.084863+0000","last_became_active":"2024-01-22T10:13:42.637077+0000","last_became_peered":"2024-01-22T10:13:42.637077+0000","last_unstale":"2024-01-22T10:14:14.084863+0000","last_undegraded":"2024-01-22T10:14:14.084863+0000","last_fullsized":"2024-01-22T10:14:14.084863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:14.084757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:14.084757+0000","last_clean_scrub_stamp":"2024-01-22T10:14:14.084757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:50:57.903522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.185703+0000","last_change":"2024-01-22T10:14:03.185725+0000","last_active":"2024-01-22T10:14:03.185703+0000","last_peered":"2024-01-22T10:14:03.185703+0000","last_clean":"2024-01-22T10:14:03.185703+0000","last_became_active":"2024-01-22T10:13:42.617110+0000","last_became_peered":"2024-01-22T10:13:42.617110+0000","last_unstale":"2024-01-22T10:14:03.185703+0000","last_undegraded":"2024-01-22T10:14:03.185703+0000","last_fullsized":"2024-01-22T10:14:03.185703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:03.185618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:03.185618+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.185618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:36:15.341379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.008374+0000","last_change":"2024-01-22T10:14:06.008396+0000","last_active":"2024-01-22T10:14:06.008374+0000","last_peered":"2024-01-22T10:14:06.008374+0000","last_clean":"2024-01-22T10:14:06.008374+0000","last_became_active":"2024-01-22T10:13:42.628259+0000","last_became_peered":"2024-01-22T10:13:42.628259+0000","last_unstale":"2024-01-22T10:14:06.008374+0000","last_undegraded":"2024-01-22T10:14:06.008374+0000","last_fullsized":"2024-01-22T10:14:06.008374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.008294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.008294+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.008294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:46:09.909909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:10.176365+0000","last_change":"2024-01-22T10:14:10.176390+0000","last_active":"2024-01-22T10:14:10.176365+0000","last_peered":"2024-01-22T10:14:10.176365+0000","last_clean":"2024-01-22T10:14:10.176365+0000","last_became_active":"2024-01-22T10:13:42.623675+0000","last_became_peered":"2024-01-22T10:13:42.623675+0000","last_unstale":"2024-01-22T10:14:10.176365+0000","last_undegraded":"2024-01-22T10:14:10.176365+0000","last_fullsized":"2024-01-22T10:14:10.176365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:10.176281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:10.176281+0000","last_clean_scrub_stamp":"2024-01-22T10:14:10.176281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:13:36.241170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:05.435060+0000","last_change":"2024-01-22T10:14:05.435097+0000","last_active":"2024-01-22T10:14:05.435060+0000","last_peered":"2024-01-22T10:14:05.435060+0000","last_clean":"2024-01-22T10:14:05.435060+0000","last_became_active":"2024-01-22T10:13:42.623680+0000","last_became_peered":"2024-01-22T10:13:42.623680+0000","last_unstale":"2024-01-22T10:14:05.435060+0000","last_undegraded":"2024-01-22T10:14:05.435060+0000","last_fullsized":"2024-01-22T10:14:05.435060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:05.434973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:05.434973+0000","last_clean_scrub_stamp":"2024-01-22T10:14:05.434973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:57:15.458759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.062203+0000","last_change":"2024-01-22T10:14:03.062231+0000","last_active":"2024-01-22T10:14:03.062203+0000","last_peered":"2024-01-22T10:14:03.062203+0000","last_clean":"2024-01-22T10:14:03.062203+0000","last_became_active":"2024-01-22T10:13:41.600823+0000","last_became_peered":"2024-01-22T10:13:41.600823+0000","last_unstale":"2024-01-22T10:14:03.062203+0000","last_undegraded":"2024-01-22T10:14:03.062203+0000","last_fullsized":"2024-01-22T10:14:03.062203+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-01-22T10:14:03.062121+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-01-22T10:14:03.062121+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.062121+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:01:03.729973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:08.022953+0000","last_change":"2024-01-22T10:14:08.022974+0000","last_active":"2024-01-22T10:14:08.022953+0000","last_peered":"2024-01-22T10:14:08.022953+0000","last_clean":"2024-01-22T10:14:08.022953+0000","last_became_active":"2024-01-22T10:13:42.626926+0000","last_became_peered":"2024-01-22T10:13:42.626926+0000","last_unstale":"2024-01-22T10:14:08.022953+0000","last_undegraded":"2024-01-22T10:14:08.022953+0000","last_fullsized":"2024-01-22T10:14:08.022953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:08.022872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:08.022872+0000","last_clean_scrub_stamp":"2024-01-22T10:14:08.022872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:44:26.461430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:58.463601+0000","last_change":"2024-01-22T10:13:58.463621+0000","last_active":"2024-01-22T10:13:58.463601+0000","last_peered":"2024-01-22T10:13:58.463601+0000","last_clean":"2024-01-22T10:13:58.463601+0000","last_became_active":"2024-01-22T10:13:41.597853+0000","last_became_peered":"2024-01-22T10:13:41.597853+0000","last_unstale":"2024-01-22T10:13:58.463601+0000","last_undegraded":"2024-01-22T10:13:58.463601+0000","last_fullsized":"2024-01-22T10:13:58.463601+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-01-22T10:13:58.463542+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-01-22T10:13:58.463542+0000","last_clean_scrub_stamp":"2024-01-22T10:13:58.463542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:34.595085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:13.115419+0000","last_change":"2024-01-22T10:14:13.115442+0000","last_active":"2024-01-22T10:14:13.115419+0000","last_peered":"2024-01-22T10:14:13.115419+0000","last_clean":"2024-01-22T10:14:13.115419+0000","last_became_active":"2024-01-22T10:13:42.637040+0000","last_became_peered":"2024-01-22T10:13:42.637040+0000","last_unstale":"2024-01-22T10:14:13.115419+0000","last_undegraded":"2024-01-22T10:14:13.115419+0000","last_fullsized":"2024-01-22T10:14:13.115419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:13.115332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:13.115332+0000","last_clean_scrub_stamp":"2024-01-22T10:14:13.115332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:33:17.904151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.431500+0000","last_change":"2024-01-22T10:14:01.431524+0000","last_active":"2024-01-22T10:14:01.431500+0000","last_peered":"2024-01-22T10:14:01.431500+0000","last_clean":"2024-01-22T10:14:01.431500+0000","last_became_active":"2024-01-22T10:13:41.594297+0000","last_became_peered":"2024-01-22T10:13:41.594297+0000","last_unstale":"2024-01-22T10:14:01.431500+0000","last_undegraded":"2024-01-22T10:14:01.431500+0000","last_fullsized":"2024-01-22T10:14:01.431500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-22T10:14:01.431414+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-22T10:14:01.431414+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.431414+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:47:29.420837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:08.124922+0000","last_change":"2024-01-22T10:14:08.124947+0000","last_active":"2024-01-22T10:14:08.124922+0000","last_peered":"2024-01-22T10:14:08.124922+0000","last_clean":"2024-01-22T10:14:08.124922+0000","last_became_active":"2024-01-22T10:13:42.630434+0000","last_became_peered":"2024-01-22T10:13:42.630434+0000","last_unstale":"2024-01-22T10:14:08.124922+0000","last_undegraded":"2024-01-22T10:14:08.124922+0000","last_fullsized":"2024-01-22T10:14:08.124922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:08.124838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:08.124838+0000","last_clean_scrub_stamp":"2024-01-22T10:14:08.124838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:35:07.377517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:59.072565+0000","last_change":"2024-01-22T10:13:59.072620+0000","last_active":"2024-01-22T10:13:59.072565+0000","last_peered":"2024-01-22T10:13:59.072565+0000","last_clean":"2024-01-22T10:13:59.072565+0000","last_became_active":"2024-01-22T10:13:41.595111+0000","last_became_peered":"2024-01-22T10:13:41.595111+0000","last_unstale":"2024-01-22T10:13:59.072565+0000","last_undegraded":"2024-01-22T10:13:59.072565+0000","last_fullsized":"2024-01-22T10:13:59.072565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-22T10:13:59.072494+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-22T10:13:59.072494+0000","last_clean_scrub_stamp":"2024-01-22T10:13:59.072494+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:22:52.348084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:08.250897+0000","last_change":"2024-01-22T10:14:08.250921+0000","last_active":"2024-01-22T10:14:08.250897+0000","last_peered":"2024-01-22T10:14:08.250897+0000","last_clean":"2024-01-22T10:14:08.250897+0000","last_became_active":"2024-01-22T10:13:42.623634+0000","last_became_peered":"2024-01-22T10:13:42.623634+0000","last_unstale":"2024-01-22T10:14:08.250897+0000","last_undegraded":"2024-01-22T10:14:08.250897+0000","last_fullsized":"2024-01-22T10:14:08.250897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:08.250813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:08.250813+0000","last_clean_scrub_stamp":"2024-01-22T10:14:08.250813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:56.085404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:05.106203+0000","last_change":"2024-01-22T10:14:05.106224+0000","last_active":"2024-01-22T10:14:05.106203+0000","last_peered":"2024-01-22T10:14:05.106203+0000","last_clean":"2024-01-22T10:14:05.106203+0000","last_became_active":"2024-01-22T10:13:41.597046+0000","last_became_peered":"2024-01-22T10:13:41.597046+0000","last_unstale":"2024-01-22T10:14:05.106203+0000","last_undegraded":"2024-01-22T10:14:05.106203+0000","last_fullsized":"2024-01-22T10:14:05.106203+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-01-22T10:14:05.106133+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-01-22T10:14:05.106133+0000","last_clean_scrub_stamp":"2024-01-22T10:14:05.106133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:14:09.478251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.828725+0000","last_change":"2024-01-22T10:14:03.828759+0000","last_active":"2024-01-22T10:14:03.828725+0000","last_peered":"2024-01-22T10:14:03.828725+0000","last_clean":"2024-01-22T10:14:03.828725+0000","last_became_active":"2024-01-22T10:13:42.623760+0000","last_became_peered":"2024-01-22T10:13:42.623760+0000","last_unstale":"2024-01-22T10:14:03.828725+0000","last_undegraded":"2024-01-22T10:14:03.828725+0000","last_fullsized":"2024-01-22T10:14:03.828725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:03.828614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:03.828614+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.828614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:25:27.280755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.022017+0000","last_change":"2024-01-22T10:14:02.022043+0000","last_active":"2024-01-22T10:14:02.022017+0000","last_peered":"2024-01-22T10:14:02.022017+0000","last_clean":"2024-01-22T10:14:02.022017+0000","last_became_active":"2024-01-22T10:13:41.596938+0000","last_became_peered":"2024-01-22T10:13:41.596938+0000","last_unstale":"2024-01-22T10:14:02.022017+0000","last_undegraded":"2024-01-22T10:14:02.022017+0000","last_fullsized":"2024-01-22T10:14:02.022017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-01-22T10:14:02.021936+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-01-22T10:14:02.021936+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.021936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:25.668906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:09.116819+0000","last_change":"2024-01-22T10:14:09.116859+0000","last_active":"2024-01-22T10:14:09.116819+0000","last_peered":"2024-01-22T10:14:09.116819+0000","last_clean":"2024-01-22T10:14:09.116819+0000","last_became_active":"2024-01-22T10:13:42.622398+0000","last_became_peered":"2024-01-22T10:13:42.622398+0000","last_unstale":"2024-01-22T10:14:09.116819+0000","last_undegraded":"2024-01-22T10:14:09.116819+0000","last_fullsized":"2024-01-22T10:14:09.116819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:09.116696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:09.116696+0000","last_clean_scrub_stamp":"2024-01-22T10:14:09.116696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:29:32.317104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:00.424314+0000","last_change":"2024-01-22T10:14:00.424333+0000","last_active":"2024-01-22T10:14:00.424314+0000","last_peered":"2024-01-22T10:14:00.424314+0000","last_clean":"2024-01-22T10:14:00.424314+0000","last_became_active":"2024-01-22T10:13:41.593248+0000","last_became_peered":"2024-01-22T10:13:41.593248+0000","last_unstale":"2024-01-22T10:14:00.424314+0000","last_undegraded":"2024-01-22T10:14:00.424314+0000","last_fullsized":"2024-01-22T10:14:00.424314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:00.424230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:00.424230+0000","last_clean_scrub_stamp":"2024-01-22T10:14:00.424230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:29:23.624638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.148694+0000","last_change":"2024-01-22T10:14:07.148727+0000","last_active":"2024-01-22T10:14:07.148694+0000","last_peered":"2024-01-22T10:14:07.148694+0000","last_clean":"2024-01-22T10:14:07.148694+0000","last_became_active":"2024-01-22T10:13:42.623690+0000","last_became_peered":"2024-01-22T10:13:42.623690+0000","last_unstale":"2024-01-22T10:14:07.148694+0000","last_undegraded":"2024-01-22T10:14:07.148694+0000","last_fullsized":"2024-01-22T10:14:07.148694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.148566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.148566+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.148566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:36:19.304327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.099207+0000","last_change":"2024-01-22T10:14:07.099230+0000","last_active":"2024-01-22T10:14:07.099207+0000","last_peered":"2024-01-22T10:14:07.099207+0000","last_clean":"2024-01-22T10:14:07.099207+0000","last_became_active":"2024-01-22T10:13:41.601016+0000","last_became_peered":"2024-01-22T10:13:41.601016+0000","last_unstale":"2024-01-22T10:14:07.099207+0000","last_undegraded":"2024-01-22T10:14:07.099207+0000","last_fullsized":"2024-01-22T10:14:07.099207+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.099109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.099109+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.099109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:43:02.787605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:10.822961+0000","last_change":"2024-01-22T10:14:10.822999+0000","last_active":"2024-01-22T10:14:10.822961+0000","last_peered":"2024-01-22T10:14:10.822961+0000","last_clean":"2024-01-22T10:14:10.822961+0000","last_became_active":"2024-01-22T10:13:42.633419+0000","last_became_peered":"2024-01-22T10:13:42.633419+0000","last_unstale":"2024-01-22T10:14:10.822961+0000","last_undegraded":"2024-01-22T10:14:10.822961+0000","last_fullsized":"2024-01-22T10:14:10.822961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:10.822855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:10.822855+0000","last_clean_scrub_stamp":"2024-01-22T10:14:10.822855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:58.657446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:05.393489+0000","last_change":"2024-01-22T10:14:05.393545+0000","last_active":"2024-01-22T10:14:05.393489+0000","last_peered":"2024-01-22T10:14:05.393489+0000","last_clean":"2024-01-22T10:14:05.393489+0000","last_became_active":"2024-01-22T10:13:41.599658+0000","last_became_peered":"2024-01-22T10:13:41.599658+0000","last_unstale":"2024-01-22T10:14:05.393489+0000","last_undegraded":"2024-01-22T10:14:05.393489+0000","last_fullsized":"2024-01-22T10:14:05.393489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:05.393399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:05.393399+0000","last_clean_scrub_stamp":"2024-01-22T10:14:05.393399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:50:49.212164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:12.389316+0000","last_change":"2024-01-22T10:14:12.389339+0000","last_active":"2024-01-22T10:14:12.389316+0000","last_peered":"2024-01-22T10:14:12.389316+0000","last_clean":"2024-01-22T10:14:12.389316+0000","last_became_active":"2024-01-22T10:13:42.624258+0000","last_became_peered":"2024-01-22T10:13:42.624258+0000","last_unstale":"2024-01-22T10:14:12.389316+0000","last_undegraded":"2024-01-22T10:14:12.389316+0000","last_fullsized":"2024-01-22T10:14:12.389316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:12.389234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:12.389234+0000","last_clean_scrub_stamp":"2024-01-22T10:14:12.389234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:27:55.709609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:00.464103+0000","last_change":"2024-01-22T10:14:00.464122+0000","last_active":"2024-01-22T10:14:00.464103+0000","last_peered":"2024-01-22T10:14:00.464103+0000","last_clean":"2024-01-22T10:14:00.464103+0000","last_became_active":"2024-01-22T10:13:41.602525+0000","last_became_peered":"2024-01-22T10:13:41.602525+0000","last_unstale":"2024-01-22T10:14:00.464103+0000","last_undegraded":"2024-01-22T10:14:00.464103+0000","last_fullsized":"2024-01-22T10:14:00.464103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:00.464041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:00.464041+0000","last_clean_scrub_stamp":"2024-01-22T10:14:00.464041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:46.407722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:07.398136+0000","last_change":"2024-01-22T10:14:07.398161+0000","last_active":"2024-01-22T10:14:07.398136+0000","last_peered":"2024-01-22T10:14:07.398136+0000","last_clean":"2024-01-22T10:14:07.398136+0000","last_became_active":"2024-01-22T10:13:42.615658+0000","last_became_peered":"2024-01-22T10:13:42.615658+0000","last_unstale":"2024-01-22T10:14:07.398136+0000","last_undegraded":"2024-01-22T10:14:07.398136+0000","last_fullsized":"2024-01-22T10:14:07.398136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:07.398040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:07.398040+0000","last_clean_scrub_stamp":"2024-01-22T10:14:07.398040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:03:59.134246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:00.853533+0000","last_change":"2024-01-22T10:14:00.853559+0000","last_active":"2024-01-22T10:14:00.853533+0000","last_peered":"2024-01-22T10:14:00.853533+0000","last_clean":"2024-01-22T10:14:00.853533+0000","last_became_active":"2024-01-22T10:13:41.598984+0000","last_became_peered":"2024-01-22T10:13:41.598984+0000","last_unstale":"2024-01-22T10:14:00.853533+0000","last_undegraded":"2024-01-22T10:14:00.853533+0000","last_fullsized":"2024-01-22T10:14:00.853533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-01-22T10:14:00.853447+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-01-22T10:14:00.853447+0000","last_clean_scrub_stamp":"2024-01-22T10:14:00.853447+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:14:05.225565+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:08.814083+0000","last_change":"2024-01-22T10:14:08.814126+0000","last_active":"2024-01-22T10:14:08.814083+0000","last_peered":"2024-01-22T10:14:08.814083+0000","last_clean":"2024-01-22T10:14:08.814083+0000","last_became_active":"2024-01-22T10:13:42.626619+0000","last_became_peered":"2024-01-22T10:13:42.626619+0000","last_unstale":"2024-01-22T10:14:08.814083+0000","last_undegraded":"2024-01-22T10:14:08.814083+0000","last_fullsized":"2024-01-22T10:14:08.814083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:08.814000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:08.814000+0000","last_clean_scrub_stamp":"2024-01-22T10:14:08.814000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:33:13.602819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'11","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.406448+0000","last_change":"2024-01-22T10:14:03.406482+0000","last_active":"2024-01-22T10:14:03.406448+0000","last_peered":"2024-01-22T10:14:03.406448+0000","last_clean":"2024-01-22T10:14:03.406448+0000","last_became_active":"2024-01-22T10:13:41.596658+0000","last_became_peered":"2024-01-22T10:13:41.596658+0000","last_unstale":"2024-01-22T10:14:03.406448+0000","last_undegraded":"2024-01-22T10:14:03.406448+0000","last_fullsized":"2024-01-22T10:14:03.406448+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'11","last_scrub_stamp":"2024-01-22T10:14:03.406365+0000","last_deep_scrub":"30'11","last_deep_scrub_stamp":"2024-01-22T10:14:03.406365+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.406365+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:52:41.528284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:05.135997+0000","last_change":"2024-01-22T10:14:05.136035+0000","last_active":"2024-01-22T10:14:05.135997+0000","last_peered":"2024-01-22T10:14:05.135997+0000","last_clean":"2024-01-22T10:14:05.135997+0000","last_became_active":"2024-01-22T10:13:42.627194+0000","last_became_peered":"2024-01-22T10:13:42.627194+0000","last_unstale":"2024-01-22T10:14:05.135997+0000","last_undegraded":"2024-01-22T10:14:05.135997+0000","last_fullsized":"2024-01-22T10:14:05.135997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:05.135921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:05.135921+0000","last_clean_scrub_stamp":"2024-01-22T10:14:05.135921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:10:00.626435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:08.136315+0000","last_change":"2024-01-22T10:14:08.136341+0000","last_active":"2024-01-22T10:14:08.136315+0000","last_peered":"2024-01-22T10:14:08.136315+0000","last_clean":"2024-01-22T10:14:08.136315+0000","last_became_active":"2024-01-22T10:13:41.602166+0000","last_became_peered":"2024-01-22T10:13:41.602166+0000","last_unstale":"2024-01-22T10:14:08.136315+0000","last_undegraded":"2024-01-22T10:14:08.136315+0000","last_fullsized":"2024-01-22T10:14:08.136315+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-22T10:14:08.136237+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-22T10:14:08.136237+0000","last_clean_scrub_stamp":"2024-01-22T10:14:08.136237+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:25:31.588378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:11.392344+0000","last_change":"2024-01-22T10:14:11.392365+0000","last_active":"2024-01-22T10:14:11.392344+0000","last_peered":"2024-01-22T10:14:11.392344+0000","last_clean":"2024-01-22T10:14:11.392344+0000","last_became_active":"2024-01-22T10:13:42.623996+0000","last_became_peered":"2024-01-22T10:13:42.623996+0000","last_unstale":"2024-01-22T10:14:11.392344+0000","last_undegraded":"2024-01-22T10:14:11.392344+0000","last_fullsized":"2024-01-22T10:14:11.392344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:11.392251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:11.392251+0000","last_clean_scrub_stamp":"2024-01-22T10:14:11.392251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T15:41:06.194378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.176322+0000","last_change":"2024-01-22T10:14:01.176357+0000","last_active":"2024-01-22T10:14:01.176322+0000","last_peered":"2024-01-22T10:14:01.176322+0000","last_clean":"2024-01-22T10:14:01.176322+0000","last_became_active":"2024-01-22T10:13:41.596376+0000","last_became_peered":"2024-01-22T10:13:41.596376+0000","last_unstale":"2024-01-22T10:14:01.176322+0000","last_undegraded":"2024-01-22T10:14:01.176322+0000","last_fullsized":"2024-01-22T10:14:01.176322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:01.176253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:01.176253+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.176253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:18:38.219103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:11.206022+0000","last_change":"2024-01-22T10:14:11.206051+0000","last_active":"2024-01-22T10:14:11.206022+0000","last_peered":"2024-01-22T10:14:11.206022+0000","last_clean":"2024-01-22T10:14:11.206022+0000","last_became_active":"2024-01-22T10:13:42.624005+0000","last_became_peered":"2024-01-22T10:13:42.624005+0000","last_unstale":"2024-01-22T10:14:11.206022+0000","last_undegraded":"2024-01-22T10:14:11.206022+0000","last_fullsized":"2024-01-22T10:14:11.206022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:11.205935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:11.205935+0000","last_clean_scrub_stamp":"2024-01-22T10:14:11.205935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:08:39.984992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.390349+0000","last_change":"2024-01-22T10:14:04.390381+0000","last_active":"2024-01-22T10:14:04.390349+0000","last_peered":"2024-01-22T10:14:04.390349+0000","last_clean":"2024-01-22T10:14:04.390349+0000","last_became_active":"2024-01-22T10:13:41.597155+0000","last_became_peered":"2024-01-22T10:13:41.597155+0000","last_unstale":"2024-01-22T10:14:04.390349+0000","last_undegraded":"2024-01-22T10:14:04.390349+0000","last_fullsized":"2024-01-22T10:14:04.390349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.390258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.390258+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.390258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:02:30.165843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.999001+0000","last_change":"2024-01-22T10:14:04.999035+0000","last_active":"2024-01-22T10:14:04.999001+0000","last_peered":"2024-01-22T10:14:04.999001+0000","last_clean":"2024-01-22T10:14:04.999001+0000","last_became_active":"2024-01-22T10:13:42.625291+0000","last_became_peered":"2024-01-22T10:13:42.625291+0000","last_unstale":"2024-01-22T10:14:04.999001+0000","last_undegraded":"2024-01-22T10:14:04.999001+0000","last_fullsized":"2024-01-22T10:14:04.999001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.998883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.998883+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.998883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:54.605950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.442598+0000","last_change":"2024-01-22T10:14:02.442647+0000","last_active":"2024-01-22T10:14:02.442598+0000","last_peered":"2024-01-22T10:14:02.442598+0000","last_clean":"2024-01-22T10:14:02.442598+0000","last_became_active":"2024-01-22T10:13:41.594410+0000","last_became_peered":"2024-01-22T10:13:41.594410+0000","last_unstale":"2024-01-22T10:14:02.442598+0000","last_undegraded":"2024-01-22T10:14:02.442598+0000","last_fullsized":"2024-01-22T10:14:02.442598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-01-22T10:14:02.442484+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-01-22T10:14:02.442484+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.442484+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:52:50.102134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:11.131373+0000","last_change":"2024-01-22T10:14:11.131409+0000","last_active":"2024-01-22T10:14:11.131373+0000","last_peered":"2024-01-22T10:14:11.131373+0000","last_clean":"2024-01-22T10:14:11.131373+0000","last_became_active":"2024-01-22T10:13:42.632877+0000","last_became_peered":"2024-01-22T10:13:42.632877+0000","last_unstale":"2024-01-22T10:14:11.131373+0000","last_undegraded":"2024-01-22T10:14:11.131373+0000","last_fullsized":"2024-01-22T10:14:11.131373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:11.131269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:11.131269+0000","last_clean_scrub_stamp":"2024-01-22T10:14:11.131269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:52:58.790919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:00.158180+0000","last_change":"2024-01-22T10:14:00.158219+0000","last_active":"2024-01-22T10:14:00.158180+0000","last_peered":"2024-01-22T10:14:00.158180+0000","last_clean":"2024-01-22T10:14:00.158180+0000","last_became_active":"2024-01-22T10:13:41.594555+0000","last_became_peered":"2024-01-22T10:13:41.594555+0000","last_unstale":"2024-01-22T10:14:00.158180+0000","last_undegraded":"2024-01-22T10:14:00.158180+0000","last_fullsized":"2024-01-22T10:14:00.158180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-01-22T10:14:00.158081+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-01-22T10:14:00.158081+0000","last_clean_scrub_stamp":"2024-01-22T10:14:00.158081+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:46:04.059696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:09.792151+0000","last_change":"2024-01-22T10:14:09.792172+0000","last_active":"2024-01-22T10:14:09.792151+0000","last_peered":"2024-01-22T10:14:09.792151+0000","last_clean":"2024-01-22T10:14:09.792151+0000","last_became_active":"2024-01-22T10:13:42.629837+0000","last_became_peered":"2024-01-22T10:13:42.629837+0000","last_unstale":"2024-01-22T10:14:09.792151+0000","last_undegraded":"2024-01-22T10:14:09.792151+0000","last_fullsized":"2024-01-22T10:14:09.792151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:09.792070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:09.792070+0000","last_clean_scrub_stamp":"2024-01-22T10:14:09.792070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:50:53.610836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:00.075372+0000","last_change":"2024-01-22T10:14:00.075405+0000","last_active":"2024-01-22T10:14:00.075372+0000","last_peered":"2024-01-22T10:14:00.075372+0000","last_clean":"2024-01-22T10:14:00.075372+0000","last_became_active":"2024-01-22T10:13:41.602710+0000","last_became_peered":"2024-01-22T10:13:41.602710+0000","last_unstale":"2024-01-22T10:14:00.075372+0000","last_undegraded":"2024-01-22T10:14:00.075372+0000","last_fullsized":"2024-01-22T10:14:00.075372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-22T10:14:00.075287+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-22T10:14:00.075287+0000","last_clean_scrub_stamp":"2024-01-22T10:14:00.075287+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:23:47.728973+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.127556+0000","last_change":"2024-01-22T10:14:06.127594+0000","last_active":"2024-01-22T10:14:06.127556+0000","last_peered":"2024-01-22T10:14:06.127556+0000","last_clean":"2024-01-22T10:14:06.127556+0000","last_became_active":"2024-01-22T10:13:42.629488+0000","last_became_peered":"2024-01-22T10:13:42.629488+0000","last_unstale":"2024-01-22T10:14:06.127556+0000","last_undegraded":"2024-01-22T10:14:06.127556+0000","last_fullsized":"2024-01-22T10:14:06.127556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.127470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.127470+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.127470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:00:54.645739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.075598+0000","last_change":"2024-01-22T10:14:06.075646+0000","last_active":"2024-01-22T10:14:06.075598+0000","last_peered":"2024-01-22T10:14:06.075598+0000","last_clean":"2024-01-22T10:14:06.075598+0000","last_became_active":"2024-01-22T10:13:41.599228+0000","last_became_peered":"2024-01-22T10:13:41.599228+0000","last_unstale":"2024-01-22T10:14:06.075598+0000","last_undegraded":"2024-01-22T10:14:06.075598+0000","last_fullsized":"2024-01-22T10:14:06.075598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-01-22T10:14:06.075513+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-01-22T10:14:06.075513+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.075513+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:35:17.883727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.987597+0000","last_change":"2024-01-22T10:14:02.987620+0000","last_active":"2024-01-22T10:14:02.987597+0000","last_peered":"2024-01-22T10:14:02.987597+0000","last_clean":"2024-01-22T10:14:02.987597+0000","last_became_active":"2024-01-22T10:13:42.625809+0000","last_became_peered":"2024-01-22T10:13:42.625809+0000","last_unstale":"2024-01-22T10:14:02.987597+0000","last_undegraded":"2024-01-22T10:14:02.987597+0000","last_fullsized":"2024-01-22T10:14:02.987597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:02.987516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:02.987516+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.987516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:19:39.039767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.066935+0000","last_change":"2024-01-22T10:14:03.066960+0000","last_active":"2024-01-22T10:14:03.066935+0000","last_peered":"2024-01-22T10:14:03.066935+0000","last_clean":"2024-01-22T10:14:03.066935+0000","last_became_active":"2024-01-22T10:13:41.597157+0000","last_became_peered":"2024-01-22T10:13:41.597157+0000","last_unstale":"2024-01-22T10:14:03.066935+0000","last_undegraded":"2024-01-22T10:14:03.066935+0000","last_fullsized":"2024-01-22T10:14:03.066935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:03.066858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:03.066858+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.066858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:46:06.968473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.002457+0000","last_change":"2024-01-22T10:14:06.002491+0000","last_active":"2024-01-22T10:14:06.002457+0000","last_peered":"2024-01-22T10:14:06.002457+0000","last_clean":"2024-01-22T10:14:06.002457+0000","last_became_active":"2024-01-22T10:13:42.630345+0000","last_became_peered":"2024-01-22T10:13:42.630345+0000","last_unstale":"2024-01-22T10:14:06.002457+0000","last_undegraded":"2024-01-22T10:14:06.002457+0000","last_fullsized":"2024-01-22T10:14:06.002457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.002346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.002346+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.002346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:51.946028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.475295+0000","last_change":"2024-01-22T10:14:02.475354+0000","last_active":"2024-01-22T10:14:02.475295+0000","last_peered":"2024-01-22T10:14:02.475295+0000","last_clean":"2024-01-22T10:14:02.475295+0000","last_became_active":"2024-01-22T10:13:41.603096+0000","last_became_peered":"2024-01-22T10:13:41.603096+0000","last_unstale":"2024-01-22T10:14:02.475295+0000","last_undegraded":"2024-01-22T10:14:02.475295+0000","last_fullsized":"2024-01-22T10:14:02.475295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-22T10:14:02.475188+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-22T10:14:02.475188+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.475188+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:46:06.376804+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.984585+0000","last_change":"2024-01-22T10:14:01.984604+0000","last_active":"2024-01-22T10:14:01.984585+0000","last_peered":"2024-01-22T10:14:01.984585+0000","last_clean":"2024-01-22T10:14:01.984585+0000","last_became_active":"2024-01-22T10:13:42.625524+0000","last_became_peered":"2024-01-22T10:13:42.625524+0000","last_unstale":"2024-01-22T10:14:01.984585+0000","last_undegraded":"2024-01-22T10:14:01.984585+0000","last_fullsized":"2024-01-22T10:14:01.984585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:01.984515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:01.984515+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.984515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:33:29.694410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.110046+0000","last_change":"2024-01-22T10:14:02.110067+0000","last_active":"2024-01-22T10:14:02.110046+0000","last_peered":"2024-01-22T10:14:02.110046+0000","last_clean":"2024-01-22T10:14:02.110046+0000","last_became_active":"2024-01-22T10:13:41.600704+0000","last_became_peered":"2024-01-22T10:13:41.600704+0000","last_unstale":"2024-01-22T10:14:02.110046+0000","last_undegraded":"2024-01-22T10:14:02.110046+0000","last_fullsized":"2024-01-22T10:14:02.110046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:02.109932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:02.109932+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.109932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:31:40.979172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:00.051717+0000","last_change":"2024-01-22T10:14:00.051736+0000","last_active":"2024-01-22T10:14:00.051717+0000","last_peered":"2024-01-22T10:14:00.051717+0000","last_clean":"2024-01-22T10:14:00.051717+0000","last_became_active":"2024-01-22T10:13:42.622631+0000","last_became_peered":"2024-01-22T10:13:42.622631+0000","last_unstale":"2024-01-22T10:14:00.051717+0000","last_undegraded":"2024-01-22T10:14:00.051717+0000","last_fullsized":"2024-01-22T10:14:00.051717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:00.051646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:00.051646+0000","last_clean_scrub_stamp":"2024-01-22T10:14:00.051646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:32:07.950699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.110751+0000","last_change":"2024-01-22T10:14:04.110769+0000","last_active":"2024-01-22T10:14:04.110751+0000","last_peered":"2024-01-22T10:14:04.110751+0000","last_clean":"2024-01-22T10:14:04.110751+0000","last_became_active":"2024-01-22T10:13:41.597324+0000","last_became_peered":"2024-01-22T10:13:41.597324+0000","last_unstale":"2024-01-22T10:14:04.110751+0000","last_undegraded":"2024-01-22T10:14:04.110751+0000","last_fullsized":"2024-01-22T10:14:04.110751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.110672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.110672+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.110672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:36.226500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.195532+0000","last_change":"2024-01-22T10:14:04.195552+0000","last_active":"2024-01-22T10:14:04.195532+0000","last_peered":"2024-01-22T10:14:04.195532+0000","last_clean":"2024-01-22T10:14:04.195532+0000","last_became_active":"2024-01-22T10:13:42.616992+0000","last_became_peered":"2024-01-22T10:13:42.616992+0000","last_unstale":"2024-01-22T10:14:04.195532+0000","last_undegraded":"2024-01-22T10:14:04.195532+0000","last_fullsized":"2024-01-22T10:14:04.195532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.195466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.195466+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.195466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:35:03.448145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.866708+0000","last_change":"2024-01-22T10:14:01.866749+0000","last_active":"2024-01-22T10:14:01.866708+0000","last_peered":"2024-01-22T10:14:01.866708+0000","last_clean":"2024-01-22T10:14:01.866708+0000","last_became_active":"2024-01-22T10:13:41.599008+0000","last_became_peered":"2024-01-22T10:13:41.599008+0000","last_unstale":"2024-01-22T10:14:01.866708+0000","last_undegraded":"2024-01-22T10:14:01.866708+0000","last_fullsized":"2024-01-22T10:14:01.866708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:01.866608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:01.866608+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.866608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:35:13.674823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.001093+0000","last_change":"2024-01-22T10:14:04.001117+0000","last_active":"2024-01-22T10:14:04.001093+0000","last_peered":"2024-01-22T10:14:04.001093+0000","last_clean":"2024-01-22T10:14:04.001093+0000","last_became_active":"2024-01-22T10:13:42.626088+0000","last_became_peered":"2024-01-22T10:13:42.626088+0000","last_unstale":"2024-01-22T10:14:04.001093+0000","last_undegraded":"2024-01-22T10:14:04.001093+0000","last_fullsized":"2024-01-22T10:14:04.001093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.001000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.001000+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.001000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:12:40.132544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:02.135147+0000","last_change":"2024-01-22T10:14:02.135175+0000","last_active":"2024-01-22T10:14:02.135147+0000","last_peered":"2024-01-22T10:14:02.135147+0000","last_clean":"2024-01-22T10:14:02.135147+0000","last_became_active":"2024-01-22T10:13:41.597126+0000","last_became_peered":"2024-01-22T10:13:41.597126+0000","last_unstale":"2024-01-22T10:14:02.135147+0000","last_undegraded":"2024-01-22T10:14:02.135147+0000","last_fullsized":"2024-01-22T10:14:02.135147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-01-22T10:14:02.135070+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-01-22T10:14:02.135070+0000","last_clean_scrub_stamp":"2024-01-22T10:14:02.135070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:14:06.507188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.837944+0000","last_change":"2024-01-22T10:14:04.837965+0000","last_active":"2024-01-22T10:14:04.837944+0000","last_peered":"2024-01-22T10:14:04.837944+0000","last_clean":"2024-01-22T10:14:04.837944+0000","last_became_active":"2024-01-22T10:13:42.624431+0000","last_became_peered":"2024-01-22T10:13:42.624431+0000","last_unstale":"2024-01-22T10:14:04.837944+0000","last_undegraded":"2024-01-22T10:14:04.837944+0000","last_fullsized":"2024-01-22T10:14:04.837944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.837878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.837878+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.837878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:29:28.038286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"30'3","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.443263+0000","last_change":"2024-01-22T10:14:01.443288+0000","last_active":"2024-01-22T10:14:01.443263+0000","last_peered":"2024-01-22T10:14:01.443263+0000","last_clean":"2024-01-22T10:14:01.443263+0000","last_became_active":"2024-01-22T10:13:41.602818+0000","last_became_peered":"2024-01-22T10:13:41.602818+0000","last_unstale":"2024-01-22T10:14:01.443263+0000","last_undegraded":"2024-01-22T10:14:01.443263+0000","last_fullsized":"2024-01-22T10:14:01.443263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-01-22T10:14:01.443201+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-01-22T10:14:01.443201+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.443201+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T18:46:51.050268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.454910+0000","last_change":"2024-01-22T10:14:06.454945+0000","last_active":"2024-01-22T10:14:06.454910+0000","last_peered":"2024-01-22T10:14:06.454910+0000","last_clean":"2024-01-22T10:14:06.454910+0000","last_became_active":"2024-01-22T10:13:42.625759+0000","last_became_peered":"2024-01-22T10:13:42.625759+0000","last_unstale":"2024-01-22T10:14:06.454910+0000","last_undegraded":"2024-01-22T10:14:06.454910+0000","last_fullsized":"2024-01-22T10:14:06.454910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.454826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.454826+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.454826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:06:09.754181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:59.114803+0000","last_change":"2024-01-22T10:13:59.114823+0000","last_active":"2024-01-22T10:13:59.114803+0000","last_peered":"2024-01-22T10:13:59.114803+0000","last_clean":"2024-01-22T10:13:59.114803+0000","last_became_active":"2024-01-22T10:13:41.593469+0000","last_became_peered":"2024-01-22T10:13:41.593469+0000","last_unstale":"2024-01-22T10:13:59.114803+0000","last_undegraded":"2024-01-22T10:13:59.114803+0000","last_fullsized":"2024-01-22T10:13:59.114803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:59.114741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:59.114741+0000","last_clean_scrub_stamp":"2024-01-22T10:13:59.114741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T20:42:22.761711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:04.024708+0000","last_change":"2024-01-22T10:14:04.024746+0000","last_active":"2024-01-22T10:14:04.024708+0000","last_peered":"2024-01-22T10:14:04.024708+0000","last_clean":"2024-01-22T10:14:04.024708+0000","last_became_active":"2024-01-22T10:13:42.622464+0000","last_became_peered":"2024-01-22T10:13:42.622464+0000","last_unstale":"2024-01-22T10:14:04.024708+0000","last_undegraded":"2024-01-22T10:14:04.024708+0000","last_fullsized":"2024-01-22T10:14:04.024708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:04.024631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:04.024631+0000","last_clean_scrub_stamp":"2024-01-22T10:14:04.024631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:01:49.968313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:13:59.416129+0000","last_change":"2024-01-22T10:13:59.416148+0000","last_active":"2024-01-22T10:13:59.416129+0000","last_peered":"2024-01-22T10:13:59.416129+0000","last_clean":"2024-01-22T10:13:59.416129+0000","last_became_active":"2024-01-22T10:13:41.601010+0000","last_became_peered":"2024-01-22T10:13:41.601010+0000","last_unstale":"2024-01-22T10:13:59.416129+0000","last_undegraded":"2024-01-22T10:13:59.416129+0000","last_fullsized":"2024-01-22T10:13:59.416129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:13:59.416062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:13:59.416062+0000","last_clean_scrub_stamp":"2024-01-22T10:13:59.416062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T11:32:24.040275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.483694+0000","last_change":"2024-01-22T10:14:03.483717+0000","last_active":"2024-01-22T10:14:03.483694+0000","last_peered":"2024-01-22T10:14:03.483694+0000","last_clean":"2024-01-22T10:14:03.483694+0000","last_became_active":"2024-01-22T10:13:42.622855+0000","last_became_peered":"2024-01-22T10:13:42.622855+0000","last_unstale":"2024-01-22T10:14:03.483694+0000","last_undegraded":"2024-01-22T10:14:03.483694+0000","last_fullsized":"2024-01-22T10:14:03.483694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:03.483617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:03.483617+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.483617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:54:35.599445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:03.116026+0000","last_change":"2024-01-22T10:14:03.116062+0000","last_active":"2024-01-22T10:14:03.116026+0000","last_peered":"2024-01-22T10:14:03.116026+0000","last_clean":"2024-01-22T10:14:03.116026+0000","last_became_active":"2024-01-22T10:13:41.597270+0000","last_became_peered":"2024-01-22T10:13:41.597270+0000","last_unstale":"2024-01-22T10:14:03.116026+0000","last_undegraded":"2024-01-22T10:14:03.116026+0000","last_fullsized":"2024-01-22T10:14:03.116026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:03.115950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:03.115950+0000","last_clean_scrub_stamp":"2024-01-22T10:14:03.115950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T10:33:21.462736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:10.398081+0000","last_change":"2024-01-22T10:14:10.398106+0000","last_active":"2024-01-22T10:14:10.398081+0000","last_peered":"2024-01-22T10:14:10.398081+0000","last_clean":"2024-01-22T10:14:10.398081+0000","last_became_active":"2024-01-22T10:13:42.623331+0000","last_became_peered":"2024-01-22T10:13:42.623331+0000","last_unstale":"2024-01-22T10:14:10.398081+0000","last_undegraded":"2024-01-22T10:14:10.398081+0000","last_fullsized":"2024-01-22T10:14:10.398081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:10.397991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:10.397991+0000","last_clean_scrub_stamp":"2024-01-22T10:14:10.397991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T14:43:52.500167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.070364+0000","last_change":"2024-01-22T10:14:01.070402+0000","last_active":"2024-01-22T10:14:01.070364+0000","last_peered":"2024-01-22T10:14:01.070364+0000","last_clean":"2024-01-22T10:14:01.070364+0000","last_became_active":"2024-01-22T10:13:41.596639+0000","last_became_peered":"2024-01-22T10:13:41.596639+0000","last_unstale":"2024-01-22T10:14:01.070364+0000","last_undegraded":"2024-01-22T10:14:01.070364+0000","last_fullsized":"2024-01-22T10:14:01.070364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:01.070278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:01.070278+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.070278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T17:43:08.099465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:16.113437+0000","last_change":"2024-01-22T10:14:16.113460+0000","last_active":"2024-01-22T10:14:16.113437+0000","last_peered":"2024-01-22T10:14:16.113437+0000","last_clean":"2024-01-22T10:14:16.113437+0000","last_became_active":"2024-01-22T10:13:42.637152+0000","last_became_peered":"2024-01-22T10:13:42.637152+0000","last_unstale":"2024-01-22T10:14:16.113437+0000","last_undegraded":"2024-01-22T10:14:16.113437+0000","last_fullsized":"2024-01-22T10:14:16.113437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:16.113351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:16.113351+0000","last_clean_scrub_stamp":"2024-01-22T10:14:16.113351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T12:04:07.849557+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:06.378435+0000","last_change":"2024-01-22T10:14:06.378471+0000","last_active":"2024-01-22T10:14:06.378435+0000","last_peered":"2024-01-22T10:14:06.378435+0000","last_clean":"2024-01-22T10:14:06.378435+0000","last_became_active":"2024-01-22T10:13:41.600181+0000","last_became_peered":"2024-01-22T10:13:41.600181+0000","last_unstale":"2024-01-22T10:14:06.378435+0000","last_undegraded":"2024-01-22T10:14:06.378435+0000","last_fullsized":"2024-01-22T10:14:06.378435+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:06.378347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:06.378347+0000","last_clean_scrub_stamp":"2024-01-22T10:14:06.378347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T21:19:13.844082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:12.184756+0000","last_change":"2024-01-22T10:14:12.184794+0000","last_active":"2024-01-22T10:14:12.184756+0000","last_peered":"2024-01-22T10:14:12.184756+0000","last_clean":"2024-01-22T10:14:12.184756+0000","last_became_active":"2024-01-22T10:13:42.626445+0000","last_became_peered":"2024-01-22T10:13:42.626445+0000","last_unstale":"2024-01-22T10:14:12.184756+0000","last_undegraded":"2024-01-22T10:14:12.184756+0000","last_fullsized":"2024-01-22T10:14:12.184756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:12.184632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:12.184632+0000","last_clean_scrub_stamp":"2024-01-22T10:14:12.184632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T13:51:50.987453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.153667+0000","last_change":"2024-01-22T10:14:01.153692+0000","last_active":"2024-01-22T10:14:01.153667+0000","last_peered":"2024-01-22T10:14:01.153667+0000","last_clean":"2024-01-22T10:14:01.153667+0000","last_became_active":"2024-01-22T10:13:41.599985+0000","last_became_peered":"2024-01-22T10:13:41.599985+0000","last_unstale":"2024-01-22T10:14:01.153667+0000","last_undegraded":"2024-01-22T10:14:01.153667+0000","last_fullsized":"2024-01-22T10:14:01.153667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-22T10:14:01.153584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-22T10:14:01.153584+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.153584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T19:30:36.657474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-22T10:14:01.130645+0000","last_change":"2024-01-22T10:14:01.130679+0000","last_active":"2024-01-22T10:14:01.130645+0000","last_peered":"2024-01-22T10:14:01.130645+0000","last_clean":"2024-01-22T10:14:01.130645+0000","last_became_active":"2024-01-22T10:12:52.033101+0000","last_became_peered":"2024-01-22T10:12:52.033101+0000","last_unstale":"2024-01-22T10:14:01.130645+0000","last_undegraded":"2024-01-22T10:14:01.130645+0000","last_fullsized":"2024-01-22T10:14:01.130645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2024-01-22T10:14:01.130569+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2024-01-22T10:14:01.130569+0000","last_clean_scrub_stamp":"2024-01-22T10:14:01.130569+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-23T16:09:56.621083+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7941,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":933888,"data_stored":719503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.75700000000000001}]},{"osd":1,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.59699999999999998}]},{"osd":2,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.626},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.68700000000000006}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.73999999999999999}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.45300000000000001}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.433},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.48999999999999999}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":129661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.57099999999999995}]},{"osd":1,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.65500000000000003}]},{"osd":3,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.629}]},{"osd":4,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.41999999999999998}]},{"osd":5,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45100000000000001}]},{"osd":7,"last update":"Mon Jan 22 10:13:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":129717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.501}]},{"osd":1,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.53300000000000003}]},{"osd":2,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.51800000000000002}]},{"osd":3,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.624},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48299999999999998}]},{"osd":4,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.314},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.33400000000000002}]},{"osd":6,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.38700000000000001}]},{"osd":7,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.373},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":129149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55200000000000005}]},{"osd":1,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.48899999999999999}]},{"osd":3,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.51800000000000002}]},{"osd":5,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.39900000000000002}]},{"osd":6,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.623}]},{"osd":7,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.5},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":136210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.34200000000000003}]},{"osd":1,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.317},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.45900000000000002}]},{"osd":2,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51400000000000001}]},{"osd":5,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.59899999999999998}]},{"osd":6,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Jan 22 10:13:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.621},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":129115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.28799999999999998}]},{"osd":1,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.31},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.42199999999999999}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.432}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.55700000000000005}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.626}]},{"osd":7,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.48299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":136210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.34100000000000003}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.30599999999999999}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.73499999999999999}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.748}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.71899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":929792,"data_stored":719413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.57399999999999995}]},{"osd":3,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.59599999999999997}]},{"osd":4,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68300000000000005}]},{"osd":5,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.65400000000000003}]},{"osd":7,"last update":"Mon Jan 22 10:13:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-22T10:14:41.847 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-22T10:14:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.997+0000 7f9825d43640 1 Processor -- start 2024-01-22T10:14:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.997+0000 7f9825d43640 1 -- start start 2024-01-22T10:14:41.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.998+0000 7f9825d43640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98200b8b30 0x7f98200b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.998+0000 7f9825d43640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98200bbef0 con 0x7f98200b3df0 2024-01-22T10:14:41.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.998+0000 7f9825d43640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98200b5de0 con 0x7f9820143390 2024-01-22T10:14:41.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.998+0000 7f9825d43640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98200bb140 con 0x7f98200b8b30 2024-01-22T10:14:41.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.998+0000 7f9816ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f98200b3df0 0x7f98200b9890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57352/0 (socket says 172.21.15.88:57352) 2024-01-22T10:14:41.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.998+0000 7f9816ffd640 1 -- 172.21.15.88:0/362549626 learned_addr learned my addr 172.21.15.88:0/362549626 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-01-22T10:14:41.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.998+0000 7f981f7fe640 1 --2- 172.21.15.88:0/362549626 >> v2:172.21.15.119:3300/0 conn(0x7f98200b8b30 0x7f98200b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:41.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.998+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294590191 0 0) 0x7f98200bbef0 con 0x7f98200b3df0 2024-01-22T10:14:41.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f980c003520 con 0x7f98200b3df0 2024-01-22T10:14:41.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1225367046 0 0) 0x7f980c003520 con 0x7f98200b3df0 2024-01-22T10:14:41.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 >> v2:172.21.15.119:3300/0 conn(0x7f98200b8b30 msgr2=0x7f98200b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 --2- 172.21.15.88:0/362549626 >> v2:172.21.15.119:3300/0 conn(0x7f98200b8b30 0x7f98200b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 >> v1:172.21.15.119:6789/0 conn(0x7f9820143390 legacy=0x7f9820153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98200bb410 con 0x7f98200b3df0 2024-01-22T10:14:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2612323009 0 0) 0x7f9808001670 con 0x7f98200b3df0 2024-01-22T10:14:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 >> v1:172.21.15.88:6789/0 conn(0x7f98200b3df0 legacy=0x7f98200b9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 --2- 172.21.15.88:0/362549626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c003a50 0x7f980c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 --2- 172.21.15.88:0/362549626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f980c0047c0 0x7f980c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 --2- 172.21.15.88:0/362549626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f980c0051d0 0x7f980c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98200bb140 con 0x7f980c0051d0 2024-01-22T10:14:41.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c00c100 con 0x7f980c003a50 2024-01-22T10:14:41.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c00c2c0 con 0x7f980c0047c0 2024-01-22T10:14:41.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981ffff640 1 --2- 172.21.15.88:0/362549626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f980c0051d0 0x7f980c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:41.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981f7fe640 1 --2- 172.21.15.88:0/362549626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c003a50 0x7f980c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:41.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f9816ffd640 1 --2- 172.21.15.88:0/362549626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f980c0047c0 0x7f980c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:41.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981ffff640 1 -- 172.21.15.88:0/362549626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f980c0047c0 msgr2=0x7f980c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:41.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981ffff640 1 --2- 172.21.15.88:0/362549626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f980c0047c0 0x7f980c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981ffff640 1 -- 172.21.15.88:0/362549626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c003a50 msgr2=0x7f980c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:41.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981ffff640 1 --2- 172.21.15.88:0/362549626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c003a50 0x7f980c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f981ffff640 1 -- 172.21.15.88:0/362549626 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c003520 con 0x7f980c0051d0 2024-01-22T10:14:41.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:41.999+0000 7f9816ffd640 1 --2- 172.21.15.88:0/362549626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f980c0047c0 0x7f980c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:14:41.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.000+0000 7f981ffff640 1 -- 172.21.15.88:0/362549626 reap_dead start 2024-01-22T10:14:41.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.000+0000 7f981ffff640 1 --2- 172.21.15.88:0/362549626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f980c0051d0 0x7f980c00b980 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9818001e20 tx=0x7f980c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaeafdbca7c89117 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:41.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.000+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9818003b70 con 0x7f980c0051d0 2024-01-22T10:14:41.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.000+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9818003cd0 con 0x7f980c0051d0 2024-01-22T10:14:41.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.000+0000 7f981effd640 1 -- 172.21.15.88:0/362549626 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98180052f0 con 0x7f980c0051d0 2024-01-22T10:14:41.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.001+0000 7f9825d43640 1 -- 172.21.15.88:0/362549626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f980c0051d0 msgr2=0x7f980c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:41.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.001+0000 7f9825d43640 1 --2- 172.21.15.88:0/362549626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f980c0051d0 0x7f980c00b980 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9818001e20 tx=0x7f980c0057f0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.001+0000 7f9825d43640 1 -- 172.21.15.88:0/362549626 shutdown_connections 2024-01-22T10:14:41.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.001+0000 7f9825d43640 1 --2- 172.21.15.88:0/362549626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f980c0051d0 0x7f980c00b980 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.001+0000 7f9825d43640 1 -- 172.21.15.88:0/362549626 >> 172.21.15.88:0/362549626 conn(0x7f9820071650 msgr2=0x7f9820071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:41.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.001+0000 7f9825d43640 1 -- 172.21.15.88:0/362549626 shutdown_connections 2024-01-22T10:14:41.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.001+0000 7f9825d43640 1 -- 172.21.15.88:0/362549626 wait complete. 2024-01-22T10:14:41.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.002+0000 7f9825d43640 1 Processor -- start 2024-01-22T10:14:41.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.002+0000 7f9825d43640 1 -- start start 2024-01-22T10:14:41.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.002+0000 7f9825d43640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0051d0 0x7f98201e2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.002+0000 7f9825d43640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98201455d0 0x7f982013cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.002+0000 7f9825d43640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9820145a50 0x7f982013cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.002+0000 7f9825d43640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98201dfca0 con 0x7f98201455d0 2024-01-22T10:14:41.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.002+0000 7f9825d43640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98201e2290 con 0x7f980c0051d0 2024-01-22T10:14:41.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.002+0000 7f9825d43640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982014a420 con 0x7f9820145a50 2024-01-22T10:14:41.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f9816ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98201455d0 0x7f982013cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:41.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f9816ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98201455d0 0x7f982013cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47880/0 (socket says 172.21.15.88:47880) 2024-01-22T10:14:41.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f9816ffd640 1 -- 172.21.15.88:0/402421661 learned_addr learned my addr 172.21.15.88:0/402421661 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:14:41.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f9816ffd640 1 -- 172.21.15.88:0/402421661 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9820145a50 msgr2=0x7f982013cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:41.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f9816ffd640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9820145a50 0x7f982013cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f9816ffd640 1 -- 172.21.15.88:0/402421661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0051d0 msgr2=0x7f98201e2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:41.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f981f7fe640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0051d0 0x7f98201e2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:41.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f9816ffd640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0051d0 0x7f98201e2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:41.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f9816ffd640 1 -- 172.21.15.88:0/402421661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98201e2530 con 0x7f98201455d0 2024-01-22T10:14:41.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f9816ffd640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98201455d0 0x7f982013cab0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f980800e700 tx=0x7f980800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:41.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f981cff9640 1 -- 172.21.15.88:0/402421661 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800ee10 con 0x7f98201455d0 2024-01-22T10:14:41.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f981cff9640 1 -- 172.21.15.88:0/402421661 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980800c870 con 0x7f98201455d0 2024-01-22T10:14:41.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f9825d43640 1 -- 172.21.15.88:0/402421661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9820149790 con 0x7f98201455d0 2024-01-22T10:14:41.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f981cff9640 1 -- 172.21.15.88:0/402421661 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800cbe0 con 0x7f98201455d0 2024-01-22T10:14:41.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.003+0000 7f9825d43640 1 -- 172.21.15.88:0/402421661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98201e2f90 con 0x7f98201455d0 2024-01-22T10:14:41.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.004+0000 7f9825d43640 1 -- 172.21.15.88:0/402421661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982004ea30 con 0x7f98201455d0 2024-01-22T10:14:41.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.004+0000 7f981cff9640 1 -- 172.21.15.88:0/402421661 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7f980801d460 con 0x7f98201455d0 2024-01-22T10:14:41.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.005+0000 7f981cff9640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f980006b330 0x7f980006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:41.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.005+0000 7f981cff9640 1 -- 172.21.15.88:0/402421661 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9808089a50 con 0x7f98201455d0 2024-01-22T10:14:41.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.005+0000 7f981f7fe640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f980006b330 0x7f980006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:41.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.005+0000 7f981f7fe640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f980006b330 0x7f980006d7f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9810009980 tx=0x7f9810008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:41.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.009+0000 7f981cff9640 1 -- 172.21.15.88:0/402421661 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9808054770 con 0x7f98201455d0 2024-01-22T10:14:42.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.177+0000 7f9825d43640 1 -- 172.21.15.88:0/402421661 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f982004ea30 con 0x7f98201455d0 2024-01-22T10:14:42.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.180+0000 7f981cff9640 1 -- 172.21.15.88:0/402421661 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9808057d90 con 0x7f98201455d0 2024-01-22T10:14:42.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.181+0000 7f981cff9640 1 -- 172.21.15.88:0/402421661 <== mon.0 v2:172.21.15.88:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9808054770 con 0x7f98201455d0 2024-01-22T10:14:42.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.182+0000 7f9825d43640 1 -- 172.21.15.88:0/402421661 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f980006b330 msgr2=0x7f980006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:42.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.182+0000 7f9825d43640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f980006b330 0x7f980006d7f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9810009980 tx=0x7f9810008040 comp rx=0 tx=0).stop 2024-01-22T10:14:42.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.182+0000 7f9825d43640 1 -- 172.21.15.88:0/402421661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98201455d0 msgr2=0x7f982013cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:42.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.182+0000 7f9825d43640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98201455d0 0x7f982013cab0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f980800e700 tx=0x7f980800ebc0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.182+0000 7f9825d43640 1 -- 172.21.15.88:0/402421661 shutdown_connections 2024-01-22T10:14:42.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.182+0000 7f9825d43640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7f980006b330 0x7f980006d7f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.182+0000 7f9825d43640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9820145a50 0x7f982013cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.182+0000 7f9825d43640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98201455d0 0x7f982013cab0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.182+0000 7f9825d43640 1 --2- 172.21.15.88:0/402421661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f980c0051d0 0x7f98201e2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.182+0000 7f9825d43640 1 -- 172.21.15.88:0/402421661 >> 172.21.15.88:0/402421661 conn(0x7f9820071650 msgr2=0x7f98200bd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:42.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.182+0000 7f9825d43640 1 -- 172.21.15.88:0/402421661 shutdown_connections 2024-01-22T10:14:42.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.182+0000 7f9825d43640 1 -- 172.21.15.88:0/402421661 wait complete. 2024-01-22T10:14:42.176 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-22T10:14:42.176 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-22T10:14:42.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.292+0000 7fc1de105640 1 Processor -- start 2024-01-22T10:14:42.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.292+0000 7fc1de105640 1 -- start start 2024-01-22T10:14:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1de105640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc1d80b3630 0x7fc1d80bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1de105640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1d814c070 0x7fc1d8152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:42.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1de105640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d80b4e80 con 0x7fc1d80b49c0 2024-01-22T10:14:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1de105640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d80b5370 con 0x7fc1d814c070 2024-01-22T10:14:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1de105640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d80b5fd0 con 0x7fc1d80b3630 2024-01-22T10:14:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1d7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1d814c070 0x7fc1d8152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1d7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1d814c070 0x7fc1d8152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47898/0 (socket says 172.21.15.88:47898) 2024-01-22T10:14:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1d7fff640 1 -- 172.21.15.88:0/4235405357 learned_addr learned my addr 172.21.15.88:0/4235405357 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:14:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1d77fe640 1 --2- 172.21.15.88:0/4235405357 >> v2:172.21.15.119:3300/0 conn(0x7fc1d80b3630 0x7fc1d80bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1d7fff640 1 -- 172.21.15.88:0/4235405357 >> v2:172.21.15.119:3300/0 conn(0x7fc1d80b3630 msgr2=0x7fc1d80bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-22T10:14:42.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1d7fff640 1 --2- 172.21.15.88:0/4235405357 >> v2:172.21.15.119:3300/0 conn(0x7fc1d80b3630 0x7fc1d80bd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1d7fff640 1 -- 172.21.15.88:0/4235405357 >> v1:172.21.15.119:6789/0 conn(0x7fc1d80b49c0 legacy=0x7fc1d814b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:42.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1d7fff640 1 -- 172.21.15.88:0/4235405357 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d80b6590 con 0x7fc1d814c070 2024-01-22T10:14:42.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.293+0000 7fc1d77fe640 1 --2- 172.21.15.88:0/4235405357 >> v2:172.21.15.119:3300/0 conn(0x7fc1d80b3630 0x7fc1d80bd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-22T10:14:42.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.294+0000 7fc1d7fff640 1 --2- 172.21.15.88:0/4235405357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d814c070 0x7fc1d8152cf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80b3dc0 tx=0x7fc1d002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0f52c91fccd032 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:42.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.294+0000 7fc1d67fc640 1 -- 172.21.15.88:0/4235405357 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d002cb20 con 0x7fc1d814c070 2024-01-22T10:14:42.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.294+0000 7fc1d67fc640 1 -- 172.21.15.88:0/4235405357 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc1d002cc80 con 0x7fc1d814c070 2024-01-22T10:14:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.294+0000 7fc1d67fc640 1 -- 172.21.15.88:0/4235405357 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d00343f0 con 0x7fc1d814c070 2024-01-22T10:14:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.295+0000 7fc1de105640 1 -- 172.21.15.88:0/4235405357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d814c070 msgr2=0x7fc1d8152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.295+0000 7fc1de105640 1 --2- 172.21.15.88:0/4235405357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d814c070 0x7fc1d8152cf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80b3dc0 tx=0x7fc1d002bf80 comp rx=0 tx=0).stop 2024-01-22T10:14:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.295+0000 7fc1de105640 1 -- 172.21.15.88:0/4235405357 shutdown_connections 2024-01-22T10:14:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.295+0000 7fc1de105640 1 --2- 172.21.15.88:0/4235405357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d814c070 0x7fc1d8152cf0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.295+0000 7fc1de105640 1 --2- 172.21.15.88:0/4235405357 >> v2:172.21.15.119:3300/0 conn(0x7fc1d80b3630 0x7fc1d80bd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.295+0000 7fc1de105640 1 -- 172.21.15.88:0/4235405357 >> 172.21.15.88:0/4235405357 conn(0x7fc1d806acf0 msgr2=0x7fc1d80bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:42.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.295+0000 7fc1de105640 1 -- 172.21.15.88:0/4235405357 shutdown_connections 2024-01-22T10:14:42.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.295+0000 7fc1de105640 1 -- 172.21.15.88:0/4235405357 wait complete. 2024-01-22T10:14:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.296+0000 7fc1de105640 1 Processor -- start 2024-01-22T10:14:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.296+0000 7fc1de105640 1 -- start start 2024-01-22T10:14:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1de105640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1d80b3630 0x7fc1d80703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1de105640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1d80b49c0 0x7fc1d806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1de105640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d81416b0 0x7fc1d8071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1de105640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d81489d0 con 0x7fc1d81416b0 2024-01-22T10:14:42.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1de105640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8156120 con 0x7fc1d80b3630 2024-01-22T10:14:42.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1de105640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8156300 con 0x7fc1d80b49c0 2024-01-22T10:14:42.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1d7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d81416b0 0x7fc1d8071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:42.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1d7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d81416b0 0x7fc1d8071360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47904/0 (socket says 172.21.15.88:47904) 2024-01-22T10:14:42.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1d7fff640 1 -- 172.21.15.88:0/147048735 learned_addr learned my addr 172.21.15.88:0/147048735 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-01-22T10:14:42.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1d77fe640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1d80b3630 0x7fc1d80703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:42.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1d6ffd640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1d80b49c0 0x7fc1d806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:42.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1d7fff640 1 -- 172.21.15.88:0/147048735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1d80b49c0 msgr2=0x7fc1d806fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:42.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1d7fff640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1d80b49c0 0x7fc1d806fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1d7fff640 1 -- 172.21.15.88:0/147048735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1d80b3630 msgr2=0x7fc1d80703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:42.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1d7fff640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1d80b3630 0x7fc1d80703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1d7fff640 1 -- 172.21.15.88:0/147048735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0009b30 con 0x7fc1d81416b0 2024-01-22T10:14:42.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1d7fff640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d81416b0 0x7fc1d8071360 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc1d002bfc0 tx=0x7fc1d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:42.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1bffff640 1 -- 172.21.15.88:0/147048735 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0007e90 con 0x7fc1d81416b0 2024-01-22T10:14:42.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1bffff640 1 -- 172.21.15.88:0/147048735 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc1d0009510 con 0x7fc1d81416b0 2024-01-22T10:14:42.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1de105640 1 -- 172.21.15.88:0/147048735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d80720c0 con 0x7fc1d81416b0 2024-01-22T10:14:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1bffff640 1 -- 172.21.15.88:0/147048735 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d003e690 con 0x7fc1d81416b0 2024-01-22T10:14:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.297+0000 7fc1de105640 1 -- 172.21.15.88:0/147048735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d8149220 con 0x7fc1d81416b0 2024-01-22T10:14:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.298+0000 7fc1de105640 1 -- 172.21.15.88:0/147048735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d804ea30 con 0x7fc1d81416b0 2024-01-22T10:14:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.299+0000 7fc1bffff640 1 -- 172.21.15.88:0/147048735 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89516+0+0 (secure 0 0 0) 0x7fc1d003e7f0 con 0x7fc1d81416b0 2024-01-22T10:14:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.299+0000 7fc1bffff640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc1c406b330 0x7fc1c406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-22T10:14:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.299+0000 7fc1d77fe640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc1c406b330 0x7fc1c406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-22T10:14:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.299+0000 7fc1bffff640 1 -- 172.21.15.88:0/147048735 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1d00ac7f0 con 0x7fc1d81416b0 2024-01-22T10:14:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.300+0000 7fc1d77fe640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc1c406b330 0x7fc1c406d7f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8006fd0 tx=0x7fc1c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-22T10:14:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.303+0000 7fc1bffff640 1 -- 172.21.15.88:0/147048735 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc1d0077410 con 0x7fc1d81416b0 2024-01-22T10:14:42.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.504+0000 7fc1de105640 1 -- 172.21.15.88:0/147048735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1d80b5cf0 con 0x7fc1d81416b0 2024-01-22T10:14:42.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.505+0000 7fc1bffff640 1 -- 172.21.15.88:0/147048735 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4150 (secure 0 0 0) 0x7fc1d0043090 con 0x7fc1d81416b0 2024-01-22T10:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-01-22T10:14:42.488 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4592,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1165513551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1165513551},{"type":"v1","addr":"172.21.15.88:6837","nonce":1165513551}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4816,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2442028121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2442028121},{"type":"v1","addr":"172.21.15.119:6833","nonce":2442028121}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-22T10:13:41.931499+0000","modified":"2024-01-22T10:13:44.831394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4983},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4983":{"gid":4983,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6836/2577795457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2577795457},{"type":"v1","addr":"172.21.15.88:6836","nonce":2577795457}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-22T10:14:42.490 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2024-01-22T10:14:42.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.507+0000 7fc1de105640 1 -- 172.21.15.88:0/147048735 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc1c406b330 msgr2=0x7fc1c406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:42.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.507+0000 7fc1de105640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc1c406b330 0x7fc1c406d7f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8006fd0 tx=0x7fc1c8008040 comp rx=0 tx=0).stop 2024-01-22T10:14:42.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.507+0000 7fc1de105640 1 -- 172.21.15.88:0/147048735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d81416b0 msgr2=0x7fc1d8071360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-22T10:14:42.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.507+0000 7fc1de105640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d81416b0 0x7fc1d8071360 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc1d002bfc0 tx=0x7fc1d0004a40 comp rx=0 tx=0).stop 2024-01-22T10:14:42.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.507+0000 7fc1de105640 1 -- 172.21.15.88:0/147048735 shutdown_connections 2024-01-22T10:14:42.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.507+0000 7fc1de105640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.88:6832/3644863096,v1:172.21.15.88:6833/3644863096] conn(0x7fc1c406b330 0x7fc1c406d7f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.507+0000 7fc1de105640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1d80b49c0 0x7fc1d806fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.507+0000 7fc1de105640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1d81416b0 0x7fc1d8071360 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.507+0000 7fc1de105640 1 --2- 172.21.15.88:0/147048735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1d80b3630 0x7fc1d80703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-22T10:14:42.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.507+0000 7fc1de105640 1 -- 172.21.15.88:0/147048735 >> 172.21.15.88:0/147048735 conn(0x7fc1d806acf0 msgr2=0x7fc1d814a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-22T10:14:42.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.507+0000 7fc1de105640 1 -- 172.21.15.88:0/147048735 shutdown_connections 2024-01-22T10:14:42.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-01-22T10:14:42.507+0000 7fc1de105640 1 -- 172.21.15.88:0/147048735 wait complete. 2024-01-22T10:14:42.500 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-22T10:14:42.501 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-22T10:14:42.501 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-22T10:14:42.501 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:42.511 INFO:tasks.ceph.mds.a:Stopped 2024-01-22T10:14:42.512 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-22T10:14:42.512 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:42.562 INFO:tasks.ceph.mds.c:Stopped 2024-01-22T10:14:42.562 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-22T10:14:42.562 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:42.574 INFO:tasks.ceph.mds.b:Stopped 2024-01-22T10:14:42.574 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-22T10:14:42.575 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-22T10:14:42.575 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:42.629 INFO:tasks.ceph.osd.0:Stopped 2024-01-22T10:14:42.629 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-22T10:14:42.629 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:42.692 INFO:tasks.ceph.osd.1:Stopped 2024-01-22T10:14:42.692 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-22T10:14:42.693 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:42.760 INFO:tasks.ceph.osd.2:Stopped 2024-01-22T10:14:42.760 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-22T10:14:42.760 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:42.825 INFO:tasks.ceph.osd.3:Stopped 2024-01-22T10:14:42.826 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-22T10:14:42.826 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:42.853 INFO:tasks.ceph.osd.4:Stopped 2024-01-22T10:14:42.854 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-22T10:14:42.854 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:42.932 INFO:tasks.ceph.osd.5:Stopped 2024-01-22T10:14:42.932 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-22T10:14:42.932 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:43.013 INFO:tasks.ceph.osd.6:Stopped 2024-01-22T10:14:43.014 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-22T10:14:43.014 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:43.050 INFO:tasks.ceph.osd.7:Stopped 2024-01-22T10:14:43.051 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-22T10:14:43.051 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-22T10:14:43.051 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:43.076 INFO:tasks.ceph.mgr.y:Stopped 2024-01-22T10:14:43.076 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-22T10:14:43.076 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:43.118 INFO:tasks.ceph.mgr.x:Stopped 2024-01-22T10:14:43.118 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-22T10:14:43.118 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-22T10:14:43.118 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:43.129 INFO:tasks.ceph.mon.a:Stopped 2024-01-22T10:14:43.130 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-22T10:14:43.130 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:43.171 INFO:tasks.ceph.mon.b:Stopped 2024-01-22T10:14:43.171 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-22T10:14:43.171 INFO:teuthology.orchestra.run:waiting for 300 2024-01-22T10:14:43.224 INFO:tasks.ceph.mon.c:Stopped 2024-01-22T10:14:43.224 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-22T10:14:43.225 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-22T10:14:43.259 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi088.front.sepia.ceph.com 2024-01-22T10:14:43.259 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-22T10:14:43.421 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi088.front.sepia.ceph.com 2024-01-22T10:14:43.421 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-22T10:14:43.520 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi088.front.sepia.ceph.com 2024-01-22T10:14:43.520 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-22T10:14:43.576 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi088.front.sepia.ceph.com 2024-01-22T10:14:43.576 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-22T10:14:43.631 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi119.front.sepia.ceph.com 2024-01-22T10:14:43.631 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-22T10:14:43.794 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi119.front.sepia.ceph.com 2024-01-22T10:14:43.837 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-22T10:14:43.887 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi119.front.sepia.ceph.com 2024-01-22T10:14:43.887 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-22T10:14:43.937 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi119.front.sepia.ceph.com 2024-01-22T10:14:43.937 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-22T10:14:43.986 INFO:tasks.ceph:Archiving mon data... 2024-01-22T10:14:43.988 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/data/mon.a.tgz 2024-01-22T10:14:43.988 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-01-22T10:14:44.003 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.esuqCCLVUH 2024-01-22T10:14:44.003 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.esuqCCLVUH 2024-01-22T10:14:44.139 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.esuqCCLVUH 2024-01-22T10:14:44.224 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.esuqCCLVUH is 269KB 2024-01-22T10:14:44.318 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.esuqCCLVUH 2024-01-22T10:14:44.333 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/data/mon.b.tgz 2024-01-22T10:14:44.333 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-01-22T10:14:44.351 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.Q2vBxPJFyz 2024-01-22T10:14:44.351 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Q2vBxPJFyz 2024-01-22T10:14:44.493 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.Q2vBxPJFyz 2024-01-22T10:14:44.579 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.Q2vBxPJFyz is 365KB 2024-01-22T10:14:44.674 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.Q2vBxPJFyz 2024-01-22T10:14:44.688 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/data/mon.c.tgz 2024-01-22T10:14:44.688 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-01-22T10:14:44.742 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.zS2oRN5lIJ 2024-01-22T10:14:44.743 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zS2oRN5lIJ 2024-01-22T10:14:44.874 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.zS2oRN5lIJ 2024-01-22T10:14:44.957 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.zS2oRN5lIJ is 365KB 2024-01-22T10:14:45.053 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.zS2oRN5lIJ 2024-01-22T10:14:45.067 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-22T10:14:45.067 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-22T10:14:45.070 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-22T10:14:45.108 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-22T10:14:45.227 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-22T10:14:45.243 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-22T10:14:45.300 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-22T10:14:45.301 INFO:tasks.ceph:Archiving crash dumps... 2024-01-22T10:14:45.303 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/remote/smithi088/crash 2024-01-22T10:14:45.303 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-22T10:14:45.334 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/remote/smithi119/crash 2024-01-22T10:14:45.335 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-22T10:14:45.361 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/remote/smithi161/crash 2024-01-22T10:14:45.362 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-22T10:14:45.471 INFO:tasks.ceph:Shutting down logrotate 2024-01-22T10:14:45.472 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:14:45.474 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:14:45.477 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-22T10:14:45.606 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-22T10:14:45.636 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-22T10:14:45.663 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-22T10:14:45.762 INFO:tasks.ceph:Compressing logs... 2024-01-22T10:14:45.762 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-22T10:14:45.765 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-22T10:14:45.767 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-22T10:14:45.794 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37235.log 2024-01-22T10:14:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-22T10:14:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37275.log 2024-01-22T10:14:45.795 INFO:teuthology.orchestra.run.smithi119.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37235.log.gz/var/log/ceph/ceph-osd.6.log: 2024-01-22T10:14:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37075.log 2024-01-22T10:14:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37035.log 2024-01-22T10:14:45.795 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37075.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-22T10:14:45.795 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37275.log.gz 2024-01-22T10:14:45.795 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37075.log.gz 2024-01-22T10:14:45.796 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37035.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-22T10:14:45.796 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37035.log.gz 2024-01-22T10:14:45.796 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-22T10:14:45.796 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37155.log 2024-01-22T10:14:45.796 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-22T10:14:45.796 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37155.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-22T10:14:45.796 INFO:teuthology.orchestra.run.smithi119.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-22T10:14:45.796 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.7.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37155.log.gz 2024-01-22T10:14:45.797 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36995.log 2024-01-22T10:14:45.797 INFO:teuthology.orchestra.run.smithi119.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-22T10:14:45.797 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-22T10:14:45.797 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37195.log 2024-01-22T10:14:45.803 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36995.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-22T10:14:45.803 INFO:teuthology.orchestra.run.smithi119.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36995.log.gz 2024-01-22T10:14:45.803 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37195.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-22T10:14:45.803 INFO:teuthology.orchestra.run.smithi119.stderr:gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37195.log.gz 2024-01-22T10:14:45.803 INFO:teuthology.orchestra.run.smithi119.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37115.log 2024-01-22T10:14:45.804 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-22T10:14:45.804 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37115.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37115.log.gz 2024-01-22T10:14:45.804 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.c.log: 91.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-22T10:14:45.804 INFO:teuthology.orchestra.run.smithi119.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-22T10:14:45.860 INFO:teuthology.orchestra.run.smithi119.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-22T10:14:45.863 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30247.log 2024-01-22T10:14:45.863 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29834.log 2024-01-22T10:14:45.863 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.30247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30243.log 2024-01-22T10:14:45.864 INFO:teuthology.orchestra.run.smithi161.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.30247.log.gz 2024-01-22T10:14:45.864 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.29834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.29834.log.gz 2024-01-22T10:14:45.864 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29815.log 2024-01-22T10:14:45.864 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.30243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.30243.log.gz 2024-01-22T10:14:45.864 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.29815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.29815.log.gz 2024-01-22T10:14:45.867 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-01-22T10:14:45.867 INFO:teuthology.orchestra.run.smithi161.stderr:real 0m0.047s 2024-01-22T10:14:45.867 INFO:teuthology.orchestra.run.smithi161.stderr:user 0m0.018s 2024-01-22T10:14:45.868 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m0.072s 2024-01-22T10:14:45.878 INFO:teuthology.orchestra.run.smithi119.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-22T10:14:45.881 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44430.log 2024-01-22T10:14:45.881 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46694.log 2024-01-22T10:14:45.881 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44430.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-22T10:14:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49584.log 2024-01-22T10:14:45.882 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44430.log.gz 2024-01-22T10:14:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44093.log 2024-01-22T10:14:45.882 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46694.log.gz 2024-01-22T10:14:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47121.log 2024-01-22T10:14:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44093.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49584.log.gz 2024-01-22T10:14:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49296.log 2024-01-22T10:14:45.882 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44093.log.gz 2024-01-22T10:14:45.882 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49254.log 2024-01-22T10:14:45.883 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47121.log.gz 2024-01-22T10:14:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47884.log 2024-01-22T10:14:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2024-01-22T10:14:45.883 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49296.log.gz 2024-01-22T10:14:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47884.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.49254.log.gz 2024-01-22T10:14:45.883 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44085.log 2024-01-22T10:14:45.883 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47884.log.gz 2024-01-22T10:14:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48960.log 2024-01-22T10:14:45.883 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44713.log 2024-01-22T10:14:45.884 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2024-01-22T10:14:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48960.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44085.log.gz 2024-01-22T10:14:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42570.log 2024-01-22T10:14:45.884 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48960.log.gz 2024-01-22T10:14:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44293.log 2024-01-22T10:14:45.884 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44713.log.gz 2024-01-22T10:14:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43755.log 2024-01-22T10:14:45.884 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44293.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42570.log.gz 2024-01-22T10:14:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45619.log 2024-01-22T10:14:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47535.log 89.1% 2024-01-22T10:14:45.885 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44293.log.gz 2024-01-22T10:14:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48372.log 2024-01-22T10:14:45.885 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43755.log.gz 2024-01-22T10:14:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47535.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45619.log.gz 2024-01-22T10:14:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46207.log 2024-01-22T10:14:45.885 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47535.log.gz 2024-01-22T10:14:45.885 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44965.log 2024-01-22T10:14:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48666.log 2024-01-22T10:14:45.886 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48372.log.gz 2024-01-22T10:14:45.886 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46207.log.gz 2024-01-22T10:14:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45787.log 2024-01-22T10:14:45.886 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44965.log.gz 2024-01-22T10:14:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2024-01-22T10:14:45.886 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48666.log: /var/log/ceph/ceph-client.admin.45787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48876.log 2024-01-22T10:14:45.886 INFO:teuthology.orchestra.run.smithi088.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48666.log.gz 2024-01-22T10:14:45.886 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45787.log.gz 2024-01-22T10:14:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37242.log 2024-01-22T10:14:45.887 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-01-22T10:14:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42874.log 2024-01-22T10:14:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37242.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48876.log.gz 2024-01-22T10:14:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36862.log 2024-01-22T10:14:45.887 INFO:teuthology.orchestra.run.smithi088.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37242.log.gz 2024-01-22T10:14:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42832.log 2024-01-22T10:14:45.887 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42874.log.gz 2024-01-22T10:14:45.887 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.36862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47703.log 2024-01-22T10:14:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42832.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36862.log.gz 2024-01-22T10:14:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47366.log 2024-01-22T10:14:45.888 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42832.log.gz 2024-01-22T10:14:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49212.log 2024-01-22T10:14:45.888 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47703.log.gz 2024-01-22T10:14:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46946.log 2024-01-22T10:14:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49212.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47366.log.gz 2024-01-22T10:14:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48498.log 2024-01-22T10:14:45.889 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49212.log.gz 2024-01-22T10:14:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46778.log 2024-01-22T10:14:45.889 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46946.log.gz 2024-01-22T10:14:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47409.log 2024-01-22T10:14:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46778.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48498.log.gz 2024-01-22T10:14:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48708.log 2024-01-22T10:14:45.889 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46778.log.gz 2024-01-22T10:14:45.889 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46484.log 2024-01-22T10:14:45.890 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47409.log.gz 2024-01-22T10:14:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48330.log 2024-01-22T10:14:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46484.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.48708.log.gz -5 2024-01-22T10:14:45.890 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46081.log 2024-01-22T10:14:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48330.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46484.log.gz 2024-01-22T10:14:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44095.log 2024-01-22T10:14:45.890 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48330.log.gz 2024-01-22T10:14:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42747.log 2024-01-22T10:14:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44425.log 2024-01-22T10:14:45.891 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46081.log.gz 2024-01-22T10:14:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42747.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44095.log.gz 2024-01-22T10:14:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42478.log 2024-01-22T10:14:45.891 INFO:teuthology.orchestra.run.smithi088.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42747.log.gz 2024-01-22T10:14:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48834.log 2024-01-22T10:14:45.891 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5%/var/log/ceph/ceph-client.admin.42478.log: -- replaced with /var/log/ceph/ceph-client.admin.44425.log.gz 2024-01-22T10:14:45.891 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45661.log 2024-01-22T10:14:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48834.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42478.log.gz 2024-01-22T10:14:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45535.log 2024-01-22T10:14:45.892 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48834.log.gz 2024-01-22T10:14:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-22T10:14:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45661.log: /var/log/ceph/ceph-client.admin.45535.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45661.log.gz -5 2024-01-22T10:14:45.892 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48222.log 2024-01-22T10:14:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.audit.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45535.log.gz 2024-01-22T10:14:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42789.log 2024-01-22T10:14:45.892 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45409.log 2024-01-22T10:14:45.893 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48222.log.gz 2024-01-22T10:14:45.893 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48180.log 2024-01-22T10:14:45.893 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-22T10:14:45.893 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49044.log 2024-01-22T10:14:45.893 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45409.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42789.log.gz 2024-01-22T10:14:45.893 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37112.log 2024-01-22T10:14:45.893 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45409.log.gz 2024-01-22T10:14:45.893 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49044.log: gzip -5 89.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.48180.log.gz 2024-01-22T10:14:45.893 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.admin.48918.log 2024-01-22T10:14:45.894 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49044.log.gz 2024-01-22T10:14:45.894 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.37112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47451.log 2024-01-22T10:14:45.894 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37112.log.gz 2024-01-22T10:14:45.894 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47661.log 2024-01-22T10:14:45.894 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47451.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48918.log.gz 2024-01-22T10:14:45.894 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44433.log 2024-01-22T10:14:45.894 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47661.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47451.log.gz 2024-01-22T10:14:45.894 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44839.log 2024-01-22T10:14:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44433.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47661.log.gz 2024-01-22T10:14:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48582.log 2024-01-22T10:14:45.895 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44433.log.gz 2024-01-22T10:14:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45913.log 2024-01-22T10:14:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46039.log 2024-01-22T10:14:45.895 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44839.log.gz 2024-01-22T10:14:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45913.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48582.log.gz 2024-01-22T10:14:45.895 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46652.log 2024-01-22T10:14:45.895 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45913.log.gz 2024-01-22T10:14:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46736.log 2024-01-22T10:14:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44091.log 2024-01-22T10:14:45.896 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46039.log.gz 2024-01-22T10:14:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46736.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46652.log.gz 2024-01-22T10:14:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47324.log 2024-01-22T10:14:45.896 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46736.log.gz 2024-01-22T10:14:45.896 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45007.log 2024-01-22T10:14:45.897 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47324.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44091.log.gz 2024-01-22T10:14:45.897 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44881.log 2024-01-22T10:14:45.897 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47324.log.gz 2024-01-22T10:14:45.897 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45217.log 2024-01-22T10:14:45.897 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44881.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45007.log.gz 2024-01-22T10:14:45.897 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45871.log 2024-01-22T10:14:45.897 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44881.log.gz 2024-01-22T10:14:45.897 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45217.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-22T10:14:45.897 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45217.log.gz 2024-01-22T10:14:45.898 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45175.log 2024-01-22T10:14:45.898 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46316.log 2024-01-22T10:14:45.898 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45871.log.gz 2024-01-22T10:14:45.898 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47577.log 2024-01-22T10:14:45.898 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46316.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45175.log.gz 2024-01-22T10:14:45.898 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47619.log 2024-01-22T10:14:45.898 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46316.log.gz 2024-01-22T10:14:45.898 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48540.log 2024-01-22T10:14:45.898 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47577.log.gz 2024-01-22T10:14:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43411.log 2024-01-22T10:14:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47619.log: /var/log/ceph/ceph-client.admin.48540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48054.log 2024-01-22T10:14:45.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47619.log.gz 2024-01-22T10:14:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43411.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48540.log.gz 2024-01-22T10:14:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45259.log 2024-01-22T10:14:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45367.log 2024-01-22T10:14:45.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43411.log.gz 2024-01-22T10:14:45.899 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48054.log: /var/log/ceph/ceph-client.admin.45259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46123.log 2024-01-22T10:14:45.899 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48054.log.gz 2024-01-22T10:14:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46904.log 2024-01-22T10:14:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45367.log: /var/log/ceph/ceph-client.admin.46123.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45259.log.gz 2024-01-22T10:14:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44671.log 2024-01-22T10:14:45.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45367.log.gz 2024-01-22T10:14:45.900 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46123.log.gz 2024-01-22T10:14:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46249.log 2024-01-22T10:14:45.900 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46904.log: /var/log/ceph/ceph-client.admin.44671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49002.log 2024-01-22T10:14:45.900 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46904.log.gz 2024-01-22T10:14:45.901 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46249.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44671.log.gz 2024-01-22T10:14:45.901 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43241.log 2024-01-22T10:14:45.901 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49170.log 2024-01-22T10:14:45.901 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46249.log.gz 2024-01-22T10:14:45.901 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49002.log: /var/log/ceph/ceph-client.admin.43241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45493.log 2024-01-22T10:14:45.901 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49002.log.gz 2024-01-22T10:14:45.901 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43241.log.gz 2024-01-22T10:14:45.901 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43754.log 2024-01-22T10:14:45.902 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49170.log: /var/log/ceph/ceph-client.admin.45493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44797.log 2024-01-22T10:14:45.902 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49170.log.gz 2024-01-22T10:14:45.902 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43754.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45493.log.gz 2024-01-22T10:14:45.902 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46165.log 2024-01-22T10:14:45.902 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44797.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43754.log.gz 2024-01-22T10:14:45.902 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47006.log 2024-01-22T10:14:45.902 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44797.log.gz 2024-01-22T10:14:45.902 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43761.log 2024-01-22T10:14:45.902 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46165.log.gz 2024-01-22T10:14:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43757.log 2024-01-22T10:14:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47006.log: /var/log/ceph/ceph-client.admin.43761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45703.log 2024-01-22T10:14:45.903 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47006.log.gz 2024-01-22T10:14:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43757.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43761.log.gz 2024-01-22T10:14:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-22T10:14:45.903 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43757.log.gz 2024-01-22T10:14:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46442.log 2024-01-22T10:14:45.903 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45703.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46400.log 2024-01-22T10:14:45.904 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45703.log.gz 2024-01-22T10:14:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43044.log 2024-01-22T10:14:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46400.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46442.log.gz 2024-01-22T10:14:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43327.log 2024-01-22T10:14:45.904 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46400.log.gz 2024-01-22T10:14:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48012.log 2024-01-22T10:14:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43327.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43044.log.gz 2024-01-22T10:14:45.904 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44426.log 2024-01-22T10:14:45.904 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43327.log.gz 2024-01-22T10:14:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45325.log 2024-01-22T10:14:45.905 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48012.log.gz 2024-01-22T10:14:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44094.log 2024-01-22T10:14:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43756.log 2024-01-22T10:14:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45325.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44426.log.gz 2024-01-22T10:14:45.905 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45829.log 2024-01-22T10:14:45.905 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45325.log.gz 2024-01-22T10:14:45.905 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44094.log.gz 2024-01-22T10:14:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44629.log 2024-01-22T10:14:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46610.log 2024-01-22T10:14:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45829.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43756.log.gz 2024-01-22T10:14:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46526.log 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45829.log.gz 2024-01-22T10:14:45.906 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-01-22T10:14:45.906 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44629.log.gz 2024-01-22T10:14:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48096.log 2024-01-22T10:14:45.906 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43495.log 2024-01-22T10:14:45.907 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46610.log.gz 2024-01-22T10:14:45.907 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46526.log: /var/log/ceph/ceph-client.admin.48096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44096.log 2024-01-22T10:14:45.907 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46526.log.gz 2024-01-22T10:14:45.907 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43495.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48096.log.gz 2024-01-22T10:14:45.907 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43199.log 2024-01-22T10:14:45.907 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43495.log.gz 2024-01-22T10:14:45.907 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45091.log 2024-01-22T10:14:45.907 INFO:teuthology.orchestra.run.smithi088.stderr:gzip 87.2%/var/log/ceph/ceph-client.admin.43199.log: -5 -- replaced with /var/log/ceph/ceph-client.admin.44096.log.gz --verbose 2024-01-22T10:14:45.907 INFO:teuthology.orchestra.run.smithi088.stderr: -- /var/log/ceph/ceph-client.admin.49338.log 2024-01-22T10:14:45.908 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45049.log 2024-01-22T10:14:45.908 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43199.log.gz 2024-01-22T10:14:45.908 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49338.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45091.log.gz 2024-01-22T10:14:45.908 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43369.log 2024-01-22T10:14:45.908 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45049.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49338.log.gz 2024-01-22T10:14:45.908 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46568.log 2024-01-22T10:14:45.908 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2%/var/log/ceph/ceph-client.admin.43369.log: -- replaced with /var/log/ceph/ceph-client.admin.45049.log.gz 2024-01-22T10:14:45.908 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43369.log.gz 2024-01-22T10:14:45.909 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48138.log 2024-01-22T10:14:45.909 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-22T10:14:45.909 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46568.log: /var/log/ceph/ceph-client.admin.48138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47926.log 2024-01-22T10:14:45.909 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46568.log.gz 2024-01-22T10:14:45.909 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48138.log.gz 2024-01-22T10:14:45.909 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47747.log 2024-01-22T10:14:45.909 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45577.log 2024-01-22T10:14:45.909 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47926.log.gz 2024-01-22T10:14:45.909 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48414.log 2024-01-22T10:14:45.910 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5/var/log/ceph/ceph-client.admin.45577.log: 88.0% --verbose -- /var/log/ceph/ceph-client.admin.46820.log 2024-01-22T10:14:45.910 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47747.log.gz 2024-01-22T10:14:45.910 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48414.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45577.log.gz 2024-01-22T10:14:45.910 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47970.log 2024-01-22T10:14:45.910 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48414.log.gz 2024-01-22T10:14:45.910 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49380.log 2024-01-22T10:14:45.910 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46820.log.gz 2024-01-22T10:14:45.910 INFO:teuthology.orchestra.run.smithi088.stderr:gzip/var/log/ceph/ceph-client.admin.47970.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43000.log 2024-01-22T10:14:45.910 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49380.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47970.log.gz 2024-01-22T10:14:45.911 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49380.log.gz 2024-01-22T10:14:45.911 INFO:teuthology.orchestra.run.smithi088.stderr: -- /var/log/ceph/ceph-client.admin.44427.log 2024-01-22T10:14:45.911 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44923.log 2024-01-22T10:14:45.911 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43000.log.gz 2024-01-22T10:14:45.911 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48456.log 2024-01-22T10:14:45.911 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44427.log.gz 2024-01-22T10:14:45.911 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44923.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-22T10:14:45.911 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44089.log 2024-01-22T10:14:45.912 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44923.log.gz 2024-01-22T10:14:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.0.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48456.log.gz 2024-01-22T10:14:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43758.log 2024-01-22T10:14:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46358.log 2024-01-22T10:14:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43758.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44089.log.gz 2024-01-22T10:14:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45997.log 2024-01-22T10:14:45.912 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43758.log.gz 2024-01-22T10:14:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48792.log 2024-01-22T10:14:45.912 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46358.log: /var/log/ceph/ceph-client.admin.45997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45745.log 2024-01-22T10:14:45.913 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48792.log: 87.3% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46358.log.gz 2024-01-22T10:14:45.913 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45997.log.gz 2024-01-22T10:14:45.913 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48792.log.gz 2024-01-22T10:14:45.913 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49128.log 2024-01-22T10:14:45.913 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-22T10:14:45.913 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45745.log: /var/log/ceph/ceph-client.admin.49128.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-22T10:14:45.913 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45745.log.gz 2024-01-22T10:14:45.913 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49128.log.gz 2024-01-22T10:14:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47068.log 2024-01-22T10:14:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- 84.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-22T10:14:45.914 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.admin.43285.log 2024-01-22T10:14:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45955.log 2024-01-22T10:14:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43285.log: /var/log/ceph/ceph-client.admin.47068.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47068.log.gz 2024-01-22T10:14:45.914 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43285.log.gz 2024-01-22T10:14:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-22T10:14:45.914 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42666.log 2024-01-22T10:14:45.915 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45955.log.gz/var/log/ceph/ceph-mds.c.log: 2024-01-22T10:14:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44755.log 2024-01-22T10:14:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42666.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42666.log.gz 2024-01-22T10:14:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48750.log 2024-01-22T10:14:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44755.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44755.log.gz 2024-01-22T10:14:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45133.log 2024-01-22T10:14:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48750.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48750.log.gz 2024-01-22T10:14:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46862.log 2024-01-22T10:14:45.915 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45133.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45133.log.gz 2024-01-22T10:14:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43537.log 2024-01-22T10:14:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46862.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46862.log.gz 2024-01-22T10:14:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42916.log 2024-01-22T10:14:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43537.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43537.log.gz 2024-01-22T10:14:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30963.log 2024-01-22T10:14:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42916.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42916.log.gz 2024-01-22T10:14:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44097.log 2024-01-22T10:14:45.916 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.tmp-client.admin.30963.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30963.log.gz 2024-01-22T10:14:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49086.log 2024-01-22T10:14:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44097.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44097.log.gz 2024-01-22T10:14:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43759.log 2024-01-22T10:14:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49086.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49086.log.gz 2024-01-22T10:14:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49422.log 2024-01-22T10:14:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43759.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43759.log.gz 2024-01-22T10:14:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42958.log 2024-01-22T10:14:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49422.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49422.log.gz 2024-01-22T10:14:45.917 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44429.log 2024-01-22T10:14:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42958.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42958.log.gz 2024-01-22T10:14:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43760.log 2024-01-22T10:14:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44429.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44429.log.gz 2024-01-22T10:14:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49544.log 2024-01-22T10:14:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43760.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43760.log.gz 2024-01-22T10:14:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45451.log 2024-01-22T10:14:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49544.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49544.log.gz 2024-01-22T10:14:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49626.log 2024-01-22T10:14:45.918 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45451.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45451.log.gz 2024-01-22T10:14:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47791.log 2024-01-22T10:14:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49626.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49626.log.gz 2024-01-22T10:14:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48264.log 2024-01-22T10:14:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47791.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47791.log.gz 2024-01-22T10:14:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:gzip 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-22T10:14:45.919 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2024-01-22T10:14:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47282.log 2024-01-22T10:14:45.919 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44428.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.48264.log.gz 2024-01-22T10:14:45.919 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz 2024-01-22T10:14:45.920 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47201.log 2024-01-22T10:14:45.920 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43579.log 2024-01-22T10:14:45.920 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2%/var/log/ceph/ceph-client.admin.47201.log: -- replaced with /var/log/ceph/ceph-client.admin.47282.log.gz 2024-01-22T10:14:45.920 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49482.log 2024-01-22T10:14:45.920 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47201.log.gz/var/log/ceph/ceph-client.admin.43579.log: 2024-01-22T10:14:45.920 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43157.log 2024-01-22T10:14:45.920 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43579.log.gz 2024-01-22T10:14:45.920 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49482.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-22T10:14:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43157.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49482.log.gz 2024-01-22T10:14:45.921 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43157.log.gz 2024-01-22T10:14:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43453.log 2024-01-22T10:14:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47842.log 2024-01-22T10:14:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.43453.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43453.log.gz 2024-01-22T10:14:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48624.log 2024-01-22T10:14:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47842.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47842.log.gz 2024-01-22T10:14:45.921 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48624.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48624.log.gz 2024-01-22T10:14:45.921 INFO:teuthology.orchestra.run.smithi088.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-22T10:14:45.922 INFO:teuthology.orchestra.run.smithi088.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-22T10:14:45.962 INFO:teuthology.orchestra.run.smithi088.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-22T10:14:46.354 INFO:teuthology.orchestra.run.smithi119.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-22T10:14:46.360 INFO:teuthology.orchestra.run.smithi119.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-22T10:14:46.372 INFO:teuthology.orchestra.run.smithi119.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-22T10:14:46.380 INFO:teuthology.orchestra.run.smithi119.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-22T10:14:46.381 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-01-22T10:14:46.382 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m0.603s 2024-01-22T10:14:46.382 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m2.362s 2024-01-22T10:14:46.382 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.114s 2024-01-22T10:14:46.384 INFO:teuthology.orchestra.run.smithi088.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-22T10:14:46.395 INFO:teuthology.orchestra.run.smithi088.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-22T10:14:46.409 INFO:teuthology.orchestra.run.smithi088.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-22T10:14:46.418 INFO:teuthology.orchestra.run.smithi088.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-22T10:14:46.420 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-01-22T10:14:46.420 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m0.642s 2024-01-22T10:14:46.420 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m2.543s 2024-01-22T10:14:46.420 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m0.218s 2024-01-22T10:14:46.420 INFO:tasks.ceph:Archiving logs... 2024-01-22T10:14:46.421 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/remote/smithi088/log 2024-01-22T10:14:46.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-22T10:14:46.939 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/remote/smithi119/log 2024-01-22T10:14:46.940 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-22T10:14:47.274 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/remote/smithi161/log 2024-01-22T10:14:47.275 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-22T10:14:47.375 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-22T10:14:47.385 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-22T10:14:47.385 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-22T10:14:47.388 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-22T10:14:47.391 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-22T10:14:47.562 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-22T10:14:47.571 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-22T10:14:47.572 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T10:14:47.574 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T10:14:47.577 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-22T10:14:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-01-22T10:14:47.589 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-01-22T10:14:47.591 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-22T10:14:47.591 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-01-22T10:14:47.591 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 15 -220us[ -220us] +/- 93ms 2024-01-22T10:14:47.591 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv02.front.sepia.ceph.com 3 6 377 17 -1059us[-1064us] +/- 62ms 2024-01-22T10:14:47.592 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +1337us[+1332us] +/- 67ms 2024-01-22T10:14:47.592 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:14:47.594 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-22T10:14:47.594 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-01-22T10:14:47.594 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 15 -227us[ -227us] +/- 93ms 2024-01-22T10:14:47.594 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv02.front.sepia.ceph.com 3 6 377 15 -1059us[-1056us] +/- 62ms 2024-01-22T10:14:47.595 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +1363us[+1367us] +/- 67ms 2024-01-22T10:14:47.595 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:14:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2024-01-22T10:14:47.641 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-22T10:14:47.641 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-01-22T10:14:47.641 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 17 -213us[ -206us] +/- 93ms 2024-01-22T10:14:47.642 INFO:teuthology.orchestra.run.smithi161.stdout:^* hv02.front.sepia.ceph.com 3 6 377 17 -1018us[-1011us] +/- 62ms 2024-01-22T10:14:47.642 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +1349us[+1356us] +/- 67ms 2024-01-22T10:14:47.642 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-22T10:14:47.643 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-22T10:14:47.652 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-22T10:14:47.652 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-22T10:14:47.705 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-22T10:14:47.775 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-22T10:14:47.842 DEBUG:teuthology.orchestra.run.smithi161:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-22T10:14:48.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-22T10:14:48.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:14:48.051 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-22T10:14:48.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:14:48.082 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-22T10:14:48.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:14:48.178 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-22T10:14:48.188 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-22T10:14:48.240 INFO:teuthology.task.internal:Duration was 622.399708 seconds 2024-01-22T10:14:48.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-22T10:14:48.249 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-22T10:14:48.250 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-22T10:14:48.252 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-22T10:14:48.255 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-22T10:14:48.296 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-22T10:14:48.299 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-22T10:14:48.413 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-22T10:14:48.867 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-22T10:14:48.867 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-01-22T10:14:48.867 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-22T10:14:48.891 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-01-22T10:14:48.891 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-22T10:14:48.925 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-01-22T10:14:48.925 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-22T10:14:49.002 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-22T10:14:49.002 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-22T10:14:49.005 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-22T10:14:49.008 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-22T10:14:49.094 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-22T10:14:49.094 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-22T10:14:49.097 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-22T10:14:49.099 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-22T10:14:49.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-22T10:14:49.278 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-22T10:14:49.279 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-22T10:14:49.306 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-22T10:14:49.334 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-22T10:14:49.429 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-22T10:14:49.440 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-22T10:14:49.442 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-22T10:14:49.445 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-22T10:14:49.466 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-01-22T10:14:49.468 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-01-22T10:14:49.556 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-01-22T10:14:49.606 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-22T10:14:49.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:14:49.620 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-22T10:14:49.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:14:49.634 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-22T10:14:49.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-22T10:14:49.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-22T10:14:49.699 INFO:teuthology.task.internal:Transferring archived files... 2024-01-22T10:14:49.700 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/remote/smithi088 2024-01-22T10:14:49.700 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-22T10:14:49.735 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/remote/smithi119 2024-01-22T10:14:49.735 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-22T10:14:49.770 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821/remote/smithi161 2024-01-22T10:14:49.770 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-22T10:14:49.875 INFO:teuthology.task.internal:Removing archive directory... 2024-01-22T10:14:49.876 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-22T10:14:49.878 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-22T10:14:49.881 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-22T10:14:49.936 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-22T10:14:49.949 INFO:teuthology.task.internal:Not uploading archives. 2024-01-22T10:14:49.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-22T10:14:49.959 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-22T10:14:49.960 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-22T10:14:49.962 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-22T10:14:49.964 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-22T10:14:49.974 INFO:teuthology.orchestra.run.smithi088.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 22 10:14 /home/ubuntu/cephtest 2024-01-22T10:14:49.976 INFO:teuthology.orchestra.run.smithi119.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 22 10:14 /home/ubuntu/cephtest 2024-01-22T10:14:50.022 INFO:teuthology.orchestra.run.smithi161.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 22 10:14 /home/ubuntu/cephtest 2024-01-22T10:14:50.025 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-22T10:14:50.036 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-22T10:14:50.058 INFO:teuthology.nuke:Checking targets against current locks 2024-01-22T10:14:50.084 DEBUG:teuthology.nuke:shortname: smithi088 2024-01-22T10:14:50.084 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-22T10:14:50.107 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 09:54:49.318258', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGm5qBD0MFmF8O4lnKGEV6qA0sCe4oCTIPKXrZ7F3jhJe9dA72pdz5ZT53WhJ1X0wob/kQHl6oFQiBqWYfH3pjo='} 2024-01-22T10:14:50.111 DEBUG:teuthology.nuke:shortname: smithi119 2024-01-22T10:14:50.111 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-22T10:14:50.137 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 09:54:49.315322', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCY0m/WpUHgCVnUUbvaYPkk/w+THGvIi/cNKNAZvjymIqqgQLUoISRXPsIPcRbLekfvBUKvLgs+lfl6KCwQLxYs='} 2024-01-22T10:14:50.138 DEBUG:teuthology.nuke:shortname: smithi161 2024-01-22T10:14:50.138 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-22T10:14:50.167 INFO:teuthology.orchestra.console.smithi088:Power off 2024-01-22T10:14:50.168 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-22T10:14:50.178 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-22_07:03:31-fs-wip-vshankar-testing-20240119.075157-1-testing-default-smithi/7525821', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-22 09:54:49.317158', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC2rvdlHQbUj1hPmC8FBgSykvYQbw/1D74T2kAubvxkL9ZH4gsqn9nigCpVq58EdCyzuMuTCTLyMYsbSWK3olCE='} 2024-01-22T10:14:50.191 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-01-22T10:14:50.192 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T10:14:50.206 INFO:teuthology.orchestra.console.smithi119:Power off 2024-01-22T10:14:50.207 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-22T10:14:50.220 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-01-22T10:14:50.229 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2024-01-22T10:14:50.229 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T10:14:50.249 INFO:teuthology.orchestra.console.smithi161:Power off 2024-01-22T10:14:50.249 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-22T10:14:50.259 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-01-22T10:14:50.271 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-01-22T10:14:50.271 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T10:14:50.294 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-22T10:14:54.221 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T10:14:54.259 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T10:14:54.295 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T10:14:54.332 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-01-22T10:14:54.370 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-01-22T10:14:54.406 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-22T10:14:58.333 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T10:14:58.371 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T10:14:58.407 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T10:14:58.443 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-01-22T10:14:58.480 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-01-22T10:14:58.516 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-01-22T10:15:02.446 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T10:15:02.481 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T10:15:02.517 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-22T10:15:02.557 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-01-22T10:15:02.591 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-01-22T10:15:02.628 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-01-22T10:15:02.658 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-01-22T10:15:02.692 INFO:teuthology.orchestra.console.smithi119:Power off completed 2024-01-22T10:15:02.729 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-01-22T10:15:02.834 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 06652275eb934672217aaf9d4180f4a90395eb16 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-common}} duration: 622.3997075557709 failure_reason: 'Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7183efa5b6184004b2482bb09606cdb5 status: fail success: false 2024-01-22T10:15:02.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-22T10:15:02.909 INFO:teuthology.run:FAIL